2024-04-18T03:24:41.321 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T03:24:41.321 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439 --verbose --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --owner scheduled_teuthology@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/workunit/dir-max-entries} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/orig.config.yaml 2024-04-18T03:24:41.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:24:41.466 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439 branch: reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/workunit/dir-max-entries} email: ceph-qa@ceph.com first_in_suite: false job_id: '7661439' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 56a91dd158be807f143cc918a11685fc9ee164ae ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 56a91dd158be807f143cc918a11685fc9ee164ae subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5203 sha1: 56a91dd158be807f143cc918a11685fc9ee164ae sleep_before_teardown: 0 subset: 88/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: client.0: - fs/maxentries teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-17_22:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-18T03:24:41.466 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-18T03:24:41.467 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-18T03:24:41.467 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-18T03:24:41.468 INFO:teuthology.task.internal:Checking packages... 2024-04-18T03:24:41.494 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '56a91dd158be807f143cc918a11685fc9ee164ae' 2024-04-18T03:24:41.494 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T03:24:41.494 INFO:teuthology.packaging:ref: None 2024-04-18T03:24:41.494 INFO:teuthology.packaging:tag: None 2024-04-18T03:24:41.494 INFO:teuthology.packaging:branch: reef 2024-04-18T03:24:41.494 INFO:teuthology.packaging:sha1: 56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T03:24:41.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-04-18T03:24:41.738 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1235-g46238ac3-1focal 2024-04-18T03:24:41.740 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-18T03:24:41.746 INFO:teuthology.task.internal:no buildpackages task found 2024-04-18T03:24:41.746 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-18T03:24:41.753 INFO:teuthology.task.internal:Saving configuration 2024-04-18T03:24:41.769 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-18T03:24:41.776 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T03:24:41.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 03:18:01.522694', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-18T03:24:41.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 03:18:01.520819', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-18T03:24:41.826 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-18T03:24:41.833 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-18T03:24:41.833 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-18T03:24:41.833 INFO:teuthology.run_tasks:Running task console_log... 2024-04-18T03:24:41.907 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f18fa56eee0>, signals=[15]) 2024-04-18T03:24:41.907 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-18T03:24:41.913 INFO:teuthology.task.internal:Opening connections... 2024-04-18T03:24:41.913 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:24:41.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:24:42.007 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:24:42.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:24:42.098 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-18T03:24:42.104 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-04-18T03:24:42.111 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-04-18T03:24:42.112 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-04-18T03:24:42.160 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-04-18T03:24:42.160 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-18T03:24:42.160 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-04-18T03:24:42.160 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-04-18T03:24:42.160 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-18T03:24:42.160 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="20.04" 2024-04-18T03:24:42.160 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T03:24:42.161 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T03:24:42.161 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T03:24:42.161 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T03:24:42.161 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=focal 2024-04-18T03:24:42.161 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=focal 2024-04-18T03:24:42.162 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-04-18T03:24:42.188 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-18T03:24:42.201 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-18T03:24:42.202 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-18T03:24:42.253 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Ubuntu" 2024-04-18T03:24:42.254 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-18T03:24:42.254 INFO:teuthology.orchestra.run.smithi175.stdout:ID=ubuntu 2024-04-18T03:24:42.254 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE=debian 2024-04-18T03:24:42.254 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-18T03:24:42.254 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="20.04" 2024-04-18T03:24:42.254 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T03:24:42.254 INFO:teuthology.orchestra.run.smithi175.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T03:24:42.254 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T03:24:42.255 INFO:teuthology.orchestra.run.smithi175.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T03:24:42.255 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_CODENAME=focal 2024-04-18T03:24:42.255 INFO:teuthology.orchestra.run.smithi175.stdout:UBUNTU_CODENAME=focal 2024-04-18T03:24:42.255 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-18T03:24:42.276 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-18T03:24:42.441 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-18T03:24:42.806 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-18T03:24:42.807 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-04-18T03:24:42.810 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-04-18T03:24:42.815 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-18T03:24:42.975 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-18T03:24:42.975 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-04-18T03:24:42.978 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-04-18T03:24:42.992 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-18T03:24:43.052 INFO:teuthology.run_tasks:Running task kernel... 2024-04-18T03:24:43.066 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-18T03:24:43.066 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-18T03:24:43.067 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T03:24:43.067 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T03:24:43.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:24:43.073 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-04-18T03:24:43.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:24:43.074 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-18T03:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout:5.4.0-124-generic 2024-04-18T03:24:43.080 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.4.0-124-generic 2024-04-18T03:24:43.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get clean 2024-04-18T03:24:43.120 INFO:teuthology.orchestra.run.smithi157.stdout:5.4.0-124-generic 2024-04-18T03:24:43.120 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.4.0-124-generic 2024-04-18T03:24:43.120 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-04-18T03:24:43.223 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-18T03:24:43.231 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-04-18T03:24:43.398 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-18T03:24:43.398 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-18T03:24:43.399 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-18T03:24:43.479 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-18T03:24:43.513 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-18T03:24:43.514 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-18T03:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-18T03:24:43.785 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-18T03:24:43.887 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-18T03:24:43.926 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [961 kB] 2024-04-18T03:24:43.929 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-18T03:24:43.938 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-18T03:24:43.942 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-18T03:24:43.942 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-18T03:24:43.971 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-18T03:24:43.972 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-18T03:24:43.975 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-18T03:24:43.975 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-18T03:24:43.983 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-18T03:24:43.993 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-18T03:24:43.993 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-18T03:24:43.996 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-18T03:24:43.998 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-18T03:24:43.998 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-18T03:24:44.019 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-18T03:24:44.019 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-18T03:24:44.024 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,233 kB] 2024-04-18T03:24:44.078 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [514 kB] 2024-04-18T03:24:44.083 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-18T03:24:44.083 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,852 kB] 2024-04-18T03:24:44.111 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-18T03:24:44.111 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [398 kB] 2024-04-18T03:24:44.115 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-18T03:24:44.115 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [782 kB] 2024-04-18T03:24:44.122 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,180 kB] 2024-04-18T03:24:44.131 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,233 kB] 2024-04-18T03:24:44.133 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-18T03:24:44.136 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-18T03:24:44.137 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-18T03:24:44.137 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-18T03:24:44.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-18T03:24:44.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-18T03:24:44.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-18T03:24:44.155 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-18T03:24:44.155 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-18T03:24:44.156 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-18T03:24:44.175 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-18T03:24:44.176 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-18T03:24:44.346 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-18T03:24:44.538 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-18T03:24:44.553 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-18T03:24:44.553 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-18T03:24:44.609 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [961 kB] 2024-04-18T03:24:44.626 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [514 kB] 2024-04-18T03:24:44.628 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-18T03:24:44.628 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-18T03:24:44.636 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-18T03:24:44.636 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-18T03:24:44.653 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-18T03:24:44.653 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-18T03:24:44.653 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,852 kB] 2024-04-18T03:24:44.672 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-18T03:24:44.737 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [398 kB] 2024-04-18T03:24:44.744 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-18T03:24:44.847 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-18T03:24:44.907 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [782 kB] 2024-04-18T03:24:45.281 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-18T03:24:45.286 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-18T03:24:45.293 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-18T03:24:45.295 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-18T03:24:45.297 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-18T03:24:45.501 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,180 kB] 2024-04-18T03:24:45.611 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-18T03:24:45.635 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-18T03:24:45.635 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-18T03:24:45.635 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-18T03:24:45.635 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-18T03:24:45.636 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-18T03:24:45.636 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-18T03:24:45.638 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-18T03:24:45.641 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-18T03:24:45.805 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-18T03:24:45.968 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-18T03:24:46.019 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-18T03:24:47.954 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 19.8 MB in 3s (7,152 kB/s) 2024-04-18T03:24:48.568 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 19.8 MB in 3s (5,922 kB/s) 2024-04-18T03:24:49.487 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-18T03:24:49.515 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T03:24:49.585 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-18T03:24:49.798 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-04-18T03:24:49.799 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-04-18T03:24:49.997 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-04-18T03:24:49.997 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-5.4.0-176 linux-headers-5.4.0-176-generic 2024-04-18T03:24:49.997 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-generic linux-image-5.4.0-176-generic 2024-04-18T03:24:49.997 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-5.4.0-176-generic linux-modules-extra-5.4.0-176-generic 2024-04-18T03:24:49.998 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-04-18T03:24:49.998 INFO:teuthology.orchestra.run.smithi157.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-18T03:24:49.998 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-04-18T03:24:49.998 INFO:teuthology.orchestra.run.smithi157.stdout: thermald 2024-04-18T03:24:50.055 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-04-18T03:24:50.055 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-5.4.0-176 linux-headers-5.4.0-176-generic 2024-04-18T03:24:50.055 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-176-generic linux-modules-5.4.0-176-generic 2024-04-18T03:24:50.055 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-extra-5.4.0-176-generic 2024-04-18T03:24:50.057 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-04-18T03:24:50.057 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T03:24:50.082 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-18T03:24:50.108 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T03:24:50.117 INFO:teuthology.orchestra.run.smithi157.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-18T03:24:50.117 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 77.1 MB of archives. 2024-04-18T03:24:50.117 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-18T03:24:50.117 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-176-generic amd64 5.4.0-176.196 [15.0 MB] 2024-04-18T03:24:50.194 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-18T03:24:50.404 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-18T03:24:50.405 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-18T03:24:50.495 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-176-generic amd64 5.4.0-176.196 [10.5 MB] 2024-04-18T03:24:50.592 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-176-generic amd64 5.4.0-176.196 [39.2 MB] 2024-04-18T03:24:50.610 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-18T03:24:50.610 INFO:teuthology.orchestra.run.smithi175.stdout: linux-generic linux-headers-5.4.0-176 linux-headers-5.4.0-176-generic 2024-04-18T03:24:50.610 INFO:teuthology.orchestra.run.smithi175.stdout: linux-headers-generic linux-image-5.4.0-176-generic 2024-04-18T03:24:50.610 INFO:teuthology.orchestra.run.smithi175.stdout: linux-modules-5.4.0-176-generic linux-modules-extra-5.4.0-176-generic 2024-04-18T03:24:50.611 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-18T03:24:50.611 INFO:teuthology.orchestra.run.smithi175.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-18T03:24:50.611 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-04-18T03:24:50.611 INFO:teuthology.orchestra.run.smithi175.stdout: thermald 2024-04-18T03:24:50.676 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-18T03:24:50.676 INFO:teuthology.orchestra.run.smithi175.stdout: linux-headers-5.4.0-176 linux-headers-5.4.0-176-generic 2024-04-18T03:24:50.676 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-176-generic linux-modules-5.4.0-176-generic 2024-04-18T03:24:50.676 INFO:teuthology.orchestra.run.smithi175.stdout: linux-modules-extra-5.4.0-176-generic 2024-04-18T03:24:50.677 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-04-18T03:24:50.677 INFO:teuthology.orchestra.run.smithi175.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T03:24:50.754 INFO:teuthology.orchestra.run.smithi175.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-18T03:24:50.754 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 77.1 MB of archives. 2024-04-18T03:24:50.754 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-18T03:24:50.754 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-176-generic amd64 5.4.0-176.196 [15.0 MB] 2024-04-18T03:24:51.204 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.176.174 [1,896 B] 2024-04-18T03:24:51.204 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.176.174 [2,592 B] 2024-04-18T03:24:51.205 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-176 all 5.4.0-176.196 [11.0 MB] 2024-04-18T03:24:51.260 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-176-generic amd64 5.4.0-176.196 [10.5 MB] 2024-04-18T03:24:51.371 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-176-generic amd64 5.4.0-176.196 [39.2 MB] 2024-04-18T03:24:51.614 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-176-generic amd64 5.4.0-176.196 [1,377 kB] 2024-04-18T03:24:51.678 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.176.174 [2,464 B] 2024-04-18T03:24:51.956 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.176.174 [1,896 B] 2024-04-18T03:24:51.956 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.176.174 [2,592 B] 2024-04-18T03:24:51.956 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-176 all 5.4.0-176.196 [11.0 MB] 2024-04-18T03:24:52.059 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-176-generic amd64 5.4.0-176.196 [1,377 kB] 2024-04-18T03:24:52.070 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.176.174 [2,464 B] 2024-04-18T03:24:52.423 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 77.1 MB in 2s (47.8 MB/s) 2024-04-18T03:24:52.605 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-5.4.0-176-generic. 2024-04-18T03:24:52.731 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 77.1 MB in 1s (55.6 MB/s) 2024-04-18T03:24:52.894 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-modules-5.4.0-176-generic. 2024-04-18T03:24:54.358 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-18T03:24:54.363 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-linux-modules-5.4.0-176-generic_5.4.0-176.196_amd64.deb ... 2024-04-18T03:24:54.519 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:24:54.572 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-18T03:24:54.577 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../0-linux-modules-5.4.0-176-generic_5.4.0-176.196_amd64.deb ... 2024-04-18T03:24:54.650 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-modules-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:24:56.436 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-5.4.0-176-generic. 2024-04-18T03:24:56.451 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-linux-image-5.4.0-176-generic_5.4.0-176.196_amd64.deb ... 2024-04-18T03:24:56.553 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:24:56.557 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-image-5.4.0-176-generic. 2024-04-18T03:24:56.571 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../1-linux-image-5.4.0-176-generic_5.4.0-176.196_amd64.deb ... 2024-04-18T03:24:56.672 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:24:57.706 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-176-generic. 2024-04-18T03:24:57.719 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-176-generic_5.4.0-176.196_amd64.deb ... 2024-04-18T03:24:57.744 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-176-generic. 2024-04-18T03:24:57.760 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-176-generic_5.4.0-176.196_amd64.deb ... 2024-04-18T03:24:57.764 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-extra-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:24:57.793 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-modules-extra-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:02.441 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../3-linux-generic_5.4.0.176.174_amd64.deb ... 2024-04-18T03:25:02.559 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-generic (5.4.0.176.174) over (5.4.0.124.125) ... 2024-04-18T03:25:02.709 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-linux-generic_5.4.0.176.174_amd64.deb ... 2024-04-18T03:25:02.862 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-generic (5.4.0.176.174) over (5.4.0.124.125) ... 2024-04-18T03:25:02.944 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.176.174_amd64.deb ... 2024-04-18T03:25:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-generic (5.4.0.176.174) over (5.4.0.124.125) ... 2024-04-18T03:25:03.257 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.176.174_amd64.deb ... 2024-04-18T03:25:03.382 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-generic (5.4.0.176.174) over (5.4.0.124.125) ... 2024-04-18T03:25:03.408 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-headers-5.4.0-176. 2024-04-18T03:25:03.425 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../5-linux-headers-5.4.0-176_5.4.0-176.196_all.deb ... 2024-04-18T03:25:03.466 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-5.4.0-176 (5.4.0-176.196) ... 2024-04-18T03:25:03.743 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.4.0-176. 2024-04-18T03:25:03.759 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-linux-headers-5.4.0-176_5.4.0-176.196_all.deb ... 2024-04-18T03:25:03.801 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.4.0-176 (5.4.0-176.196) ... 2024-04-18T03:25:08.772 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-headers-5.4.0-176-generic. 2024-04-18T03:25:08.792 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../6-linux-headers-5.4.0-176-generic_5.4.0-176.196_amd64.deb ... 2024-04-18T03:25:08.830 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:10.204 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.4.0-176-generic. 2024-04-18T03:25:10.225 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-linux-headers-5.4.0-176-generic_5.4.0-176.196_amd64.deb ... 2024-04-18T03:25:10.262 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:11.426 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.176.174_amd64.deb ... 2024-04-18T03:25:11.554 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-generic (5.4.0.176.174) over (5.4.0.124.125) ... 2024-04-18T03:25:11.880 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-modules-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:13.100 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-5.4.0-176 (5.4.0-176.196) ... 2024-04-18T03:25:13.227 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:13.424 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.176.174_amd64.deb ... 2024-04-18T03:25:13.546 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-generic (5.4.0.176.174) over (5.4.0.124.125) ... 2024-04-18T03:25:13.921 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-176-generic 2024-04-18T03:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-176-generic 2024-04-18T03:25:14.545 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:14.671 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-generic (5.4.0.176.174) ... 2024-04-18T03:25:14.797 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-modules-extra-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:15.110 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.4.0-176 (5.4.0-176.196) ... 2024-04-18T03:25:15.244 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:15.982 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-generic (5.4.0.176.174) ... 2024-04-18T03:25:16.116 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-generic (5.4.0.176.174) ... 2024-04-18T03:25:16.268 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for linux-image-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:16.340 INFO:teuthology.orchestra.run.smithi175.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T03:25:16.340 INFO:teuthology.orchestra.run.smithi175.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-176-generic 2024-04-18T03:25:16.381 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-176-generic 2024-04-18T03:25:16.381 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-176-generic 2024-04-18T03:25:16.530 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:16.656 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-generic (5.4.0.176.174) ... 2024-04-18T03:25:16.807 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-extra-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:18.942 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-generic (5.4.0.176.174) ... 2024-04-18T03:25:19.101 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-generic (5.4.0.176.174) ... 2024-04-18T03:25:19.244 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for linux-image-5.4.0-176-generic (5.4.0-176.196) ... 2024-04-18T03:25:19.316 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T03:25:19.316 INFO:teuthology.orchestra.run.smithi157.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-176-generic 2024-04-18T03:25:38.468 INFO:teuthology.orchestra.run.smithi175.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T03:25:38.469 INFO:teuthology.orchestra.run.smithi175.stdout:Sourcing file `/etc/default/grub' 2024-04-18T03:25:38.480 INFO:teuthology.orchestra.run.smithi175.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T03:25:38.491 INFO:teuthology.orchestra.run.smithi175.stdout:Generating grub configuration file ... 2024-04-18T03:25:38.836 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.4.0-176-generic 2024-04-18T03:25:38.856 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.4.0-176-generic 2024-04-18T03:25:39.272 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-18T03:25:39.283 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-18T03:25:41.056 INFO:teuthology.orchestra.run.smithi175.stdout:done 2024-04-18T03:25:41.550 DEBUG:teuthology.orchestra.run.smithi175:> dpkg -s linux-image-generic 2024-04-18T03:25:41.603 INFO:teuthology.orchestra.run.smithi175.stdout:Package: linux-image-generic 2024-04-18T03:25:41.603 INFO:teuthology.orchestra.run.smithi175.stdout:Status: install ok installed 2024-04-18T03:25:41.603 INFO:teuthology.orchestra.run.smithi175.stdout:Priority: optional 2024-04-18T03:25:41.603 INFO:teuthology.orchestra.run.smithi175.stdout:Section: kernel 2024-04-18T03:25:41.603 INFO:teuthology.orchestra.run.smithi175.stdout:Installed-Size: 20 2024-04-18T03:25:41.603 INFO:teuthology.orchestra.run.smithi175.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T03:25:41.603 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: amd64 2024-04-18T03:25:41.603 INFO:teuthology.orchestra.run.smithi175.stdout:Source: linux-meta 2024-04-18T03:25:41.604 INFO:teuthology.orchestra.run.smithi175.stdout:Version: 5.4.0.176.174 2024-04-18T03:25:41.604 INFO:teuthology.orchestra.run.smithi175.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-18T03:25:41.604 INFO:teuthology.orchestra.run.smithi175.stdout:Depends: linux-image-5.4.0-176-generic, linux-modules-extra-5.4.0-176-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T03:25:41.604 INFO:teuthology.orchestra.run.smithi175.stdout:Recommends: thermald 2024-04-18T03:25:41.604 INFO:teuthology.orchestra.run.smithi175.stdout:Description: Generic Linux kernel image 2024-04-18T03:25:41.604 INFO:teuthology.orchestra.run.smithi175.stdout: This package will always depend on the latest generic kernel image 2024-04-18T03:25:41.604 INFO:teuthology.orchestra.run.smithi175.stdout: available. 2024-04-18T03:25:41.604 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-176-generic 2024-04-18T03:25:41.604 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T03:25:41.604 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T03:25:41.605 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-18T03:25:41.605 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T03:25:41.605 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get clean 2024-04-18T03:25:41.682 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-18T03:25:41.750 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T03:25:41.750 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub' 2024-04-18T03:25:41.758 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T03:25:41.768 INFO:teuthology.orchestra.run.smithi157.stdout:Generating grub configuration file ... 2024-04-18T03:25:41.855 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-18T03:25:41.942 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-18T03:25:42.023 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-18T03:25:42.098 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-176-generic 2024-04-18T03:25:42.105 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-18T03:25:42.125 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-176-generic 2024-04-18T03:25:42.515 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-18T03:25:42.527 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-18T03:25:43.647 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-18T03:25:43.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T03:25:43.744 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-18T03:25:43.930 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-18T03:25:44.171 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-18T03:25:44.171 INFO:teuthology.orchestra.run.smithi175.stdout:linux-image-generic is already the newest version (5.4.0.176.174). 2024-04-18T03:25:44.171 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-18T03:25:44.171 DEBUG:teuthology.orchestra.run.smithi175:> dpkg -s linux-image-generic 2024-04-18T03:25:44.192 INFO:teuthology.orchestra.run.smithi175.stdout:Package: linux-image-generic 2024-04-18T03:25:44.192 INFO:teuthology.orchestra.run.smithi175.stdout:Status: install ok installed 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Priority: optional 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Section: kernel 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Installed-Size: 20 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: amd64 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Source: linux-meta 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Version: 5.4.0.176.174 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Depends: linux-image-5.4.0-176-generic, linux-modules-extra-5.4.0-176-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Recommends: thermald 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout:Description: Generic Linux kernel image 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: This package will always depend on the latest generic kernel image 2024-04-18T03:25:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: available. 2024-04-18T03:25:44.194 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-18T03:25:44.242 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.lVDtecs3mZ 2024-04-18T03:25:44.242 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lVDtecs3mZ 2024-04-18T03:25:44.258 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.lVDtecs3mZ 2024-04-18T03:25:44.344 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.lVDtecs3mZ is 9KB 2024-04-18T03:25:44.359 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.lVDtecs3mZ 2024-04-18T03:25:44.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T03:25:44.376 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-04-18T03:25:44.423 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:25:44.423 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T03:25:44.423 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T03:25:44.451 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-176-generic 2024-04-18T03:25:44.451 DEBUG:teuthology.orchestra.run.smithi175:> sudo update-grub 2024-04-18T03:25:44.817 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-04-18T03:25:44.855 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-04-18T03:25:44.855 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-04-18T03:25:44.855 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-04-18T03:25:44.855 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 20 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.4.0.176.174 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.4.0-176-generic, linux-modules-extra-5.4.0-176-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-04-18T03:25:44.856 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-04-18T03:25:44.856 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-176-generic 2024-04-18T03:25:44.856 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T03:25:44.857 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T03:25:44.857 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-18T03:25:44.857 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T03:25:44.857 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-04-18T03:25:44.957 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-04-18T03:25:45.097 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-18T03:25:45.107 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-18T03:25:45.128 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-18T03:25:45.209 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-18T03:25:45.670 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub' 2024-04-18T03:25:45.680 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T03:25:45.725 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-04-18T03:25:45.993 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-176-generic 2024-04-18T03:25:46.005 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-176-generic 2024-04-18T03:25:46.423 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-18T03:25:46.435 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-18T03:25:46.894 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-18T03:25:46.920 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T03:25:46.990 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-18T03:25:47.147 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-04-18T03:25:47.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-04-18T03:25:47.189 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-04-18T03:25:47.189 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-04-18T03:25:47.407 INFO:teuthology.orchestra.run.smithi157.stdout:linux-image-generic is already the newest version (5.4.0.176.174). 2024-04-18T03:25:47.407 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-18T03:25:47.409 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-04-18T03:25:47.425 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-04-18T03:25:47.425 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-04-18T03:25:47.425 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-04-18T03:25:47.425 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-04-18T03:25:47.425 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 20 2024-04-18T03:25:47.425 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.4.0.176.174 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.4.0-176-generic, linux-modules-extra-5.4.0-176-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-04-18T03:25:47.426 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-04-18T03:25:47.426 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-04-18T03:25:47.431 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.RZbTbikLGu 2024-04-18T03:25:47.431 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub/grub.cfg /tmp/tmp.RZbTbikLGu 2024-04-18T03:25:47.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.RZbTbikLGu 2024-04-18T03:25:47.525 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.RZbTbikLGu is 9KB 2024-04-18T03:25:47.539 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.RZbTbikLGu 2024-04-18T03:25:47.545 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T03:25:47.558 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:25:47.559 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T03:25:47.559 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T03:25:47.595 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-176-generic 2024-04-18T03:25:47.595 DEBUG:teuthology.orchestra.run.smithi157:> sudo update-grub 2024-04-18T03:25:49.034 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2024-04-18T03:25:49.042 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T03:25:49.054 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-04-18T03:25:49.336 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-176-generic 2024-04-18T03:25:49.348 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-176-generic 2024-04-18T03:25:49.743 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-18T03:25:49.754 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-18T03:25:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-04-18T03:25:50.518 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-04-18T03:26:17.178 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-18T03:26:17.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-18T03:26:17.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:20.526 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T03:26:20.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T03:26:20.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:55.007 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T03:27:04.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T03:27:04.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:07.074 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T03:27:17.190 DEBUG:teuthology.orchestra.remote:timed out 2024-04-18T03:27:19.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T03:27:19.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:26.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-18T03:27:26.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:26.463 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-18T03:27:27.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-18T03:27:27.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-176-generic"... 2024-04-18T03:27:27.278 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-18T03:27:27.284 INFO:teuthology.orchestra.run.smithi175.stdout:5.4.0-176-generic 2024-04-18T03:27:27.284 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-176-generic vs 5.4.0-176-generic 2024-04-18T03:27:27.284 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T03:27:27.285 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T03:27:28.285 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-18T03:27:28.286 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T03:27:28.382 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-04-18T03:27:28.404 DEBUG:teuthology.parallel:result is None 2024-04-18T03:27:37.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-04-18T03:27:52.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T03:27:52.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:53.012 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-04-18T03:27:53.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T03:27:53.885 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-176-generic"... 2024-04-18T03:27:53.885 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-04-18T03:27:53.934 INFO:teuthology.orchestra.run.smithi157.stdout:5.4.0-176-generic 2024-04-18T03:27:53.934 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-176-generic vs 5.4.0-176-generic 2024-04-18T03:27:53.934 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T03:27:53.934 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T03:27:54.935 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-18T03:27:54.936 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T03:27:55.015 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-04-18T03:27:55.039 DEBUG:teuthology.parallel:result is None 2024-04-18T03:27:55.039 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-18T03:27:55.050 INFO:teuthology.task.internal:Creating test directory... 2024-04-18T03:27:55.050 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T03:27:55.053 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T03:27:55.060 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-18T03:27:55.073 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-18T03:27:55.082 INFO:teuthology.task.internal:Creating archive directory... 2024-04-18T03:27:55.083 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T03:27:55.102 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T03:27:55.122 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-18T03:27:55.128 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-18T03:27:55.128 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T03:27:55.130 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T03:27:55.153 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T03:27:55.156 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T03:27:55.164 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T03:27:55.166 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T03:27:55.168 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-18T03:27:55.175 INFO:teuthology.task.internal:Configuring sudo... 2024-04-18T03:27:55.175 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T03:27:55.178 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T03:27:55.192 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-18T03:27:55.201 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-18T03:27:55.202 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T03:27:55.234 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T03:27:55.240 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T03:27:55.247 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T03:27:55.253 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:27:55.254 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T03:27:55.323 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T03:27:55.330 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T03:27:55.384 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:27:55.385 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T03:27:55.400 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-04-18T03:27:55.402 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-04-18T03:27:55.447 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-18T03:27:55.457 INFO:teuthology.task.internal:Starting timer... 2024-04-18T03:27:55.458 INFO:teuthology.run_tasks:Running task pcp... 2024-04-18T03:27:55.468 INFO:teuthology.run_tasks:Running task selinux... 2024-04-18T03:27:55.476 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-04-18T03:27:55.476 DEBUG:teuthology.task.selinux:Excluding smithi175: OS 'ubuntu' does not support SELinux 2024-04-18T03:27:55.476 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-18T03:27:55.476 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-18T03:27:55.476 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-18T03:27:55.477 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-18T03:27:55.486 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-18T03:27:55.503 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-18T03:27:55.504 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi157.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-18T03:33:32.103 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi157.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-04-18T03:33:32.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T03:33:32.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:33:32.195 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-04-18T03:33:32.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-18T03:33:32.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-18T03:33:32.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:33:32.417 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-18T03:33:32.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-18T03:33:32.540 INFO:teuthology.run_tasks:Running task clock... 2024-04-18T03:33:32.557 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-18T03:33:32.557 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T03:33:32.558 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T03:33:32.561 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T03:33:32.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T03:33:32.593 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-18T03:33:32.593 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: Command line: ntpd -gq 2024-04-18T03:33:32.594 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: proto: precision = 0.109 usec (-23) 2024-04-18T03:33:32.595 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T03:33:32.596 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T03:33:32.596 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T03:33:32.596 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T03:33:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T03:33:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T03:33:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T03:33:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-04-18T03:33:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: Listen normally on 4 lo [::1]:123 2024-04-18T03:33:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-04-18T03:33:32.597 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:32 ntpd[12942]: Listening on routing socket on fd #22 for interface updates 2024-04-18T03:33:32.614 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-18T03:33:32.614 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: Command line: ntpd -gq 2024-04-18T03:33:32.615 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: proto: precision = 0.296 usec (-22) 2024-04-18T03:33:32.616 INFO:teuthology.orchestra.run.smithi175.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T03:33:32.616 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-18T03:33:32.617 INFO:teuthology.orchestra.run.smithi175.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-18T03:33:32.618 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: restrict ::: KOD does nothing without LIMITED. 2024-04-18T03:33:32.618 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: Listen and drop on 0 v6wildcard [::]:123 2024-04-18T03:33:32.618 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-18T03:33:32.618 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: Listen normally on 2 lo 127.0.0.1:123 2024-04-18T03:33:32.618 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: Listen normally on 3 enp3s0f1 172.21.15.175:123 2024-04-18T03:33:32.618 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: Listen normally on 4 lo [::1]:123 2024-04-18T03:33:32.618 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:71f1%5]:123 2024-04-18T03:33:32.618 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:32 ntpd[12965]: Listening on routing socket on fd #22 for interface updates 2024-04-18T03:33:34.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:34 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:34.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:34 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:34.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:34 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:34.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:34 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:34.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:34 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:34.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:34 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:34.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:34 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:34.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:34 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:34.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:34 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:34.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:34 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:34.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:34 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:34.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:34 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:35 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:35.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:35 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:35.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:35 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:35.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:35 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:35.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:35 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:35.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:35 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:35.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:35 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:36.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:36 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:36.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:36 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:36.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:36 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:36.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:36 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:36.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:36 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:36.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:36 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:36.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:36.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:36.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:36.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:36.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:36.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:36.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:36.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:36.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:36.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:36.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:36.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:36.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:36.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:36 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:37 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:37.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:37 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:37.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:37 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:37.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:37 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:37.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:37 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:37.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:37 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:37.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:37 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:38.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:38 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:38.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:38 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:38.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:38 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:38.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:38 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:38.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:38 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:38.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:38 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:38.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:38.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:38.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:38.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:38.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:38.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:38.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:38.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:38.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:38.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:38.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:38.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:38 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:39.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:39.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:39.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:39.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:39.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:39.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:39.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:39.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:39.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:39.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:39.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:39.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:39 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:39.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:39 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:39.615 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:39 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:39 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:39 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:39 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:39.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:39 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:40 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:40 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:40 ntpd[12942]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:40 ntpd[12942]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:40 ntpd[12942]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:40 ntpd[12942]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:40.595 INFO:teuthology.orchestra.run.smithi157.stdout:18 Apr 03:33:40 ntpd[12942]: ntpd: time slew +0.000872 s 2024-04-18T03:33:40.595 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew +0.000872s 2024-04-18T03:33:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:40 ntpd[12942]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T03:33:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:18 Apr 03:33:40 ntpd[12942]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: can't open /var/log/ntpstats/rawstats.20240418: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: can't open /var/log/ntpstats/peerstats.20240418: Permission denied 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stdout:18 Apr 03:33:40 ntpd[12965]: ntpd: time slew +0.004782 s 2024-04-18T03:33:40.616 INFO:teuthology.orchestra.run.smithi175.stdout:ntpd: time slew +0.004782s 2024-04-18T03:33:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-18T03:33:40.617 INFO:teuthology.orchestra.run.smithi175.stderr:18 Apr 03:33:40 ntpd[12965]: can't open /var/log/ntpstats/loopstats.20240418: Permission denied 2024-04-18T03:33:40.658 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T03:33:40.658 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-04-18T03:33:40.658 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:33:40.658 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:33:40.658 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:33:40.658 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:33:40.689 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T03:33:40.689 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-04-18T03:33:40.689 INFO:teuthology.orchestra.run.smithi175.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:33:40.689 INFO:teuthology.orchestra.run.smithi175.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:33:40.689 INFO:teuthology.orchestra.run.smithi175.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:33:40.689 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:33:40.690 INFO:teuthology.run_tasks:Running task install... 2024-04-18T03:33:40.699 DEBUG:teuthology.task.install:project ceph 2024-04-18T03:33:40.699 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}} 2024-04-18T03:33:40.699 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'} 2024-04-18T03:33:40.700 INFO:teuthology.task.install:Using flavor: default 2024-04-18T03:33:40.705 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T03:33:40.705 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-04-18T03:33:40.706 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2024-04-18T03:33:40.707 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-key list | grep Ceph 2024-04-18T03:33:40.804 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-18T03:33:40.805 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-18T03:33:40.863 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T03:33:40.863 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T03:33:40.864 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-18T03:33:40.864 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-18T03:33:40.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T03:33:40.870 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-18T03:33:40.870 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph.com (release key) 2024-04-18T03:33:40.870 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-18T03:33:40.870 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-18T03:33:40.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T03:33:41.018 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default/ 2024-04-18T03:33:41.019 INFO:teuthology.task.install.deb:Package version is 18.2.2-1229-g56a91dd1-1focal 2024-04-18T03:33:41.091 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default/ 2024-04-18T03:33:41.091 INFO:teuthology.task.install.deb:Package version is 18.2.2-1229-g56a91dd1-1focal 2024-04-18T03:33:41.189 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:33:41.189 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T03:33:41.205 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:33:41.205 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-18T03:33:41.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-04-18T03:33:41.222 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-18T03:33:41.352 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-18T03:33:41.352 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-18T03:33:41.361 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-18T03:33:41.382 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-18T03:33:41.462 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal InRelease 2024-04-18T03:33:41.502 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-18T03:33:41.523 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal InRelease 2024-04-18T03:33:41.537 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-18T03:33:41.538 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-18T03:33:41.539 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal Release.gpg 2024-04-18T03:33:41.560 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-18T03:33:41.575 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main i386 Packages [3,421 B] 2024-04-18T03:33:41.598 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal Release.gpg 2024-04-18T03:33:41.607 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-18T03:33:41.621 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-18T03:33:41.635 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-18T03:33:41.681 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main i386 Packages [3,421 B] 2024-04-18T03:33:41.689 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-18T03:33:42.001 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 28.4 kB in 1s (44.6 kB/s) 2024-04-18T03:33:42.192 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 28.4 kB in 1s (37.5 kB/s) 2024-04-18T03:33:43.094 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-18T03:33:43.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1229-g56a91dd1-1focal cephadm=18.2.2-1229-g56a91dd1-1focal ceph-mds=18.2.2-1229-g56a91dd1-1focal ceph-mgr=18.2.2-1229-g56a91dd1-1focal ceph-common=18.2.2-1229-g56a91dd1-1focal ceph-fuse=18.2.2-1229-g56a91dd1-1focal ceph-test=18.2.2-1229-g56a91dd1-1focal ceph-volume=18.2.2-1229-g56a91dd1-1focal radosgw=18.2.2-1229-g56a91dd1-1focal python3-rados=18.2.2-1229-g56a91dd1-1focal python3-rgw=18.2.2-1229-g56a91dd1-1focal python3-cephfs=18.2.2-1229-g56a91dd1-1focal python3-rbd=18.2.2-1229-g56a91dd1-1focal libcephfs2=18.2.2-1229-g56a91dd1-1focal libcephfs-dev=18.2.2-1229-g56a91dd1-1focal librados2=18.2.2-1229-g56a91dd1-1focal librbd1=18.2.2-1229-g56a91dd1-1focal rbd-fuse=18.2.2-1229-g56a91dd1-1focal python3-cephfs=18.2.2-1229-g56a91dd1-1focal cephfs-shell=18.2.2-1229-g56a91dd1-1focal cephfs-top=18.2.2-1229-g56a91dd1-1focal cephfs-mirror=18.2.2-1229-g56a91dd1-1focal 2024-04-18T03:33:43.188 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-18T03:33:43.299 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-18T03:33:43.325 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1229-g56a91dd1-1focal cephadm=18.2.2-1229-g56a91dd1-1focal ceph-mds=18.2.2-1229-g56a91dd1-1focal ceph-mgr=18.2.2-1229-g56a91dd1-1focal ceph-common=18.2.2-1229-g56a91dd1-1focal ceph-fuse=18.2.2-1229-g56a91dd1-1focal ceph-test=18.2.2-1229-g56a91dd1-1focal ceph-volume=18.2.2-1229-g56a91dd1-1focal radosgw=18.2.2-1229-g56a91dd1-1focal python3-rados=18.2.2-1229-g56a91dd1-1focal python3-rgw=18.2.2-1229-g56a91dd1-1focal python3-cephfs=18.2.2-1229-g56a91dd1-1focal python3-rbd=18.2.2-1229-g56a91dd1-1focal libcephfs2=18.2.2-1229-g56a91dd1-1focal libcephfs-dev=18.2.2-1229-g56a91dd1-1focal librados2=18.2.2-1229-g56a91dd1-1focal librbd1=18.2.2-1229-g56a91dd1-1focal rbd-fuse=18.2.2-1229-g56a91dd1-1focal python3-cephfs=18.2.2-1229-g56a91dd1-1focal cephfs-shell=18.2.2-1229-g56a91dd1-1focal cephfs-top=18.2.2-1229-g56a91dd1-1focal cephfs-mirror=18.2.2-1229-g56a91dd1-1focal 2024-04-18T03:33:43.372 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-04-18T03:33:43.373 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-04-18T03:33:43.398 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-18T03:33:43.552 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T03:33:43.553 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-18T03:33:43.553 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T03:33:43.553 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-04-18T03:33:43.553 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T03:33:43.553 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-18T03:33:43.553 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-18T03:33:43.553 INFO:teuthology.orchestra.run.smithi157.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-18T03:33:43.554 INFO:teuthology.orchestra.run.smithi157.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-18T03:33:43.554 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-18T03:33:43.554 INFO:teuthology.orchestra.run.smithi157.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-18T03:33:43.554 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-18T03:33:43.555 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-18T03:33:43.556 INFO:teuthology.orchestra.run.smithi157.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T03:33:43.557 INFO:teuthology.orchestra.run.smithi157.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-18T03:33:43.557 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-04-18T03:33:43.557 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2024-04-18T03:33:43.606 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-18T03:33:43.606 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-18T03:33:43.674 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-04-18T03:33:43.675 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T03:33:43.675 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T03:33:43.675 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-18T03:33:43.675 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-04-18T03:33:43.675 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-04-18T03:33:43.675 INFO:teuthology.orchestra.run.smithi157.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-04-18T03:33:43.675 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-04-18T03:33:43.676 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-04-18T03:33:43.676 INFO:teuthology.orchestra.run.smithi157.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-18T03:33:43.676 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-18T03:33:43.676 INFO:teuthology.orchestra.run.smithi157.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-18T03:33:43.676 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-04-18T03:33:43.677 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-04-18T03:33:43.678 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 librbd1 2024-04-18T03:33:43.749 INFO:teuthology.orchestra.run.smithi157.stdout:2 upgraded, 116 newly installed, 0 to remove and 277 not upgraded. 2024-04-18T03:33:43.749 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 199 MB of archives. 2024-04-18T03:33:43.749 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 977 MB of additional disk space will be used. 2024-04-18T03:33:43.750 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-04-18T03:33:43.771 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-18T03:33:43.780 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-04-18T03:33:43.792 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T03:33:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-18T03:33:43.794 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T03:33:43.794 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-18T03:33:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-18T03:33:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-18T03:33:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-18T03:33:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-18T03:33:43.794 INFO:teuthology.orchestra.run.smithi175.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-18T03:33:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-18T03:33:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-18T03:33:43.796 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-18T03:33:43.797 INFO:teuthology.orchestra.run.smithi175.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-04-18T03:33:43.798 INFO:teuthology.orchestra.run.smithi175.stdout: btrfs-tools 2024-04-18T03:33:43.812 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-18T03:33:43.825 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1229-g56a91dd1-1focal [3,447 kB] 2024-04-18T03:33:43.847 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-18T03:33:43.851 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-18T03:33:43.868 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-18T03:33:43.918 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-18T03:33:43.918 INFO:teuthology.orchestra.run.smithi175.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-18T03:33:43.918 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-18T03:33:43.918 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-18T03:33:43.918 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-18T03:33:43.919 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-18T03:33:43.920 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-04-18T03:33:43.920 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-04-18T03:33:43.920 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-18T03:33:43.920 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-18T03:33:43.920 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-18T03:33:43.920 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-18T03:33:43.920 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-18T03:33:43.920 INFO:teuthology.orchestra.run.smithi175.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-04-18T03:33:43.921 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-18T03:33:43.921 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-04-18T03:33:43.921 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 librbd1 2024-04-18T03:33:43.921 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-18T03:33:43.928 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-18T03:33:43.930 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-18T03:33:43.931 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-18T03:33:43.932 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-18T03:33:43.932 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-18T03:33:43.935 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-18T03:33:43.936 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-18T03:33:43.940 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-18T03:33:43.958 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-18T03:33:43.959 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-18T03:33:43.960 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-18T03:33:43.961 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T03:33:43.962 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-18T03:33:43.963 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-18T03:33:43.967 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-18T03:33:43.967 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-18T03:33:43.967 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-18T03:33:43.982 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-18T03:33:43.982 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-18T03:33:43.989 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-18T03:33:44.003 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-18T03:33:44.003 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-18T03:33:44.004 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-18T03:33:44.005 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-18T03:33:44.008 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-18T03:33:44.011 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-18T03:33:44.012 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-18T03:33:44.029 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-18T03:33:44.032 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-18T03:33:44.033 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-18T03:33:44.034 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1229-g56a91dd1-1focal [4,030 kB] 2024-04-18T03:33:44.050 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-18T03:33:44.051 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-18T03:33:44.051 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-18T03:33:44.053 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-18T03:33:44.053 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-18T03:33:44.054 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-18T03:33:44.057 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T03:33:44.070 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-18T03:33:44.072 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-18T03:33:44.074 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-18T03:33:44.091 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-18T03:33:44.092 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-18T03:33:44.093 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-18T03:33:44.112 INFO:teuthology.orchestra.run.smithi175.stdout:2 upgraded, 116 newly installed, 0 to remove and 277 not upgraded. 2024-04-18T03:33:44.112 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 199 MB of archives. 2024-04-18T03:33:44.112 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 977 MB of additional disk space will be used. 2024-04-18T03:33:44.112 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-04-18T03:33:44.160 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1229-g56a91dd1-1focal [744 kB] 2024-04-18T03:33:44.165 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1229-g56a91dd1-1focal [3,447 kB] 2024-04-18T03:33:44.184 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1229-g56a91dd1-1focal [388 kB] 2024-04-18T03:33:44.190 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-18T03:33:44.196 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-18T03:33:44.198 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1229-g56a91dd1-1focal [31.9 kB] 2024-04-18T03:33:44.198 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1229-g56a91dd1-1focal [201 kB] 2024-04-18T03:33:44.206 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1229-g56a91dd1-1focal [62.4 kB] 2024-04-18T03:33:44.208 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1229-g56a91dd1-1focal [364 kB] 2024-04-18T03:33:44.234 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-04-18T03:33:44.251 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-18T03:33:44.251 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1229-g56a91dd1-1focal [6,595 kB] 2024-04-18T03:33:44.253 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-18T03:33:44.268 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-18T03:33:44.269 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-18T03:33:44.269 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-18T03:33:44.270 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-18T03:33:44.270 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-18T03:33:44.271 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-18T03:33:44.271 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-18T03:33:44.272 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-18T03:33:44.293 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-18T03:33:44.293 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-18T03:33:44.298 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-18T03:33:44.300 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-18T03:33:44.302 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-18T03:33:44.303 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-18T03:33:44.306 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-18T03:33:44.308 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-04-18T03:33:44.308 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-18T03:33:44.323 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-18T03:33:44.342 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-18T03:33:44.344 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-18T03:33:44.370 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-18T03:33:44.393 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-18T03:33:44.394 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-18T03:33:44.394 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-18T03:33:44.395 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-18T03:33:44.407 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T03:33:44.407 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-18T03:33:44.408 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-18T03:33:44.409 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-18T03:33:44.409 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-18T03:33:44.448 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1229-g56a91dd1-1focal [113 kB] 2024-04-18T03:33:44.451 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1229-g56a91dd1-1focal [475 kB] 2024-04-18T03:33:44.468 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1229-g56a91dd1-1focal [25.1 MB] 2024-04-18T03:33:44.502 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-18T03:33:44.520 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-18T03:33:44.581 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-18T03:33:44.780 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-18T03:33:44.789 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-18T03:33:44.815 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-18T03:33:44.823 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-18T03:33:44.986 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-18T03:33:45.350 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-18T03:33:45.369 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-18T03:33:45.446 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1229-g56a91dd1-1focal [9,603 kB] 2024-04-18T03:33:45.544 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-18T03:33:45.554 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-18T03:33:45.587 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-18T03:33:45.593 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-18T03:33:45.596 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-18T03:33:45.598 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-18T03:33:45.608 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-18T03:33:45.609 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-18T03:33:45.665 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1229-g56a91dd1-1focal [238 kB] 2024-04-18T03:33:45.672 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1229-g56a91dd1-1focal [148 kB] 2024-04-18T03:33:45.677 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1229-g56a91dd1-1focal [1,571 kB] 2024-04-18T03:33:45.733 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1229-g56a91dd1-1focal [6,636 kB] 2024-04-18T03:33:45.774 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-18T03:33:45.965 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1229-g56a91dd1-1focal [24.5 MB] 2024-04-18T03:33:46.093 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-18T03:33:46.114 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-18T03:33:46.184 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-18T03:33:46.246 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-18T03:33:46.255 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-18T03:33:46.373 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-18T03:33:46.374 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-18T03:33:46.378 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-18T03:33:46.382 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-18T03:33:46.393 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-18T03:33:46.518 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1229-g56a91dd1-1focal [4,030 kB] 2024-04-18T03:33:46.579 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-18T03:33:46.936 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1229-g56a91dd1-1focal [13.7 kB] 2024-04-18T03:33:46.942 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1229-g56a91dd1-1focal [853 kB] 2024-04-18T03:33:46.954 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1229-g56a91dd1-1focal [2,291 kB] 2024-04-18T03:33:46.971 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1229-g56a91dd1-1focal [237 kB] 2024-04-18T03:33:46.973 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1229-g56a91dd1-1focal [142 kB] 2024-04-18T03:33:46.974 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1229-g56a91dd1-1focal [7,011 kB] 2024-04-18T03:33:47.023 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-18T03:33:47.035 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-18T03:33:47.080 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-18T03:33:47.124 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-18T03:33:47.134 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-18T03:33:47.139 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-18T03:33:47.149 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-18T03:33:47.154 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-18T03:33:47.170 INFO:teuthology.orchestra.run.smithi175.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-18T03:33:47.172 INFO:teuthology.orchestra.run.smithi175.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-18T03:33:47.228 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1229-g56a91dd1-1focal [7,905 kB] 2024-04-18T03:33:47.343 INFO:teuthology.orchestra.run.smithi175.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-18T03:33:47.530 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1229-g56a91dd1-1focal [13.8 kB] 2024-04-18T03:33:47.530 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1229-g56a91dd1-1focal [46.7 MB] 2024-04-18T03:33:47.631 INFO:teuthology.orchestra.run.smithi175.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1229-g56a91dd1-1focal [744 kB] 2024-04-18T03:33:47.764 INFO:teuthology.orchestra.run.smithi175.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-18T03:33:47.764 INFO:teuthology.orchestra.run.smithi175.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1229-g56a91dd1-1focal [388 kB] 2024-04-18T03:33:47.767 INFO:teuthology.orchestra.run.smithi175.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-18T03:33:47.801 INFO:teuthology.orchestra.run.smithi175.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-18T03:33:47.833 INFO:teuthology.orchestra.run.smithi175.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1229-g56a91dd1-1focal [31.9 kB] 2024-04-18T03:33:47.834 INFO:teuthology.orchestra.run.smithi175.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1229-g56a91dd1-1focal [201 kB] 2024-04-18T03:33:47.851 INFO:teuthology.orchestra.run.smithi175.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-18T03:33:47.861 INFO:teuthology.orchestra.run.smithi175.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1229-g56a91dd1-1focal [62.4 kB] 2024-04-18T03:33:47.870 INFO:teuthology.orchestra.run.smithi175.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1229-g56a91dd1-1focal [364 kB] 2024-04-18T03:33:47.880 INFO:teuthology.orchestra.run.smithi175.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-18T03:33:47.884 INFO:teuthology.orchestra.run.smithi175.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-18T03:33:47.893 INFO:teuthology.orchestra.run.smithi175.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-18T03:33:47.928 INFO:teuthology.orchestra.run.smithi175.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1229-g56a91dd1-1focal [6,595 kB] 2024-04-18T03:33:48.384 INFO:teuthology.orchestra.run.smithi175.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-18T03:33:48.440 INFO:teuthology.orchestra.run.smithi175.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-18T03:33:48.441 INFO:teuthology.orchestra.run.smithi175.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-18T03:33:48.675 INFO:teuthology.orchestra.run.smithi175.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-18T03:33:48.759 INFO:teuthology.orchestra.run.smithi175.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-18T03:33:48.782 INFO:teuthology.orchestra.run.smithi175.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1229-g56a91dd1-1focal [113 kB] 2024-04-18T03:33:48.792 INFO:teuthology.orchestra.run.smithi175.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1229-g56a91dd1-1focal [475 kB] 2024-04-18T03:33:48.843 INFO:teuthology.orchestra.run.smithi175.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1229-g56a91dd1-1focal [25.1 MB] 2024-04-18T03:33:48.901 INFO:teuthology.orchestra.run.smithi175.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-18T03:33:48.955 INFO:teuthology.orchestra.run.smithi175.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-18T03:33:48.981 INFO:teuthology.orchestra.run.smithi175.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-18T03:33:49.021 INFO:teuthology.orchestra.run.smithi175.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-18T03:33:49.034 INFO:teuthology.orchestra.run.smithi175.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-18T03:33:49.085 INFO:teuthology.orchestra.run.smithi175.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-18T03:33:49.089 INFO:teuthology.orchestra.run.smithi175.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-18T03:33:49.104 INFO:teuthology.orchestra.run.smithi175.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-18T03:33:49.183 INFO:teuthology.orchestra.run.smithi175.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-18T03:33:49.372 INFO:teuthology.orchestra.run.smithi175.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-18T03:33:49.734 INFO:teuthology.orchestra.run.smithi175.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-18T03:33:49.760 INFO:teuthology.orchestra.run.smithi175.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-18T03:33:49.870 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1229-g56a91dd1-1focal [119 kB] 2024-04-18T03:33:49.873 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.2-1229-g56a91dd1-1focal [268 kB] 2024-04-18T03:33:49.878 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.2-1229-g56a91dd1-1focal [33.0 kB] 2024-04-18T03:33:49.879 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.2-1229-g56a91dd1-1focal [22.8 kB] 2024-04-18T03:33:49.880 INFO:teuthology.orchestra.run.smithi157.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1229-g56a91dd1-1focal [37.4 kB] 2024-04-18T03:33:49.881 INFO:teuthology.orchestra.run.smithi157.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1229-g56a91dd1-1focal [13.4 MB] 2024-04-18T03:33:49.910 INFO:teuthology.orchestra.run.smithi175.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-18T03:33:49.965 INFO:teuthology.orchestra.run.smithi175.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-04-18T03:33:49.969 INFO:teuthology.orchestra.run.smithi175.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-18T03:33:50.135 INFO:teuthology.orchestra.run.smithi175.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-18T03:33:50.144 INFO:teuthology.orchestra.run.smithi175.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-18T03:33:50.153 INFO:teuthology.orchestra.run.smithi175.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-18T03:33:50.312 INFO:teuthology.orchestra.run.smithi175.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-18T03:33:50.314 INFO:teuthology.orchestra.run.smithi175.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-18T03:33:50.381 INFO:teuthology.orchestra.run.smithi157.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1229-g56a91dd1-1focal [107 kB] 2024-04-18T03:33:50.478 INFO:teuthology.orchestra.run.smithi175.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-18T03:33:50.805 INFO:teuthology.orchestra.run.smithi175.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-18T03:33:50.810 INFO:teuthology.orchestra.run.smithi175.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1229-g56a91dd1-1focal [9,603 kB] 2024-04-18T03:33:51.024 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 199 MB in 7s (29.7 MB/s) 2024-04-18T03:33:51.152 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-18T03:33:51.170 INFO:teuthology.orchestra.run.smithi175.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1229-g56a91dd1-1focal [238 kB] 2024-04-18T03:33:51.173 INFO:teuthology.orchestra.run.smithi175.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1229-g56a91dd1-1focal [148 kB] 2024-04-18T03:33:51.174 INFO:teuthology.orchestra.run.smithi175.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1229-g56a91dd1-1focal [1,571 kB] 2024-04-18T03:33:51.176 INFO:teuthology.orchestra.run.smithi175.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-18T03:33:51.181 INFO:teuthology.orchestra.run.smithi175.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-18T03:33:51.192 INFO:teuthology.orchestra.run.smithi175.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-18T03:33:51.193 INFO:teuthology.orchestra.run.smithi175.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-18T03:33:51.208 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-18T03:33:51.212 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-04-18T03:33:51.238 INFO:teuthology.orchestra.run.smithi175.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-18T03:33:51.244 INFO:teuthology.orchestra.run.smithi175.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1229-g56a91dd1-1focal [6,636 kB] 2024-04-18T03:33:51.250 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-04-18T03:33:51.515 INFO:teuthology.orchestra.run.smithi175.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1229-g56a91dd1-1focal [24.5 MB] 2024-04-18T03:33:51.578 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T03:33:51.598 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-18T03:33:51.636 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-18T03:33:51.964 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cmd2. 2024-04-18T03:33:51.981 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-04-18T03:33:52.022 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-04-18T03:33:52.376 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-18T03:33:52.393 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-18T03:33:52.484 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-18T03:33:52.551 INFO:teuthology.orchestra.run.smithi175.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1229-g56a91dd1-1focal [13.7 kB] 2024-04-18T03:33:52.552 INFO:teuthology.orchestra.run.smithi175.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1229-g56a91dd1-1focal [853 kB] 2024-04-18T03:33:52.567 INFO:teuthology.orchestra.run.smithi175.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1229-g56a91dd1-1focal [2,291 kB] 2024-04-18T03:33:52.627 INFO:teuthology.orchestra.run.smithi175.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1229-g56a91dd1-1focal [237 kB] 2024-04-18T03:33:52.631 INFO:teuthology.orchestra.run.smithi175.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1229-g56a91dd1-1focal [142 kB] 2024-04-18T03:33:52.635 INFO:teuthology.orchestra.run.smithi175.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1229-g56a91dd1-1focal [7,011 kB] 2024-04-18T03:33:52.846 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T03:33:52.864 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-18T03:33:52.895 INFO:teuthology.orchestra.run.smithi175.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1229-g56a91dd1-1focal [7,905 kB] 2024-04-18T03:33:52.921 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-18T03:33:53.196 INFO:teuthology.orchestra.run.smithi175.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1229-g56a91dd1-1focal [13.8 kB] 2024-04-18T03:33:53.196 INFO:teuthology.orchestra.run.smithi175.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1229-g56a91dd1-1focal [46.7 MB] 2024-04-18T03:33:53.241 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T03:33:53.259 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-18T03:33:53.299 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-18T03:33:53.795 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T03:33:53.811 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-18T03:33:53.889 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:33:54.431 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T03:33:54.449 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-18T03:33:54.489 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:33:54.870 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T03:33:54.887 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-18T03:33:54.928 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:33:55.091 INFO:teuthology.orchestra.run.smithi175.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1229-g56a91dd1-1focal [119 kB] 2024-04-18T03:33:55.093 INFO:teuthology.orchestra.run.smithi175.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.2-1229-g56a91dd1-1focal [268 kB] 2024-04-18T03:33:55.099 INFO:teuthology.orchestra.run.smithi175.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.2-1229-g56a91dd1-1focal [33.0 kB] 2024-04-18T03:33:55.100 INFO:teuthology.orchestra.run.smithi175.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.2-1229-g56a91dd1-1focal [22.8 kB] 2024-04-18T03:33:55.101 INFO:teuthology.orchestra.run.smithi175.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1229-g56a91dd1-1focal [37.4 kB] 2024-04-18T03:33:55.102 INFO:teuthology.orchestra.run.smithi175.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1229-g56a91dd1-1focal [13.4 MB] 2024-04-18T03:33:55.339 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-18T03:33:55.358 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-18T03:33:55.397 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-18T03:33:55.469 INFO:teuthology.orchestra.run.smithi175.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/reef/56a91dd158be807f143cc918a11685fc9ee164ae/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1229-g56a91dd1-1focal [107 kB] 2024-04-18T03:33:55.758 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-librbd1_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:33:55.909 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (18.2.2-1229-g56a91dd1-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-18T03:33:56.098 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 199 MB in 12s (17.2 MB/s) 2024-04-18T03:33:56.224 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-18T03:33:56.278 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-18T03:33:56.283 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-04-18T03:33:56.322 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-04-18T03:33:56.591 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-librados2_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:33:56.625 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-18T03:33:56.642 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-18T03:33:56.683 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-18T03:33:56.713 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (18.2.2-1229-g56a91dd1-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-18T03:33:56.995 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cmd2. 2024-04-18T03:33:57.010 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-04-18T03:33:57.053 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-04-18T03:33:57.406 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-18T03:33:57.424 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-18T03:33:57.458 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T03:33:57.475 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-libcephfs2_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:33:57.497 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-18T03:33:57.516 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:33:57.784 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-18T03:33:57.800 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-18T03:33:57.861 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2024-04-18T03:33:57.867 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-18T03:33:57.879 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-python3-rados_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:33:57.919 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:33:58.220 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-18T03:33:58.237 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-18T03:33:58.278 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-18T03:33:58.297 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T03:33:58.313 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:33:58.355 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:33:58.607 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T03:33:58.624 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-cephfs_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:33:58.666 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:33:58.783 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-18T03:33:58.798 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-18T03:33:58.851 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:33:59.018 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T03:33:59.039 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:33:59.076 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:33:59.328 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-18T03:33:59.348 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-18T03:33:59.386 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:33:59.438 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T03:33:59.454 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-04-18T03:33:59.496 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-18T03:33:59.747 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-18T03:33:59.763 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-18T03:33:59.765 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T03:33:59.781 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-python3-rbd_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:33:59.805 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:33:59.823 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:00.201 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-18T03:34:00.218 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-18T03:34:00.259 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-18T03:34:00.333 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-18T03:34:00.350 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-18T03:34:00.383 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-18T03:34:00.638 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-18T03:34:00.655 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-18T03:34:00.696 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-18T03:34:00.747 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../010-librbd1_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:00.870 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librbd1 (18.2.2-1229-g56a91dd1-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-18T03:34:01.274 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T03:34:01.290 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-18T03:34:01.332 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-18T03:34:01.583 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../011-librados2_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:01.660 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2024-04-18T03:34:01.677 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-librgw2_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:01.708 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librados2 (18.2.2-1229-g56a91dd1-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-18T03:34:01.709 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:02.445 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs2. 2024-04-18T03:34:02.464 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../012-libcephfs2_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:02.503 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:02.629 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T03:34:02.645 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-python3-rgw_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:02.687 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:02.823 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rados. 2024-04-18T03:34:02.841 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../013-python3-rados_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:02.881 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rados (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:03.073 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0. 2024-04-18T03:34:03.091 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-18T03:34:03.131 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-18T03:34:03.209 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-18T03:34:03.228 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:03.283 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-argparse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:03.434 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T03:34:03.451 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-libradosstriper1_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:03.517 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:03.544 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cephfs. 2024-04-18T03:34:03.562 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../015-python3-cephfs_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:03.603 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cephfs (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:03.954 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2024-04-18T03:34:03.955 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-18T03:34:03.970 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-ceph-common_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:03.973 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:04.014 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-common (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:04.028 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:04.342 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-prettytable. 2024-04-18T03:34:04.358 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-04-18T03:34:04.400 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-18T03:34:04.695 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rbd. 2024-04-18T03:34:04.713 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../018-python3-rbd_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:04.753 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rbd (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:05.081 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-18T03:34:05.100 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-18T03:34:05.138 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-18T03:34:05.517 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-18T03:34:05.533 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-18T03:34:05.575 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-18T03:34:05.887 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-18T03:34:05.905 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-18T03:34:05.961 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-18T03:34:06.314 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librgw2. 2024-04-18T03:34:06.331 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../022-librgw2_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:06.372 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librgw2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:06.534 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2024-04-18T03:34:06.552 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-ceph-base_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:06.602 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:07.250 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rgw. 2024-04-18T03:34:07.266 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../023-python3-rgw_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:07.325 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rgw (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:07.686 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liboath0. 2024-04-18T03:34:07.702 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-18T03:34:07.744 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-18T03:34:07.838 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T03:34:07.856 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-18T03:34:07.888 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-18T03:34:08.089 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libradosstriper1. 2024-04-18T03:34:08.106 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../025-libradosstriper1_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:08.147 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libradosstriper1 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:08.266 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T03:34:08.284 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-04-18T03:34:08.324 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-18T03:34:08.618 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-common. 2024-04-18T03:34:08.637 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../026-ceph-common_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:08.678 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T03:34:08.683 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-common (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:08.693 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-04-18T03:34:08.735 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-18T03:34:09.063 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T03:34:09.079 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-18T03:34:09.113 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-18T03:34:09.366 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2024-04-18T03:34:09.384 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-18T03:34:09.457 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-18T03:34:09.744 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T03:34:09.763 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T03:34:09.810 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T03:34:10.138 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T03:34:10.154 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-18T03:34:10.196 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-18T03:34:10.524 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2024-04-18T03:34:10.541 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-18T03:34:10.582 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-18T03:34:10.929 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-18T03:34:10.948 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-18T03:34:10.993 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-18T03:34:11.106 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-base. 2024-04-18T03:34:11.122 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../027-ceph-base_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:11.174 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-base (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:11.305 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bs4. 2024-04-18T03:34:11.323 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-04-18T03:34:11.363 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-18T03:34:11.741 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T03:34:11.757 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-18T03:34:11.802 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-18T03:34:12.144 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T03:34:12.161 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-04-18T03:34:12.210 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-18T03:34:12.452 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-18T03:34:12.468 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-18T03:34:12.510 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-18T03:34:12.530 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2024-04-18T03:34:12.546 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-18T03:34:12.588 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-18T03:34:12.880 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-natsort. 2024-04-18T03:34:12.899 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-04-18T03:34:12.938 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-18T03:34:12.941 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T03:34:12.957 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-18T03:34:12.999 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-18T03:34:13.233 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-logutils. 2024-04-18T03:34:13.252 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-04-18T03:34:13.285 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T03:34:13.291 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-18T03:34:13.301 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-18T03:34:13.366 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-18T03:34:13.603 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-18T03:34:13.619 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-18T03:34:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-18T03:34:13.671 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T03:34:13.688 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-04-18T03:34:13.730 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-18T03:34:13.905 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-mako. 2024-04-18T03:34:13.924 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-18T03:34:13.963 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-18T03:34:14.074 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T03:34:14.092 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-18T03:34:14.132 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-18T03:34:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-18T03:34:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-18T03:34:14.375 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-18T03:34:14.496 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T03:34:14.513 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-18T03:34:14.553 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-18T03:34:14.707 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-18T03:34:14.726 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-18T03:34:14.769 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-18T03:34:14.865 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T03:34:14.881 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:14.923 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:15.039 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webob. 2024-04-18T03:34:15.056 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-18T03:34:15.089 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-18T03:34:15.289 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T03:34:15.308 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:15.353 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:15.400 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-18T03:34:15.418 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-18T03:34:15.672 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cryptography. 2024-04-18T03:34:15.688 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-18T03:34:15.691 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-18T03:34:15.730 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-18T03:34:16.084 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T03:34:16.103 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-18T03:34:16.142 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-18T03:34:16.528 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-bs4. 2024-04-18T03:34:16.544 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-04-18T03:34:16.586 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-18T03:34:16.940 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-waitress. 2024-04-18T03:34:16.956 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-18T03:34:17.001 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-18T03:34:17.229 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T03:34:17.248 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-ceph-mgr_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:17.312 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:17.326 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempita. 2024-04-18T03:34:17.345 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-04-18T03:34:17.384 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-18T03:34:17.729 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-paste. 2024-04-18T03:34:17.746 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-18T03:34:17.787 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-18T03:34:17.823 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T03:34:17.839 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-ceph-mon_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:17.881 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:18.048 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-18T03:34:18.064 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-18T03:34:18.098 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-18T03:34:18.418 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-18T03:34:18.437 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-18T03:34:18.475 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-18T03:34:18.779 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webtest. 2024-04-18T03:34:18.793 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T03:34:18.795 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-04-18T03:34:18.811 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-ceph-osd_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:18.851 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:18.854 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-18T03:34:19.165 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pecan. 2024-04-18T03:34:19.182 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-18T03:34:19.223 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-18T03:34:19.561 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-18T03:34:19.577 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-18T03:34:19.611 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-18T03:34:19.914 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-18T03:34:19.931 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:19.972 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:20.378 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-18T03:34:20.393 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:20.435 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:20.764 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cryptography. 2024-04-18T03:34:20.779 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-18T03:34:20.822 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-18T03:34:21.062 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2024-04-18T03:34:21.080 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-ceph_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:21.120 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:21.209 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-openssl. 2024-04-18T03:34:21.226 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-18T03:34:21.267 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-18T03:34:21.456 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T03:34:21.473 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-ceph-fuse_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:21.506 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:21.578 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr. 2024-04-18T03:34:21.595 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../050-ceph-mgr_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:21.628 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:21.992 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T03:34:22.012 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-ceph-mds_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:22.050 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:22.065 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mon. 2024-04-18T03:34:22.080 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../051-ceph-mon_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:22.123 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mon (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:22.637 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2024-04-18T03:34:22.653 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-cephadm_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:22.711 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:23.018 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-osd. 2024-04-18T03:34:23.031 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T03:34:23.037 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../052-ceph-osd_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:23.047 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-18T03:34:23.076 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-osd (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:23.089 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-18T03:34:23.475 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T03:34:23.493 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-18T03:34:23.533 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-18T03:34:23.895 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T03:34:23.911 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:23.953 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:24.315 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T03:34:24.333 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-18T03:34:24.373 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-18T03:34:24.684 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jwt. 2024-04-18T03:34:24.701 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-18T03:34:24.733 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-18T03:34:25.020 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-attr. 2024-04-18T03:34:25.037 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-04-18T03:34:25.111 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-18T03:34:25.163 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph. 2024-04-18T03:34:25.181 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../053-ceph_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:25.212 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:25.422 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T03:34:25.438 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-04-18T03:34:25.465 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-fuse. 2024-04-18T03:34:25.480 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-18T03:34:25.482 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../054-ceph-fuse_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:25.514 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-fuse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:25.792 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2024-04-18T03:34:25.811 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-18T03:34:25.850 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-18T03:34:25.918 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mds. 2024-04-18T03:34:25.937 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../055-ceph-mds_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:25.976 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mds (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:26.208 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-18T03:34:26.225 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-18T03:34:26.266 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-18T03:34:26.596 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephadm. 2024-04-18T03:34:26.602 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-packaging. 2024-04-18T03:34:26.612 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../056-cephadm_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:26.618 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-04-18T03:34:26.654 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephadm (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:26.660 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-18T03:34:26.972 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T03:34:26.989 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-04-18T03:34:26.990 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-18T03:34:27.007 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-18T03:34:27.048 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-18T03:34:27.054 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-18T03:34:27.392 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T03:34:27.409 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T03:34:27.418 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jinja2. 2024-04-18T03:34:27.435 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-18T03:34:27.449 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T03:34:27.485 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-18T03:34:27.736 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjs-underscore. 2024-04-18T03:34:27.753 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-18T03:34:27.785 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-18T03:34:27.829 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-18T03:34:27.847 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:27.887 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:28.096 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-18T03:34:28.112 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-18T03:34:28.154 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-18T03:34:28.272 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-18T03:34:28.290 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-18T03:34:28.332 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-18T03:34:28.499 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2024-04-18T03:34:28.515 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-04-18T03:34:28.557 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-18T03:34:28.635 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jwt. 2024-04-18T03:34:28.651 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-18T03:34:28.702 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-18T03:34:28.885 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T03:34:28.901 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:28.985 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:29.038 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-attr. 2024-04-18T03:34:29.055 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-04-18T03:34:29.096 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-18T03:34:29.399 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pluggy. 2024-04-18T03:34:29.418 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-04-18T03:34:29.457 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-18T03:34:29.776 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-py. 2024-04-18T03:34:29.794 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-18T03:34:29.843 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-18T03:34:30.180 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-18T03:34:30.195 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-18T03:34:30.238 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-18T03:34:30.452 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-decorator. 2024-04-18T03:34:30.470 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-18T03:34:30.510 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-18T03:34:30.565 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-packaging. 2024-04-18T03:34:30.583 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-04-18T03:34:30.624 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-18T03:34:30.838 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-18T03:34:30.854 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-18T03:34:30.896 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-18T03:34:30.925 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pytest. 2024-04-18T03:34:30.941 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-04-18T03:34:31.000 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-18T03:34:31.256 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-scipy. 2024-04-18T03:34:31.273 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-18T03:34:31.314 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-18T03:34:31.345 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-18T03:34:31.363 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-04-18T03:34:31.394 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-18T03:34:32.022 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjs-underscore. 2024-04-18T03:34:32.039 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-18T03:34:32.080 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-18T03:34:32.366 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-18T03:34:32.382 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-18T03:34:32.424 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-18T03:34:32.735 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-routes. 2024-04-18T03:34:32.751 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-04-18T03:34:32.793 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-18T03:34:33.130 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-18T03:34:33.140 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-18T03:34:33.149 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:33.160 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-18T03:34:33.188 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:33.198 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-18T03:34:33.752 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T03:34:33.769 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-04-18T03:34:33.809 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-18T03:34:34.165 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T03:34:34.182 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-18T03:34:34.215 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-18T03:34:34.568 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-decorator. 2024-04-18T03:34:34.584 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-18T03:34:34.626 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-18T03:34:34.906 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T03:34:34.914 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-18T03:34:34.922 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:34.931 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-18T03:34:34.956 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:34.992 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-18T03:34:35.310 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-scipy. 2024-04-18T03:34:35.327 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-18T03:34:35.368 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-18T03:34:36.070 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T03:34:36.083 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-04-18T03:34:36.125 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-18T03:34:36.538 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T03:34:36.555 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-18T03:34:36.596 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-18T03:34:36.675 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-18T03:34:36.692 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-18T03:34:36.733 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-18T03:34:36.959 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T03:34:36.979 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-18T03:34:37.017 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-18T03:34:37.261 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-joblib. 2024-04-18T03:34:37.278 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T03:34:37.281 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-04-18T03:34:37.299 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-04-18T03:34:37.319 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-18T03:34:37.328 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-18T03:34:37.673 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T03:34:37.690 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-04-18T03:34:37.711 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn. 2024-04-18T03:34:37.730 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-18T03:34:37.731 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-18T03:34:37.774 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-18T03:34:38.078 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-blinker. 2024-04-18T03:34:38.094 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-18T03:34:38.127 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-18T03:34:38.463 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-18T03:34:38.481 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-18T03:34:38.490 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-18T03:34:38.506 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:38.521 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-18T03:34:38.548 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:38.834 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T03:34:38.850 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-18T03:34:38.908 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-18T03:34:39.220 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T03:34:39.237 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-18T03:34:39.277 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-18T03:34:39.614 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T03:34:39.633 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-18T03:34:39.659 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cachetools. 2024-04-18T03:34:39.675 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-04-18T03:34:39.680 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-18T03:34:39.742 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-18T03:34:40.072 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-18T03:34:40.091 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-18T03:34:40.122 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-18T03:34:40.307 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T03:34:40.328 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:40.377 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:40.459 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-18T03:34:40.478 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-18T03:34:40.517 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-18T03:34:40.688 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T03:34:40.705 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-04-18T03:34:40.746 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-18T03:34:40.846 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rsa. 2024-04-18T03:34:40.863 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-04-18T03:34:40.904 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-18T03:34:41.041 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T03:34:41.058 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:34:41.099 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-18T03:34:41.216 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-google-auth. 2024-04-18T03:34:41.233 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-04-18T03:34:41.274 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-18T03:34:41.402 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2024-04-18T03:34:41.420 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:34:41.460 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-18T03:34:41.594 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-blinker. 2024-04-18T03:34:41.611 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-18T03:34:41.651 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-18T03:34:41.712 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2024-04-18T03:34:41.728 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-04-18T03:34:41.787 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-18T03:34:41.979 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-18T03:34:41.996 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-18T03:34:42.037 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-18T03:34:42.115 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T03:34:42.133 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-18T03:34:42.173 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-18T03:34:42.368 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-18T03:34:42.384 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-18T03:34:42.450 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-18T03:34:42.544 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2024-04-18T03:34:42.560 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:42.602 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:42.762 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-websocket. 2024-04-18T03:34:42.779 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-18T03:34:42.821 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-18T03:34:43.173 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-18T03:34:43.190 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-18T03:34:43.231 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-18T03:34:43.819 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-18T03:34:43.836 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:43.877 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:44.205 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-18T03:34:44.225 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-04-18T03:34:44.263 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-18T03:34:44.641 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-18T03:34:44.657 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:34:44.699 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-18T03:34:44.969 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package jq. 2024-04-18T03:34:44.988 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:34:45.027 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-18T03:34:45.271 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package socat. 2024-04-18T03:34:45.290 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-04-18T03:34:45.321 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-18T03:34:45.649 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package xmlstarlet. 2024-04-18T03:34:45.669 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-18T03:34:45.707 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-18T03:34:46.070 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-test. 2024-04-18T03:34:46.088 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:46.128 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-test (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:46.756 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T03:34:46.773 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:46.814 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:47.211 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-18T03:34:47.229 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:47.269 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-mirror (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:47.605 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-colorama. 2024-04-18T03:34:47.624 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-04-18T03:34:47.688 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-04-18T03:34:47.958 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-shell. 2024-04-18T03:34:47.975 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-cephfs-shell_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:48.016 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-shell (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:48.286 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-top. 2024-04-18T03:34:48.304 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-cephfs-top_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:48.344 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-top (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:48.588 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-18T03:34:48.608 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-18T03:34:48.669 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-18T03:34:49.200 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T03:34:49.217 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:49.258 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:49.681 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T03:34:49.698 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-18T03:34:49.757 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-18T03:34:50.052 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T03:34:50.065 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-volume. 2024-04-18T03:34:50.066 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-18T03:34:50.081 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:50.123 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-volume (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:50.128 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-18T03:34:50.519 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-18T03:34:50.521 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-18T03:34:50.536 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:50.540 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-18T03:34:50.577 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-mirror (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:50.579 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-18T03:34:50.923 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-colorama. 2024-04-18T03:34:50.939 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-04-18T03:34:50.980 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-04-18T03:34:51.266 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-shell. 2024-04-18T03:34:51.283 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../100-cephfs-shell_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:51.324 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-shell (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:51.560 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-top. 2024-04-18T03:34:51.579 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../101-cephfs-top_18.2.2-1229-g56a91dd1-1focal_all.deb ... 2024-04-18T03:34:51.610 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-top (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:51.880 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-18T03:34:51.899 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-18T03:34:51.937 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-18T03:34:52.252 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-18T03:34:52.271 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-18T03:34:52.310 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-18T03:34:52.450 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-18T03:34:52.467 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:52.530 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs-dev (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:52.672 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webencodings. 2024-04-18T03:34:52.688 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-18T03:34:52.729 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-18T03:34:52.936 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package nvme-cli. 2024-04-18T03:34:52.953 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-18T03:34:53.007 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-html5lib. 2024-04-18T03:34:53.012 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-18T03:34:53.024 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-04-18T03:34:53.080 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-18T03:34:53.324 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-18T03:34:53.340 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-18T03:34:53.384 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-18T03:34:53.435 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-18T03:34:53.455 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-18T03:34:53.493 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-18T03:34:53.730 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-18T03:34:53.747 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-18T03:34:53.780 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-18T03:34:53.913 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T03:34:53.933 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T03:34:53.971 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T03:34:54.299 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T03:34:54.317 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-18T03:34:54.357 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-18T03:34:54.702 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T03:34:54.719 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-18T03:34:54.760 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-18T03:34:55.105 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T03:34:55.122 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-18T03:34:55.163 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-18T03:34:55.432 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T03:34:55.450 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-18T03:34:55.494 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-18T03:34:55.506 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-18T03:34:55.513 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-18T03:34:55.552 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-18T03:34:55.896 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webencodings. 2024-04-18T03:34:55.913 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-18T03:34:55.954 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-18T03:34:56.227 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2024-04-18T03:34:56.242 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-html5lib. 2024-04-18T03:34:56.244 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../116-radosgw_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:56.263 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-04-18T03:34:56.285 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:56.300 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-18T03:34:56.687 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-18T03:34:56.707 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-18T03:34:56.745 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-18T03:34:57.215 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastescript. 2024-04-18T03:34:57.235 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-04-18T03:34:57.272 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-18T03:34:57.610 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-psutil. 2024-04-18T03:34:57.626 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-18T03:34:57.667 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-18T03:34:57.763 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T03:34:57.779 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../117-rbd-fuse_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:57.821 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:58.021 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-18T03:34:58.037 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-18T03:34:58.078 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-18T03:34:58.152 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-18T03:34:58.398 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplejson. 2024-04-18T03:34:58.415 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-18T03:34:58.456 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-18T03:34:58.456 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-18T03:34:58.585 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-18T03:34:58.711 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-18T03:34:58.767 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-18T03:34:58.785 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-18T03:34:58.816 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-18T03:34:58.904 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:59.504 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package radosgw. 2024-04-18T03:34:59.521 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../116-radosgw_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:34:59.522 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2024-04-18T03:34:59.562 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking radosgw (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:34:59.652 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-18T03:34:59.753 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-18T03:35:00.079 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T03:35:00.367 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-18T03:35:00.498 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-18T03:35:00.641 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-18T03:35:00.923 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-fuse. 2024-04-18T03:35:00.941 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../117-rbd-fuse_18.2.2-1229-g56a91dd1-1focal_amd64.deb ... 2024-04-18T03:35:00.976 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-18T03:35:00.981 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-fuse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-18T03:35:01.378 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-18T03:35:01.603 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-18T03:35:01.645 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-18T03:35:01.728 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-18T03:35:01.863 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-18T03:35:01.913 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-04-18T03:35:02.090 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephadm (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:02.189 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-18T03:35:02.490 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-18T03:35:02.810 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:03.078 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-18T03:35:03.132 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user cephadm....done 2024-04-18T03:35:03.179 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-04-18T03:35:03.320 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-18T03:35:03.446 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-18T03:35:03.539 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-18T03:35:03.798 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-18T03:35:04.083 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-18T03:35:04.165 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-18T03:35:04.200 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-18T03:35:04.326 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-18T03:35:04.449 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-18T03:35:04.575 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-18T03:35:04.653 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-18T03:35:04.952 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-18T03:35:05.063 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-18T03:35:05.253 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-18T03:35:05.364 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-18T03:35:05.562 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-18T03:35:05.657 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-04-18T03:35:05.939 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-18T03:35:05.966 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-18T03:35:06.215 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-18T03:35:06.242 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-18T03:35:06.527 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-18T03:35:06.535 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-argparse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:06.837 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-18T03:35:06.853 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-18T03:35:06.979 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-04-18T03:35:07.113 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-18T03:35:07.239 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-18T03:35:07.283 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-18T03:35:07.390 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-18T03:35:07.581 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-18T03:35:07.666 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-18T03:35:07.874 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-18T03:35:08.016 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-18T03:35:08.034 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-04-18T03:35:08.344 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-18T03:35:08.401 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-18T03:35:08.685 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-18T03:35:08.746 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-18T03:35:08.978 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-18T03:35:09.106 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-18T03:35:09.265 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:09.345 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-18T03:35:09.559 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:35:09.638 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-18T03:35:09.729 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-18T03:35:09.998 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-18T03:35:10.072 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-18T03:35:10.222 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-18T03:35:10.282 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-18T03:35:10.340 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-18T03:35:10.583 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-18T03:35:10.600 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-18T03:35:10.734 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-18T03:35:10.852 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-18T03:35:10.934 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:35:11.061 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-18T03:35:11.131 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-18T03:35:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-18T03:35:11.530 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-18T03:35:11.540 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-04-18T03:35:11.824 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-18T03:35:11.850 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-18T03:35:12.117 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-18T03:35:12.218 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-18T03:35:12.226 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T03:35:12.511 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-18T03:35:12.570 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-18T03:35:12.696 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-common (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:12.829 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-18T03:35:13.014 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:35:13.130 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-18T03:35:13.148 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-18T03:35:13.491 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-18T03:35:13.526 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-18T03:35:13.617 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-18T03:35:13.743 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-18T03:35:13.791 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-18T03:35:13.892 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-18T03:35:14.036 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-18T03:35:14.185 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-18T03:35:14.347 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:35:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-18T03:35:14.537 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-18T03:35:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-18T03:35:14.679 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-18T03:35:14.805 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-18T03:35:14.968 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-18T03:35:15.132 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-18T03:35:15.244 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-18T03:35:15.399 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-18T03:35:15.553 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-18T03:35:15.679 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-18T03:35:15.972 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-18T03:35:16.281 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-18T03:35:16.590 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-18T03:35:16.905 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-18T03:35:17.031 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-18T03:35:17.037 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-18T03:35:17.286 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-18T03:35:17.408 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-18T03:35:17.437 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-18T03:35:17.692 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-18T03:35:17.771 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-18T03:35:17.977 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:35:18.103 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-18T03:35:18.114 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-18T03:35:18.240 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-18T03:35:18.366 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-18T03:35:18.446 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-18T03:35:18.751 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-18T03:35:18.773 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-18T03:35:19.043 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-18T03:35:19.182 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-18T03:35:19.542 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-18T03:35:20.507 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-18T03:35:20.572 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-18T03:35:20.632 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-18T03:35:20.719 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-18T03:35:20.858 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-18T03:35:20.984 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-18T03:35:21.009 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-18T03:35:21.285 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-18T03:35:21.302 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-18T03:35:21.411 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-18T03:35:21.603 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-18T03:35:21.729 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-18T03:35:21.737 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-18T03:35:22.030 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T03:35:22.098 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-18T03:35:22.323 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-18T03:35:22.398 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-18T03:35:22.650 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:22.775 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-18T03:35:22.886 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-18T03:35:23.013 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:23.101 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-18T03:35:23.139 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:23.299 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:23.424 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-18T03:35:23.726 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:23.860 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-18T03:35:24.156 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-18T03:35:24.203 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:24.282 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-18T03:35:24.313 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:24.416 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-18T03:35:24.439 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:24.559 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-18T03:35:24.681 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T03:35:24.681 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T03:35:24.852 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-18T03:35:24.977 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-18T03:35:25.157 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:25.270 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-18T03:35:25.283 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:25.409 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-top (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:25.535 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-18T03:35:25.555 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-18T03:35:25.881 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-18T03:35:26.250 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librados2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:26.453 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-18T03:35:26.481 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:26.579 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librgw2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:26.615 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:26.705 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:26.733 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:26.841 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs2 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:26.859 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:26.965 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-18T03:35:26.993 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-shell (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:27.153 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:27.266 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libradosstriper1 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:27.393 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-18T03:35:27.680 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2024-04-18T03:35:27.719 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librbd1 (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:27.845 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-modules-core (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:27.971 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-fuse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:28.099 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2024-04-18T03:35:28.199 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T03:35:28.199 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-18T03:35:28.267 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2024-04-18T03:35:28.289 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T03:35:28.444 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T03:35:28.655 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs-dev (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:28.767 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T03:35:28.815 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rados (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:28.941 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-top (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:29.067 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-18T03:35:29.588 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-mirror (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:29.796 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T03:35:29.796 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T03:35:30.004 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rbd (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:30.130 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-fuse (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:30.232 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:30.264 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rgw (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:30.358 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:30.390 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cephfs (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:30.526 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-shell (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:30.650 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-common (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:30.864 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T03:35:30.864 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T03:35:31.228 INFO:teuthology.orchestra.run.smithi175.stdout:Adding group ceph....done 2024-04-18T03:35:31.293 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:31.613 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user ceph....done 2024-04-18T03:35:31.715 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T03:35:31.780 INFO:teuthology.orchestra.run.smithi175.stdout:Setting system user ceph properties....done 2024-04-18T03:35:31.806 INFO:teuthology.orchestra.run.smithi175.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-18T03:35:31.966 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-18T03:35:32.170 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:32.275 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-18T03:35:32.391 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T03:35:32.391 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T03:35:32.743 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-mirror (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:32.830 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:32.991 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T03:35:32.991 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-18T03:35:33.075 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T03:35:33.075 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T03:35:33.427 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-test (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:33.531 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:33.578 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up radosgw (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:34.022 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T03:35:34.022 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T03:35:34.048 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T03:35:34.048 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-18T03:35:34.456 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-base (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:34.474 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:34.600 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:34.839 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-18T03:35:35.086 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:35.291 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mds (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:35.517 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T03:35:35.517 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-18T03:35:35.587 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T03:35:35.588 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T03:35:35.984 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:36.036 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:36.180 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:36.214 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T03:35:36.214 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-18T03:35:36.311 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:36.432 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:36.660 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-osd (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:36.811 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-18T03:35:36.962 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-18T03:35:37.177 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T03:35:37.177 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-18T03:35:37.213 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-18T03:35:37.628 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:37.754 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:37.897 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mon (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:38.114 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T03:35:38.114 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-18T03:35:38.556 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-cephadm (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:38.708 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:38.833 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-dashboard (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:38.993 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-volume (18.2.2-1229-g56a91dd1-1focal) ... 2024-04-18T03:35:39.355 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-18T03:35:39.506 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-18T03:35:39.774 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-18T03:35:40.091 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-18T03:35:40.731 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T03:35:40.733 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-18T03:35:40.808 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-04-18T03:35:41.019 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-04-18T03:35:41.019 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-04-18T03:35:41.230 INFO:teuthology.orchestra.run.smithi157.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-18T03:35:41.231 INFO:teuthology.orchestra.run.smithi157.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-18T03:35:41.231 INFO:teuthology.orchestra.run.smithi157.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-04-18T03:35:41.231 INFO:teuthology.orchestra.run.smithi157.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-18T03:35:41.231 INFO:teuthology.orchestra.run.smithi157.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-18T03:35:41.231 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T03:35:41.231 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-18T03:35:41.232 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T03:35:41.232 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-04-18T03:35:41.232 INFO:teuthology.orchestra.run.smithi157.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-04-18T03:35:41.232 INFO:teuthology.orchestra.run.smithi157.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-04-18T03:35:41.233 INFO:teuthology.orchestra.run.smithi157.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-04-18T03:35:41.233 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-04-18T03:35:41.233 INFO:teuthology.orchestra.run.smithi157.stdout: usb-modeswitch-data wpasupplicant 2024-04-18T03:35:41.234 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-04-18T03:35:41.234 INFO:teuthology.orchestra.run.smithi157.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-04-18T03:35:41.234 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-04-18T03:35:41.234 INFO:teuthology.orchestra.run.smithi157.stdout: libengine-pkcs11-openssl 2024-04-18T03:35:41.295 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-04-18T03:35:41.296 INFO:teuthology.orchestra.run.smithi157.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-04-18T03:35:41.296 INFO:teuthology.orchestra.run.smithi157.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-04-18T03:35:41.297 INFO:teuthology.orchestra.run.smithi157.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-04-18T03:35:41.297 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-04-18T03:35:41.297 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-04-18T03:35:41.297 INFO:teuthology.orchestra.run.smithi157.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T03:35:41.298 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-04-18T03:35:41.299 INFO:teuthology.orchestra.run.smithi157.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-04-18T03:35:41.362 INFO:teuthology.orchestra.run.smithi157.stdout:6 upgraded, 31 newly installed, 0 to remove and 271 not upgraded. 2024-04-18T03:35:41.363 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 25.3 MB of archives. 2024-04-18T03:35:41.363 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 79.9 MB of additional disk space will be used. 2024-04-18T03:35:41.363 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-04-18T03:35:41.515 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-18T03:35:41.516 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-18T03:35:41.517 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-18T03:35:41.523 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-18T03:35:41.525 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-18T03:35:41.543 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-04-18T03:35:41.544 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-04-18T03:35:41.546 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-04-18T03:35:41.547 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-18T03:35:41.547 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2024-04-18T03:35:41.554 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-18T03:35:41.555 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-04-18T03:35:41.556 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-04-18T03:35:41.557 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-04-18T03:35:41.574 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2024-04-18T03:35:41.574 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-04-18T03:35:41.581 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.18-0ubuntu0.20.04.1 [116 kB] 2024-04-18T03:35:41.583 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-04-18T03:35:41.589 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-04-18T03:35:41.589 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-18T03:35:41.604 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-04-18T03:35:41.604 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-04-18T03:35:41.612 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2024-04-18T03:35:41.623 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-04-18T03:35:41.639 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-04-18T03:35:41.642 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-04-18T03:35:41.642 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-04-18T03:35:41.643 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-04-18T03:35:41.643 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.18-0ubuntu0.20.04.1 [1,054 kB] 2024-04-18T03:35:41.652 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-04-18T03:35:41.654 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.18-0ubuntu0.20.04.1 [13.5 MB] 2024-04-18T03:35:41.832 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-04-18T03:35:41.832 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-04-18T03:35:41.913 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-04-18T03:35:41.913 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-04-18T03:35:41.914 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-04-18T03:35:42.315 INFO:teuthology.orchestra.run.smithi157.stdout:Preconfiguring packages ... 2024-04-18T03:35:42.507 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 25.3 MB in 1s (41.6 MB/s) 2024-04-18T03:35:42.601 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-18T03:35:42.802 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153107 files and directories currently installed.) 2024-04-18T03:35:42.807 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-18T03:35:42.969 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-18T03:35:43.243 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T03:35:43.246 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-18T03:35:43.314 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-18T03:35:43.525 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-18T03:35:43.526 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-18T03:35:43.735 INFO:teuthology.orchestra.run.smithi175.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-18T03:35:43.735 INFO:teuthology.orchestra.run.smithi175.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-18T03:35:43.735 INFO:teuthology.orchestra.run.smithi175.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-04-18T03:35:43.735 INFO:teuthology.orchestra.run.smithi175.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-18T03:35:43.735 INFO:teuthology.orchestra.run.smithi175.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-18T03:35:43.735 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T03:35:43.735 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-18T03:35:43.736 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T03:35:43.736 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-18T03:35:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-04-18T03:35:43.736 INFO:teuthology.orchestra.run.smithi175.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-04-18T03:35:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-04-18T03:35:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-04-18T03:35:43.737 INFO:teuthology.orchestra.run.smithi175.stdout: usb-modeswitch-data wpasupplicant 2024-04-18T03:35:43.738 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-18T03:35:43.738 INFO:teuthology.orchestra.run.smithi175.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-04-18T03:35:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-04-18T03:35:43.739 INFO:teuthology.orchestra.run.smithi175.stdout: libengine-pkcs11-openssl 2024-04-18T03:35:43.798 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-18T03:35:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-04-18T03:35:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-04-18T03:35:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-04-18T03:35:43.799 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-04-18T03:35:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-04-18T03:35:43.800 INFO:teuthology.orchestra.run.smithi175.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-18T03:35:43.800 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-04-18T03:35:43.801 INFO:teuthology.orchestra.run.smithi175.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-04-18T03:35:43.986 INFO:teuthology.orchestra.run.smithi175.stdout:6 upgraded, 31 newly installed, 0 to remove and 271 not upgraded. 2024-04-18T03:35:43.986 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 25.3 MB of archives. 2024-04-18T03:35:43.986 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 79.9 MB of additional disk space will be used. 2024-04-18T03:35:43.986 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-04-18T03:35:44.115 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-04-18T03:35:44.703 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-18T03:35:44.709 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-18T03:35:44.710 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-18T03:35:44.725 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-18T03:35:44.728 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-18T03:35:44.890 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-04-18T03:35:44.891 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-04-18T03:35:44.896 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-04-18T03:35:44.899 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-18T03:35:44.899 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2024-04-18T03:35:45.066 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-18T03:35:45.335 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-04-18T03:35:45.463 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-04-18T03:35:45.468 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-04-18T03:35:45.487 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153107 files and directories currently installed.) 2024-04-18T03:35:45.493 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-18T03:35:45.598 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2024-04-18T03:35:45.601 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-04-18T03:35:45.624 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-18T03:35:45.711 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.18-0ubuntu0.20.04.1 [116 kB] 2024-04-18T03:35:45.726 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-04-18T03:35:45.807 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-04-18T03:35:45.808 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-18T03:35:45.913 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-04-18T03:35:46.077 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-04-18T03:35:46.726 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2024-04-18T03:35:46.847 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-04-18T03:35:46.943 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-04-18T03:35:46.956 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-04-18T03:35:46.957 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-04-18T03:35:46.959 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-04-18T03:35:46.960 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.18-0ubuntu0.20.04.1 [1,054 kB] 2024-04-18T03:35:46.994 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-04-18T03:35:46.998 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.18-0ubuntu0.20.04.1 [13.5 MB] 2024-04-18T03:35:47.078 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-18T03:35:47.333 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-18T03:35:47.472 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-04-18T03:35:47.638 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-04-18T03:35:47.681 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-18T03:35:47.722 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-04-18T03:35:47.723 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-04-18T03:35:47.851 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-04-18T03:35:48.139 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153107 files and directories currently installed.) 2024-04-18T03:35:48.144 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-18T03:35:48.299 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-18T03:35:48.356 INFO:teuthology.orchestra.run.smithi175.stdout:Preconfiguring packages ... 2024-04-18T03:35:48.548 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 25.3 MB in 4s (6,128 kB/s) 2024-04-18T03:35:48.804 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-18T03:35:48.835 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153107 files and directories currently installed.) 2024-04-18T03:35:48.839 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-18T03:35:48.938 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-18T03:35:49.020 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-18T03:35:49.394 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-18T03:35:49.560 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-18T03:35:50.089 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-18T03:35:50.106 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-04-18T03:35:50.147 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-04-18T03:35:50.453 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-04-18T03:35:50.517 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package dump. 2024-04-18T03:35:50.534 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-04-18T03:35:50.574 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking dump (0.4b46-6) ... 2024-04-18T03:35:50.854 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package indent. 2024-04-18T03:35:50.870 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:35:50.912 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-04-18T03:35:51.248 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T03:35:51.265 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-18T03:35:51.306 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-18T03:35:51.669 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-18T03:35:51.686 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2024-04-18T03:35:51.727 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-04-18T03:35:51.798 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153107 files and directories currently installed.) 2024-04-18T03:35:51.804 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-18T03:35:51.919 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-18T03:35:52.030 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T03:35:52.046 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-18T03:35:52.088 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-18T03:35:52.318 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-18T03:35:52.501 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-18T03:35:52.829 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-18T03:35:53.281 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153107 files and directories currently installed.) 2024-04-18T03:35:53.286 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-18T03:35:53.417 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-18T03:35:53.491 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-18T03:35:53.509 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:53.559 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-04-18T03:35:53.837 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-18T03:35:53.855 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:53.887 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-04-18T03:35:53.915 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-18T03:35:54.038 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-18T03:35:54.223 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-18T03:35:54.240 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:54.281 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-04-18T03:35:54.496 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-18T03:35:54.618 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-18T03:35:54.685 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-18T03:35:54.702 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2024-04-18T03:35:54.743 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2024-04-18T03:35:55.096 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-18T03:35:55.114 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-04-18T03:35:55.154 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-04-18T03:35:55.374 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-18T03:35:55.391 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-04-18T03:35:55.432 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-04-18T03:35:55.557 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-18T03:35:55.574 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../14-libpq5_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:35:55.615 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:35:55.760 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package dump. 2024-04-18T03:35:55.777 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-04-18T03:35:55.818 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking dump (0.4b46-6) ... 2024-04-18T03:35:55.987 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-18T03:35:56.004 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:56.037 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-04-18T03:35:56.105 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package indent. 2024-04-18T03:35:56.125 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:35:56.163 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-04-18T03:35:56.406 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-18T03:35:56.425 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:56.464 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-04-18T03:35:56.534 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-18T03:35:56.551 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-18T03:35:56.591 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-18T03:35:56.733 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T03:35:56.752 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-18T03:35:56.792 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-18T03:35:56.886 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-18T03:35:56.907 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2024-04-18T03:35:56.945 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-04-18T03:35:57.231 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-18T03:35:57.250 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-18T03:35:57.289 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-18T03:35:57.332 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-18T03:35:57.353 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-04-18T03:35:57.395 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-04-18T03:35:57.617 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-18T03:35:57.637 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:57.675 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-04-18T03:35:57.773 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package modemmanager. 2024-04-18T03:35:57.791 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:57.867 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-04-18T03:35:57.936 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-18T03:35:57.954 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:57.986 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-04-18T03:35:58.314 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-18T03:35:58.331 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:58.372 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-04-18T03:35:58.600 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package wpasupplicant. 2024-04-18T03:35:58.623 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2024-04-18T03:35:58.734 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-18T03:35:58.753 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2024-04-18T03:35:58.775 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-04-18T03:35:58.791 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2024-04-18T03:35:59.091 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-18T03:35:59.111 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-04-18T03:35:59.153 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-04-18T03:35:59.481 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-18T03:35:59.501 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../14-libpq5_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:35:59.539 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:35:59.628 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package network-manager. 2024-04-18T03:35:59.646 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-04-18T03:35:59.710 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-04-18T03:35:59.900 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-18T03:35:59.918 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:35:59.958 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-04-18T03:36:00.462 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ppp. 2024-04-18T03:36:00.479 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-04-18T03:36:00.497 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-18T03:36:00.517 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:36:00.555 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-04-18T03:36:00.754 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-04-18T03:36:00.807 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-18T03:36:00.824 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-18T03:36:00.865 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-18T03:36:01.090 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pptp-linux. 2024-04-18T03:36:01.110 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-04-18T03:36:01.148 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-04-18T03:36:01.336 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-18T03:36:01.356 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-04-18T03:36:01.394 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-04-18T03:36:01.543 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-18T03:36:01.562 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-04-18T03:36:01.620 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-04-18T03:36:01.797 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package modemmanager. 2024-04-18T03:36:01.815 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-04-18T03:36:01.866 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-04-18T03:36:01.930 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-18T03:36:01.947 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-04-18T03:36:01.988 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-04-18T03:36:02.310 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client-12. 2024-04-18T03:36:02.327 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../26-postgresql-client-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:36:02.367 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:02.478 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package wpasupplicant. 2024-04-18T03:36:02.497 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2024-04-18T03:36:02.536 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-04-18T03:36:02.922 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-common. 2024-04-18T03:36:02.940 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-04-18T03:36:03.005 INFO:teuthology.orchestra.run.smithi157.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-18T03:36:03.032 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-04-18T03:36:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package network-manager. 2024-04-18T03:36:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-04-18T03:36:03.165 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-04-18T03:36:03.521 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-12. 2024-04-18T03:36:03.541 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../28-postgresql-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:36:03.582 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:03.890 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ppp. 2024-04-18T03:36:03.907 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-04-18T03:36:04.168 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-04-18T03:36:04.529 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package pptp-linux. 2024-04-18T03:36:04.546 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-04-18T03:36:04.587 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-04-18T03:36:04.957 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-18T03:36:04.974 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-04-18T03:36:05.033 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-04-18T03:36:05.191 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql. 2024-04-18T03:36:05.210 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-04-18T03:36:05.249 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-04-18T03:36:05.360 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-18T03:36:05.378 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-04-18T03:36:05.418 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-04-18T03:36:05.476 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client. 2024-04-18T03:36:05.497 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-04-18T03:36:05.558 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-04-18T03:36:05.812 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-18T03:36:05.828 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-04-18T03:36:05.870 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-04-18T03:36:06.164 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-18T03:36:06.182 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-04-18T03:36:06.222 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-04-18T03:36:06.348 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client-12. 2024-04-18T03:36:06.368 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../26-postgresql-client-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:36:06.406 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:06.609 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-18T03:36:06.626 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-04-18T03:36:06.669 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-04-18T03:36:06.952 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-04-18T03:36:07.011 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-common. 2024-04-18T03:36:07.028 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-04-18T03:36:07.093 INFO:teuthology.orchestra.run.smithi175.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-18T03:36:07.121 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-04-18T03:36:07.190 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-18T03:36:07.525 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:07.626 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-12. 2024-04-18T03:36:07.643 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../28-postgresql-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-04-18T03:36:07.651 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-04-18T03:36:07.687 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:07.777 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-18T03:36:07.903 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-04-18T03:36:08.335 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T03:36:08.335 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T03:36:08.806 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:09.363 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql. 2024-04-18T03:36:09.382 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-04-18T03:36:09.429 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-04-18T03:36:09.673 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client. 2024-04-18T03:36:09.690 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-04-18T03:36:09.699 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-18T03:36:09.731 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-04-18T03:36:09.820 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-18T03:36:09.979 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-04-18T03:36:10.000 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-18T03:36:10.018 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-04-18T03:36:10.066 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-04-18T03:36:10.105 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-04-18T03:36:10.294 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-18T03:36:10.312 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-04-18T03:36:10.352 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-04-18T03:36:10.755 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-18T03:36:10.772 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-04-18T03:36:10.824 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-04-18T03:36:11.123 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-04-18T03:36:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:Adding user postgres to group ssl-cert 2024-04-18T03:36:11.369 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-18T03:36:11.463 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:11.463 INFO:teuthology.orchestra.run.smithi157.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-18T03:36:11.719 INFO:teuthology.orchestra.run.smithi157.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-18T03:36:11.719 INFO:teuthology.orchestra.run.smithi157.stdout:Removing obsolete dictionary files: 2024-04-18T03:36:11.721 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:11.847 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-04-18T03:36:11.998 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-18T03:36:12.065 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-18T03:36:12.115 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-04-18T03:36:12.472 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T03:36:12.472 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-18T03:36:12.874 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-18T03:36:12.927 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:13.000 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-04-18T03:36:13.126 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-04-18T03:36:13.236 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-04-18T03:36:13.797 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-18T03:36:13.899 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-18T03:36:14.034 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-04-18T03:36:14.151 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-04-18T03:36:14.230 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-04-18T03:36:14.467 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up dump (0.4b46-6) ... 2024-04-18T03:36:14.564 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-18T03:36:14.618 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-04-18T03:36:15.120 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-04-18T03:36:15.199 INFO:teuthology.orchestra.run.smithi175.stdout:Adding user postgres to group ssl-cert 2024-04-18T03:36:15.246 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-04-18T03:36:15.405 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-04-18T03:36:15.472 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:15.472 INFO:teuthology.orchestra.run.smithi175.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-18T03:36:15.582 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2024-04-18T03:36:15.708 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:15.713 INFO:teuthology.orchestra.run.smithi175.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-18T03:36:15.714 INFO:teuthology.orchestra.run.smithi175.stdout:Removing obsolete dictionary files: 2024-04-18T03:36:16.051 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-18T03:36:16.123 INFO:teuthology.orchestra.run.smithi157.stdout:Creating new PostgreSQL cluster 12/main ... 2024-04-18T03:36:16.135 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-04-18T03:36:16.195 INFO:teuthology.orchestra.run.smithi157.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-18T03:36:16.195 INFO:teuthology.orchestra.run.smithi157.stdout:This user must also own the server process. 2024-04-18T03:36:16.195 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:16.195 INFO:teuthology.orchestra.run.smithi157.stdout:The database cluster will be initialized with locale "en_US". 2024-04-18T03:36:16.195 INFO:teuthology.orchestra.run.smithi157.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-18T03:36:16.196 INFO:teuthology.orchestra.run.smithi157.stdout:The default text search configuration will be set to "english". 2024-04-18T03:36:16.196 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:16.196 INFO:teuthology.orchestra.run.smithi157.stdout:Data page checksums are disabled. 2024-04-18T03:36:16.196 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:16.196 INFO:teuthology.orchestra.run.smithi157.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-04-18T03:36:16.196 INFO:teuthology.orchestra.run.smithi157.stdout:creating subdirectories ... ok 2024-04-18T03:36:16.196 INFO:teuthology.orchestra.run.smithi157.stdout:selecting dynamic shared memory implementation ... posix 2024-04-18T03:36:16.213 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default max_connections ... 100 2024-04-18T03:36:16.234 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default shared_buffers ... 128MB 2024-04-18T03:36:16.242 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default time zone ... Etc/UTC 2024-04-18T03:36:16.242 INFO:teuthology.orchestra.run.smithi157.stdout:creating configuration files ... ok 2024-04-18T03:36:16.350 INFO:teuthology.orchestra.run.smithi157.stdout:running bootstrap script ... ok 2024-04-18T03:36:16.883 INFO:teuthology.orchestra.run.smithi157.stdout:performing post-bootstrap initialization ... ok 2024-04-18T03:36:17.112 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-18T03:36:17.238 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-04-18T03:36:17.389 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-04-18T03:36:17.515 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-04-18T03:36:17.670 INFO:teuthology.orchestra.run.smithi157.stdout:syncing data to disk ... ok 2024-04-18T03:36:17.670 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:17.670 INFO:teuthology.orchestra.run.smithi157.stdout:Success. You can now start the database server using: 2024-04-18T03:36:17.670 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:17.670 INFO:teuthology.orchestra.run.smithi157.stdout: pg_ctlcluster 12 main start 2024-04-18T03:36:17.670 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:17.993 INFO:teuthology.orchestra.run.smithi157.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-04-18T03:36:17.994 INFO:teuthology.orchestra.run.smithi157.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-04-18T03:36:18.073 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-18T03:36:18.437 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-04-18T03:36:18.671 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up dump (0.4b46-6) ... 2024-04-18T03:36:18.793 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-18T03:36:18.856 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-04-18T03:36:18.966 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-04-18T03:36:19.075 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-04-18T03:36:19.201 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-04-18T03:36:19.403 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2024-04-18T03:36:19.529 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-04-18T03:36:19.905 INFO:teuthology.orchestra.run.smithi175.stdout:Creating new PostgreSQL cluster 12/main ... 2024-04-18T03:36:19.919 INFO:teuthology.orchestra.run.smithi175.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-04-18T03:36:19.987 INFO:teuthology.orchestra.run.smithi175.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-18T03:36:19.987 INFO:teuthology.orchestra.run.smithi175.stdout:This user must also own the server process. 2024-04-18T03:36:19.987 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:19.987 INFO:teuthology.orchestra.run.smithi175.stdout:The database cluster will be initialized with locale "en_US". 2024-04-18T03:36:19.987 INFO:teuthology.orchestra.run.smithi175.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-18T03:36:19.987 INFO:teuthology.orchestra.run.smithi175.stdout:The default text search configuration will be set to "english". 2024-04-18T03:36:19.988 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:19.988 INFO:teuthology.orchestra.run.smithi175.stdout:Data page checksums are disabled. 2024-04-18T03:36:19.988 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:19.988 INFO:teuthology.orchestra.run.smithi175.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-04-18T03:36:19.989 INFO:teuthology.orchestra.run.smithi175.stdout:creating subdirectories ... ok 2024-04-18T03:36:19.989 INFO:teuthology.orchestra.run.smithi175.stdout:selecting dynamic shared memory implementation ... posix 2024-04-18T03:36:20.009 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default max_connections ... 100 2024-04-18T03:36:20.032 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default shared_buffers ... 128MB 2024-04-18T03:36:20.044 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default time zone ... Etc/UTC 2024-04-18T03:36:20.045 INFO:teuthology.orchestra.run.smithi175.stdout:creating configuration files ... ok 2024-04-18T03:36:20.155 INFO:teuthology.orchestra.run.smithi175.stdout:running bootstrap script ... ok 2024-04-18T03:36:20.692 INFO:teuthology.orchestra.run.smithi175.stdout:performing post-bootstrap initialization ... ok 2024-04-18T03:36:21.190 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-18T03:36:21.332 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-04-18T03:36:21.432 INFO:teuthology.orchestra.run.smithi175.stdout:syncing data to disk ... ok 2024-04-18T03:36:21.432 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:21.432 INFO:teuthology.orchestra.run.smithi175.stdout:Success. You can now start the database server using: 2024-04-18T03:36:21.432 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:21.432 INFO:teuthology.orchestra.run.smithi175.stdout: pg_ctlcluster 12 main start 2024-04-18T03:36:21.432 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:21.458 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-04-18T03:36:21.593 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-18T03:36:21.726 INFO:teuthology.orchestra.run.smithi175.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-04-18T03:36:21.726 INFO:teuthology.orchestra.run.smithi175.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-04-18T03:36:21.727 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-04-18T03:36:21.815 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-18T03:36:21.853 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-04-18T03:36:22.580 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-18T03:36:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:which means they are currently configured by ifupdown: 2024-04-18T03:36:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:- enp3s0f1 2024-04-18T03:36:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-18T03:36:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:remove their configuration from /etc/network/interfaces. 2024-04-18T03:36:22.581 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:22.739 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-18T03:36:23.073 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-18T03:36:23.598 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-18T03:36:24.107 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-04-18T03:36:24.242 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-04-18T03:36:24.384 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-18T03:36:24.532 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-04-18T03:36:24.670 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-04-18T03:36:24.796 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-04-18T03:36:24.827 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-18T03:36:24.922 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-04-18T03:36:24.953 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-04-18T03:36:25.073 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-04-18T03:36:25.079 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-04-18T03:36:25.239 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-18T03:36:25.322 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T03:36:25.323 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T03:36:25.365 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-04-18T03:36:25.516 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-04-18T03:36:25.825 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-04-18T03:36:25.935 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-18T03:36:26.086 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-18T03:36:26.207 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:26.207 INFO:teuthology.orchestra.run.smithi175.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-18T03:36:26.207 INFO:teuthology.orchestra.run.smithi175.stdout:which means they are currently configured by ifupdown: 2024-04-18T03:36:26.207 INFO:teuthology.orchestra.run.smithi175.stdout:- enp3s0f1 2024-04-18T03:36:26.207 INFO:teuthology.orchestra.run.smithi175.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-18T03:36:26.207 INFO:teuthology.orchestra.run.smithi175.stdout:remove their configuration from /etc/network/interfaces. 2024-04-18T03:36:26.207 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:26.237 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-18T03:36:26.369 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-18T03:36:26.539 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-18T03:36:26.718 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-18T03:36:27.218 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-18T03:36:27.744 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-04-18T03:36:27.870 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-04-18T03:36:28.013 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-18T03:36:28.147 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-04-18T03:36:28.273 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-04-18T03:36:28.408 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-04-18T03:36:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-04-18T03:36:28.668 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-04-18T03:36:28.972 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T03:36:28.972 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-18T03:36:29.488 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-04-18T03:36:29.596 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-18T03:36:29.714 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-18T03:36:29.857 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-18T03:36:30.167 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-18T03:36:33.726 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-04-18T03:36:33.851 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-04-18T03:36:34.701 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T03:36:34.706 DEBUG:teuthology.parallel:result is None 2024-04-18T03:36:37.630 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-04-18T03:36:37.746 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-04-18T03:36:38.637 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-18T03:36:38.641 DEBUG:teuthology.parallel:result is None 2024-04-18T03:36:38.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T03:36:38.781 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2024-04-18T03:36:38.804 INFO:teuthology.orchestra.run.smithi157.stdout:18.2.2-1229-g56a91dd1-1focal 2024-04-18T03:36:38.805 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1229-g56a91dd1-1focal 2024-04-18T03:36:38.805 INFO:teuthology.task.install:The correct ceph version 18.2.2-1229-g56a91dd1-1focal is installed. 2024-04-18T03:36:38.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=56a91dd158be807f143cc918a11685fc9ee164ae 2024-04-18T03:36:39.018 DEBUG:teuthology.orchestra.run.smithi175:> dpkg-query -W -f '${Version}' ceph 2024-04-18T03:36:39.043 INFO:teuthology.orchestra.run.smithi175.stdout:18.2.2-1229-g56a91dd1-1focal 2024-04-18T03:36:39.044 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1229-g56a91dd1-1focal 2024-04-18T03:36:39.044 INFO:teuthology.task.install:The correct ceph version 18.2.2-1229-g56a91dd1-1focal is installed. 2024-04-18T03:36:39.045 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-18T03:36:39.046 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:39.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T03:36:39.062 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:36:39.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T03:36:39.102 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-18T03:36:39.103 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:39.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T03:36:39.118 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T03:36:39.177 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:36:39.177 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T03:36:39.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T03:36:39.208 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-18T03:36:39.208 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:39.208 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T03:36:39.224 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T03:36:39.237 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:36:39.237 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T03:36:39.266 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T03:36:39.276 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-18T03:36:39.276 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:39.276 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T03:36:39.294 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T03:36:39.304 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:36:39.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T03:36:39.318 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T03:36:39.373 INFO:teuthology.run_tasks:Running task ceph... 2024-04-18T03:36:39.447 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-18T03:36:39.448 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-04-18T03:36:39.450 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-04-18T03:36:39.465 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-18T03:36:39.465 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T03:36:39.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T03:36:39.522 INFO:tasks.ceph:Creating extra log directories... 2024-04-18T03:36:39.522 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T03:36:39.524 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T03:36:39.584 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-18T03:36:39.584 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-18T03:36:39.584 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-18T03:36:39.584 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:39.585 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-18T03:36:39.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-18T03:36:39.673 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:36:39.673 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-18T03:36:39.680 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-18T03:36:39.767 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-18T03:36:39.767 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-18T03:36:39.767 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439', 'branch': 'reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/workunit/dir-max-entries}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7661439', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5203, 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae', 'sleep_before_teardown': 0, 'subset': '88/512', 'suite': 'fs', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '56a91dd158be807f143cc918a11685fc9ee164ae', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'client.0': ['fs/maxentries']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-17_22:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-18T03:36:39.768 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T03:36:39.770 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T03:36:39.776 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T03:36:39.820 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T03:36:39.835 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:39.835 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T03:36:39.840 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T03:36:39.840 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-04-18T03:36:39.847 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T03:36:39.847 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T03:36:39.847 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-04-18T03:36:39.847 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:36:39.847 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-18 03:32:03.776016946 +0000 2024-04-18T03:36:39.848 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-18 03:32:03.552022111 +0000 2024-04-18T03:36:39.848 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-18 03:32:03.552022111 +0000 2024-04-18T03:36:39.848 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-18T03:36:39.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T03:36:39.903 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-18T03:36:39.903 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-18T03:36:39.903 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000282571 s, 1.8 MB/s 2024-04-18T03:36:39.904 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T03:36:39.912 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-04-18T03:36:39.919 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T03:36:39.919 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T03:36:39.919 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-18T03:36:39.919 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:36:39.920 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-18 03:32:04.204007082 +0000 2024-04-18T03:36:39.920 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-18 03:32:03.996011876 +0000 2024-04-18T03:36:39.920 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-18 03:32:03.996011876 +0000 2024-04-18T03:36:39.920 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-18T03:36:39.920 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T03:36:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-18T03:36:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-18T03:36:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000299666 s, 1.7 MB/s 2024-04-18T03:36:39.935 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T03:36:39.986 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-04-18T03:36:40.005 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T03:36:40.005 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T03:36:40.005 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 372 Links: 1 2024-04-18T03:36:40.005 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:36:40.005 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-18 03:32:04.432001827 +0000 2024-04-18T03:36:40.005 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-18 03:32:04.428001918 +0000 2024-04-18T03:36:40.005 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-18 03:32:04.428001918 +0000 2024-04-18T03:36:40.005 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-18T03:36:40.006 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T03:36:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-18T03:36:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-18T03:36:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00024315 s, 2.1 MB/s 2024-04-18T03:36:40.021 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T03:36:40.071 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-04-18T03:36:40.077 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T03:36:40.077 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T03:36:40.078 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-04-18T03:36:40.078 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:36:40.078 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-18 03:32:05.083986797 +0000 2024-04-18T03:36:40.078 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-18 03:32:04.867991776 +0000 2024-04-18T03:36:40.078 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-18 03:32:04.867991776 +0000 2024-04-18T03:36:40.078 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-18T03:36:40.078 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T03:36:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-18T03:36:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-18T03:36:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000295603 s, 1.7 MB/s 2024-04-18T03:36:40.091 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T03:36:40.143 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:40.143 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:36:40.144 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T03:36:40.151 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T03:36:40.151 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-04-18T03:36:40.158 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T03:36:40.158 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T03:36:40.159 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-04-18T03:36:40.159 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:36:40.159 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-18 03:31:52.711260371 +0000 2024-04-18T03:36:40.159 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-18 03:31:52.707260463 +0000 2024-04-18T03:36:40.159 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-18 03:31:52.707260463 +0000 2024-04-18T03:36:40.159 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-18T03:36:40.159 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T03:36:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-18T03:36:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-18T03:36:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000424173 s, 1.2 MB/s 2024-04-18T03:36:40.218 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T03:36:40.227 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-04-18T03:36:40.232 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T03:36:40.233 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T03:36:40.233 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 363 Links: 1 2024-04-18T03:36:40.233 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:36:40.233 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-18 03:31:53.167249854 +0000 2024-04-18T03:36:40.233 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-18 03:31:53.163249946 +0000 2024-04-18T03:36:40.233 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-18 03:31:53.163249946 +0000 2024-04-18T03:36:40.233 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-18T03:36:40.233 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T03:36:40.289 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-18T03:36:40.289 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-18T03:36:40.289 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000405733 s, 1.3 MB/s 2024-04-18T03:36:40.290 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T03:36:40.297 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-04-18T03:36:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T03:36:40.303 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T03:36:40.303 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 370 Links: 1 2024-04-18T03:36:40.303 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:36:40.303 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-18 03:31:53.839234356 +0000 2024-04-18T03:36:40.304 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-18 03:31:53.599239891 +0000 2024-04-18T03:36:40.304 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-18 03:31:53.599239891 +0000 2024-04-18T03:36:40.304 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-18T03:36:40.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T03:36:40.361 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-18T03:36:40.361 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-18T03:36:40.361 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00041784 s, 1.2 MB/s 2024-04-18T03:36:40.362 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T03:36:40.369 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-04-18T03:36:40.374 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T03:36:40.375 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T03:36:40.375 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 376 Links: 1 2024-04-18T03:36:40.375 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:36:40.375 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-18 03:31:54.275224301 +0000 2024-04-18T03:36:40.375 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-18 03:31:54.059229283 +0000 2024-04-18T03:36:40.375 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-18 03:31:54.059229283 +0000 2024-04-18T03:36:40.375 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-18T03:36:40.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T03:36:40.385 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-18T03:36:40.385 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-18T03:36:40.385 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000366708 s, 1.4 MB/s 2024-04-18T03:36:40.386 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T03:36:40.439 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:40.439 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-18T03:36:40.439 INFO:tasks.ceph:Generating config... 2024-04-18T03:36:40.440 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-18T03:36:40.440 INFO:tasks.ceph:[client] debug client = 20 2024-04-18T03:36:40.440 INFO:tasks.ceph:[client] debug ms = 1 2024-04-18T03:36:40.440 INFO:tasks.ceph:[client] pid file = 2024-04-18T03:36:40.440 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-18T03:36:40.440 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-18T03:36:40.441 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-18T03:36:40.441 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-18T03:36:40.442 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-18T03:36:40.442 INFO:tasks.ceph:Setting up mon.a... 2024-04-18T03:36:40.443 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-18T03:36:40.483 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.keyring 2024-04-18T03:36:40.499 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-18T03:36:40.539 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T03:36:40.548 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.157'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2024-04-18T03:36:40.548 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.157,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-18T03:36:40.549 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:40.549 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T03:36:40.596 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.157 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: generated fsid f4d3acd0-980f-44ff-9559-06e2da8e4de0 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:setting min_mon_release = pacific 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:epoch 0 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:fsid f4d3acd0-980f-44ff-9559-06e2da8e4de0 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:last_changed 2024-04-18T03:36:40.639470+0000 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:created 2024-04-18T03:36:40.639470+0000 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:min_mon_release 16 (pacific) 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:election_strategy: 1 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:0: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.a 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2024-04-18T03:36:40.640 INFO:teuthology.orchestra.run.smithi157.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2024-04-18T03:36:40.641 INFO:teuthology.orchestra.run.smithi157.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-18T03:36:40.641 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T03:36:40.648 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f4d3acd0-980f-44ff-9559-06e2da8e4de0... 2024-04-18T03:36:40.648 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T03:36:40.651 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-04-18T03:36:40.680 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-04-18T03:36:40.681 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.157,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = f4d3acd0-980f-44ff-9559-06e2da8e4de0 2024-04-18T03:36:40.682 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-04-18T03:36:40.683 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 20 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 20 2024-04-18T03:36:40.684 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 10 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-04-18T03:36:40.685 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-04-18T03:36:40.686 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:36:40.687 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = "" 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-04-18T03:36:40.688 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-04-18T03:36:40.689 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.690 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-18T03:36:40.691 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.157,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = f4d3acd0-980f-44ff-9559-06e2da8e4de0 2024-04-18T03:36:40.692 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-18T03:36:40.693 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 20 2024-04-18T03:36:40.694 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 20 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 10 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-18T03:36:40.695 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-18T03:36:40.696 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-18T03:36:40.697 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-18T03:36:40.698 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-18T03:36:40.699 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-18T03:36:40.701 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-18T03:36:40.701 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-18T03:36:40.888 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-18T03:36:40.888 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:40.888 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-18T03:36:40.895 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:40.895 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-18T03:36:40.902 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:36:40.902 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:40.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T03:36:40.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T03:36:40.931 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:36:40.932 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:40.953 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:36:40.953 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:36:40.953 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T03:36:40.953 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T03:36:40.980 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:36:40.980 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:41.029 INFO:tasks.ceph:Setting up mon nodes... 2024-04-18T03:36:41.029 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-18T03:36:41.029 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T03:36:41.082 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T03:36:41.085 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T03:36:41.135 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T03:36:41.160 INFO:tasks.ceph:Setting up mds nodes... 2024-04-18T03:36:41.160 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T03:36:41.212 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T03:36:41.215 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-18T03:36:41.226 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-18T03:36:41.271 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-18T03:36:41.273 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-18T03:36:41.284 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-18T03:36:41.340 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-18T03:36:41.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-18T03:36:41.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-18T03:36:41.401 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-18T03:36:41.405 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-18T03:36:41.415 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-18T03:36:41.415 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-18T03:36:41.457 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-18T03:36:41.470 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-18T03:36:41.510 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-18T03:36:41.524 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-18T03:36:41.565 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-18T03:36:41.579 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-18T03:36:41.618 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-18T03:36:41.631 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-18T03:36:41.631 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-18T03:36:41.632 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-18T03:36:41.648 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:41.648 INFO:tasks.ceph:role: osd.0 2024-04-18T03:36:41.648 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:36:41.648 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T03:36:41.733 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T03:36:41.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-18T03:36:41.735 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-18T03:36:41.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-18T03:36:41.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:36:41.764 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T03:36:41.764 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-18T03:36:41.778 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:41.778 INFO:tasks.ceph:role: osd.1 2024-04-18T03:36:41.778 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:36:41.778 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T03:36:41.818 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T03:36:41.819 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T03:36:41.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-18T03:36:41.821 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-18T03:36:41.883 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-18T03:36:41.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:36:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T03:36:41.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-18T03:36:41.904 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:41.904 INFO:tasks.ceph:role: osd.2 2024-04-18T03:36:41.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:36:41.904 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T03:36:41.944 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T03:36:41.946 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-18T03:36:41.946 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-18T03:36:42.011 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-18T03:36:42.021 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T03:36:42.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:36:42.022 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-18T03:36:42.032 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:42.032 INFO:tasks.ceph:role: osd.3 2024-04-18T03:36:42.032 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:36:42.032 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T03:36:42.075 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T03:36:42.075 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T03:36:42.075 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T03:36:42.075 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 2024-04-18T03:36:42.075 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T03:36:42.075 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-18T03:36:42.076 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T03:36:42.076 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T03:36:42.076 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T03:36:42.076 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T03:36:42.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-18T03:36:42.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-18T03:36:42.095 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-18T03:36:42.150 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T03:36:42.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:36:42.151 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:42.238+0000 7f8fc0d0e880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-18T03:36:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:42.238+0000 7f8fc0d0e880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-18T03:36:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:42.238+0000 7f8fc0d0e880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T03:36:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:42.238+0000 7f8fc0d0e880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T03:36:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:42.238+0000 7f8fc0d0e880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T03:36:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:42.242+0000 7f8fc0d0e880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-18T03:36:45.298 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-18T03:36:45.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:45.350+0000 7f041e62d880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-18T03:36:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:45.350+0000 7f041e62d880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-18T03:36:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:45.350+0000 7f041e62d880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T03:36:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:45.350+0000 7f041e62d880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T03:36:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:45.350+0000 7f041e62d880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T03:36:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:45.354+0000 7f041e62d880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-18T03:36:48.349 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-18T03:36:48.406 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:48.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:48.446+0000 7fed76b50880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-18T03:36:48.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:48.446+0000 7fed76b50880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-18T03:36:48.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:48.446+0000 7fed76b50880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T03:36:48.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:48.446+0000 7fed76b50880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T03:36:48.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:48.446+0000 7fed76b50880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T03:36:48.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:48.446+0000 7fed76b50880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-18T03:36:51.429 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-18T03:36:51.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:51.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:51.482+0000 7fa1d6622880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-18T03:36:51.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:51.482+0000 7fa1d6622880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-18T03:36:51.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:51.482+0000 7fa1d6622880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T03:36:51.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:51.482+0000 7fa1d6622880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T03:36:51.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:51.482+0000 7fa1d6622880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T03:36:51.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:36:51.482+0000 7fa1d6622880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-18T03:36:54.476 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-18T03:36:54.535 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-18T03:36:54.552 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:54.552 INFO:tasks.ceph:role: osd.4 2024-04-18T03:36:54.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:36:54.552 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T03:36:55.124 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T03:36:55.124 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T03:36:55.124 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T03:36:55.124 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 2024-04-18T03:36:55.124 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T03:36:55.124 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-18T03:36:55.124 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T03:36:55.125 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T03:36:55.125 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T03:36:55.125 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T03:36:55.127 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-18T03:36:55.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-18T03:36:55.229 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-18T03:36:55.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:36:55.241 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T03:36:55.241 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-18T03:36:55.251 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:55.251 INFO:tasks.ceph:role: osd.5 2024-04-18T03:36:55.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:36:55.251 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T03:36:55.759 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T03:36:55.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-18T03:36:55.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-18T03:36:55.819 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-18T03:36:55.830 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T03:36:55.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:36:55.831 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-18T03:36:55.842 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:55.842 INFO:tasks.ceph:role: osd.6 2024-04-18T03:36:55.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:36:55.842 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T03:36:56.323 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T03:36:56.325 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-18T03:36:56.325 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-18T03:36:56.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-18T03:36:56.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:36:56.386 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T03:36:56.386 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-18T03:36:56.397 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-18T03:36:56.397 INFO:tasks.ceph:role: osd.7 2024-04-18T03:36:56.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:36:56.397 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T03:36:56.913 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T03:36:56.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-18T03:36:56.915 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-18T03:36:56.973 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-18T03:36:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-18T03:36:56.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:36:56.984 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:36:57.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:36:57.057+0000 7f705a3d4880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-18T03:36:57.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:36:57.061+0000 7f705a3d4880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-18T03:36:57.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:36:57.061+0000 7f705a3d4880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T03:36:57.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:36:57.061+0000 7f705a3d4880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T03:36:57.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:36:57.061+0000 7f705a3d4880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-18T03:36:57.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:36:57.065+0000 7f705a3d4880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-18T03:37:00.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-18T03:37:00.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:37:00.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:00.113+0000 7f8d36f6a880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-18T03:37:00.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:00.113+0000 7f8d36f6a880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-18T03:37:00.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:00.113+0000 7f8d36f6a880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T03:37:00.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:00.113+0000 7f8d36f6a880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T03:37:00.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:00.113+0000 7f8d36f6a880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-18T03:37:00.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:00.113+0000 7f8d36f6a880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-18T03:37:03.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-18T03:37:03.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:37:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:03.177+0000 7fcdcccc1880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-18T03:37:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:03.177+0000 7fcdcccc1880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-18T03:37:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:03.177+0000 7fcdcccc1880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T03:37:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:03.177+0000 7fcdcccc1880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T03:37:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:03.177+0000 7fcdcccc1880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-18T03:37:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:03.177+0000 7fcdcccc1880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-18T03:37:06.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-18T03:37:06.187 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:37:06.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:06.270+0000 7f333e639880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-18T03:37:06.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:06.270+0000 7f333e639880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-18T03:37:06.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:06.270+0000 7f333e639880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T03:37:06.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:06.270+0000 7f333e639880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T03:37:06.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:06.270+0000 7f333e639880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-18T03:37:06.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:06.274+0000 7f333e639880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-18T03:37:09.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-18T03:37:09.275 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-18T03:37:09.275 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.275 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-18T03:37:09.291 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.291 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-18T03:37:09.307 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.308 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-18T03:37:09.320 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-18T03:37:09.333 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.333 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-18T03:37:09.345 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.346 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-18T03:37:09.403 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.403 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-18T03:37:09.419 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.419 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-18T03:37:09.435 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-18T03:37:09.493 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.494 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-18T03:37:09.503 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.503 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-18T03:37:09.517 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.517 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-18T03:37:09.571 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.571 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-18T03:37:09.587 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.587 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-18T03:37:09.601 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.602 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-18T03:37:09.608 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:09.609 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-18T03:37:09.656 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.656 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-18T03:37:09.663 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:09.663 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-18T03:37:09.712 INFO:tasks.ceph:Adding keys to all mons... 2024-04-18T03:37:09.712 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T03:37:09.714 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T03:37:09.727 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2024-04-18T03:37:09.727 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBmmGbeBBAAV1U+OhaqoO+HipO4xTUauA== 2024-04-18T03:37:09.727 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-04-18T03:37:09.727 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBmrRSrDBAAbOrqSKZo2vtMr2v3S1tBpw== 2024-04-18T03:37:09.727 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-04-18T03:37:09.727 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBmcc8hEBAAS7KcVKpa7n2sLeTgG++sqg== 2024-04-18T03:37:09.727 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-04-18T03:37:09.727 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBKlSBmLDahDhAALryJKTiIcHrjYyc5rP9/yQ== 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBNlSBmrG5RFRAAU4qp+062Hwj+bE973W2z6A== 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBQlSBmMOOzGhAAlj38FuHDbEaN35S28hMEJg== 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBTlSBm43zvHBAAcNc+UEISJZKyfvvtTEYw4A== 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBmETnqBxAA2S8dcWTKEx1aqxV3M7JI8g== 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBm55sbFBAAMQuVuSN6hTSyUfUWWhui7g== 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2024-04-18T03:37:09.728 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBmSYPDFxAA89vOIKJ+yLm//RMQv3hPbg== 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBZlSBmHWzNAxAAcAdTo2kXzrCJGMcDjH/5SA== 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBclSBm57X7BhAA3mVbvXDpADQBU60uYClWgA== 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBflSBmRAjNChAAq3oU/S62EKiNx9P9EU5Klw== 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBilSBmaiNqEBAAXK2t9tUV6Jhj4OK2PrfdeA== 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBmjn88GxAATXi75OxGPwHvOkS4qdkHYQ== 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout:[client.2] 2024-04-18T03:37:09.729 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBms+NoHhAATG0/peQgLNc+WbxMpomXeQ== 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBm/zOGIRAA75DZecejH7Vpc0Pcw34Wjw== 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi157.stdout:[client.3] 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJlSBmzQC0JBAAKKHrWfZv3sjLBSoKeI2AdA== 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBmmGbeBBAAV1U+OhaqoO+HipO4xTUauA== 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBmrRSrDBAAbOrqSKZo2vtMr2v3S1tBpw== 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBmcc8hEBAAS7KcVKpa7n2sLeTgG++sqg== 2024-04-18T03:37:09.730 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBKlSBmLDahDhAALryJKTiIcHrjYyc5rP9/yQ== 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBNlSBmrG5RFRAAU4qp+062Hwj+bE973W2z6A== 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBQlSBmMOOzGhAAlj38FuHDbEaN35S28hMEJg== 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBTlSBm43zvHBAAcNc+UEISJZKyfvvtTEYw4A== 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBmETnqBxAA2S8dcWTKEx1aqxV3M7JI8g== 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBm55sbFBAAMQuVuSN6hTSyUfUWWhui7g== 2024-04-18T03:37:09.731 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBmSYPDFxAA89vOIKJ+yLm//RMQv3hPbg== 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBZlSBmHWzNAxAAcAdTo2kXzrCJGMcDjH/5SA== 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBclSBm57X7BhAA3mVbvXDpADQBU60uYClWgA== 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBflSBmRAjNChAAq3oU/S62EKiNx9P9EU5Klw== 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBilSBmaiNqEBAAXK2t9tUV6Jhj4OK2PrfdeA== 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBmjn88GxAATXi75OxGPwHvOkS4qdkHYQ== 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout:[client.2] 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBms+NoHhAATG0/peQgLNc+WbxMpomXeQ== 2024-04-18T03:37:09.732 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2024-04-18T03:37:09.733 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBm/zOGIRAA75DZecejH7Vpc0Pcw34Wjw== 2024-04-18T03:37:09.733 INFO:teuthology.orchestra.run.smithi175.stdout:[client.3] 2024-04-18T03:37:09.733 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJlSBmzQC0JBAAKKHrWfZv3sjLBSoKeI2AdA== 2024-04-18T03:37:09.734 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T03:37:09.769 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:37:09.779 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T03:37:09.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:37:09.832 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T03:37:09.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T03:37:09.886 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T03:37:09.931 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T03:37:09.983 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:09.985 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.032 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.035 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.085 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.088 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.134 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.136 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.230 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T03:37:10.233 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T03:37:10.283 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T03:37:10.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T03:37:10.380 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T03:37:10.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T03:37:10.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.438 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.486 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.488 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.581 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.583 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.631 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T03:37:10.684 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T03:37:10.687 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T03:37:10.735 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T03:37:10.738 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T03:37:10.790 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T03:37:10.792 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T03:37:10.843 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T03:37:10.845 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T03:37:10.896 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-18T03:37:10.896 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-18T03:37:10.908 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T03:37:11.044 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-18T03:37:11.059 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-18T03:37:11.075 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T03:37:11.164 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-18T03:37:11.181 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-18T03:37:11.190 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T03:37:11.316 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-18T03:37:11.333 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:37:11.335 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T03:37:11.339 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-18T03:37:11.340 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T03:37:11.340 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T03:37:11.342 INFO:tasks.ceph.mon.a:Started 2024-04-18T03:37:11.342 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T03:37:11.342 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T03:37:11.345 INFO:tasks.ceph.mon.b:Started 2024-04-18T03:37:11.345 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T03:37:11.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T03:37:11.347 INFO:tasks.ceph.mon.c:Started 2024-04-18T03:37:11.347 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-18T03:37:11.347 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-18T03:37:11.347 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-18T03:37:11.350 INFO:tasks.ceph.mgr.y:Started 2024-04-18T03:37:11.350 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-18T03:37:11.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-18T03:37:11.352 INFO:tasks.ceph.mgr.x:Started 2024-04-18T03:37:11.353 INFO:tasks.ceph:Setting crush tunables to default 2024-04-18T03:37:11.353 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd crush tunables default 2024-04-18T03:37:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.458+0000 7fab3db37700 1 Processor -- start 2024-04-18T03:37:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab3db37700 1 -- start start 2024-04-18T03:37:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab3db37700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab3db37700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab380d00e0 con 0x7fab3815b320 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab3db37700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3815b700 con 0x7fab38071080 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab3db37700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab380b6d60 con 0x7fab380aff20 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab377fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fab3815b320 0x7fab380d0570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:35548/0 (socket says 172.21.15.157:35548) 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 learned_addr learned my addr 172.21.15.157:0/2286374172 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:11.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.462+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.662+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.662+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.662+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.662+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:11.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:11.662+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T03:37:12.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.062+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:12.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.066+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:12.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.066+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:12.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.066+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:12.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.066+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T03:37:12.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.866+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:12.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.866+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:12.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.866+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:12.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.866+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:12.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:12.866+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T03:37:14.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 msgr2=0x7fab380b6820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:14.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab357fa700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab380aff20 0x7fab380b6820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 >> v1:172.21.15.175:6789/0 conn(0x7fab38071080 legacy=0x7fab380b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 >> v1:172.21.15.157:6789/0 conn(0x7fab3815b320 legacy=0x7fab380d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab357fa700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab357fa700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380b6d60 con 0x7fab240037c0 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab24008da0 con 0x7fab24006270 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:14.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:14.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:14.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.462+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:14.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:14.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:14.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T03:37:14.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:14.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:14.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T03:37:14.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:14.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:14.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:14.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:14.662+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-18T03:37:15.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:15.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:15.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T03:37:15.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:15.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:15.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T03:37:15.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:15.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:15.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:15.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.066+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-18T03:37:15.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab36ffd700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:15.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:15.866+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-18T03:37:16.771 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:16.766+0000 7fae05dbc2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T03:37:17.335 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:17.330+0000 7fae05dbc2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T03:37:17.388 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:17.382+0000 7fae05dbc2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 msgr2=0x7fab240086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab357fa700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.175:3300/0 conn(0x7fab24006270 0x7fab240086f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 msgr2=0x7fab24005c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab357fa700 1 --2- 172.21.15.157:0/2286374172 >> v2:172.21.15.157:3300/0 conn(0x7fab240037c0 0x7fab24005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab37fff700 1 -- 172.21.15.157:0/2286374172 reap_dead start 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab357fa700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab24008220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab380cc0b0 con 0x7fab24003c10 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab24008950 con 0x7fab38071080 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab357fa700 1 -- 172.21.15.157:0/2286374172 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab380b6d60 con 0x7fab24007da0 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab37fff700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab24008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab37fff700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 msgr2=0x7fab24008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T03:37:17.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab37fff700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 msgr2=0x7fab24008220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab37fff700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab24008220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab37fff700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab24008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162793852 0 0) 0x7fab24008950 con 0x7fab38071080 2024-04-18T03:37:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab200035d0 con 0x7fab38071080 2024-04-18T03:37:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910558139 0 0) 0x7fab380cc0b0 con 0x7fab24003c10 2024-04-18T03:37:17.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab24008950 con 0x7fab24003c10 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 436252562 0 0) 0x7fab24008950 con 0x7fab24003c10 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 msgr2=0x7fab24008220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab367fc700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab24008220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.463+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 >> v1:172.21.15.175:6789/0 conn(0x7fab38071080 legacy=0x7fab2400b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24010870 con 0x7fab24003c10 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7fab280044a0 con 0x7fab24003c10 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 >> v1:172.21.15.157:6789/0 conn(0x7fab24003c10 legacy=0x7fab24006680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab20004c70 0x7fab20005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20003810 0x7fab20003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab200042a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c007e00 con 0x7fab20004c70 2024-04-18T03:37:17.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380b6d60 con 0x7fab20003810 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2000bc70 con 0x7fab24007da0 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab20004c70 0x7fab20005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20003810 0x7fab20003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab37fff700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab200042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab37fff700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 msgr2=0x7fab200042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 msgr2=0x7fab200042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab37fff700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 msgr2=0x7fab200042a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab37fff700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab200042a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab37fff700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab200042a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab24007da0 0x7fab200042a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20003810 msgr2=0x7fab20003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20003810 0x7fab20003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab377fe700 1 -- 172.21.15.157:0/2286374172 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24008950 con 0x7fab20004c70 2024-04-18T03:37:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab36ffd700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab20003810 0x7fab20003c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab377fe700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab20004c70 0x7fab20005050 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0019c0 tx=0x7fab200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd6eb0aee696426 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c001cd0 con 0x7fab20004c70 2024-04-18T03:37:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c0075c0 con 0x7fab20004c70 2024-04-18T03:37:17.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.467+0000 7fab367fc700 1 -- 172.21.15.157:0/2286374172 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c016450 con 0x7fab20004c70 2024-04-18T03:37:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab3db37700 1 -- 172.21.15.157:0/2286374172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab20004c70 msgr2=0x7fab20005050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab3db37700 1 --2- 172.21.15.157:0/2286374172 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab20004c70 0x7fab20005050 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0019c0 tx=0x7fab200058a0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab37fff700 1 -- 172.21.15.157:0/2286374172 reap_dead start 2024-04-18T03:37:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab3db37700 1 -- 172.21.15.157:0/2286374172 shutdown_connections 2024-04-18T03:37:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab3db37700 1 -- 172.21.15.157:0/2286374172 >> 172.21.15.157:0/2286374172 conn(0x7fab380d0de0 msgr2=0x7fab380d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab3db37700 1 -- 172.21.15.157:0/2286374172 shutdown_connections 2024-04-18T03:37:17.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab3db37700 1 -- 172.21.15.157:0/2286374172 wait complete. 2024-04-18T03:37:17.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab3db37700 1 Processor -- start 2024-04-18T03:37:17.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.471+0000 7fab3db37700 1 -- start start 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab3db37700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab3814e1e0 0x7fab3815e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab3db37700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab3815d540 0x7fab380b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab3db37700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 0x7fab380b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab3db37700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab381572d0 con 0x7fab3814e1e0 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab3db37700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380c7eb0 con 0x7fab3815d540 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab3db37700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3815d9d0 con 0x7fab3814e5c0 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab3814e1e0 0x7fab3815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab3814e1e0 0x7fab3815e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44064/0 (socket says 172.21.15.157:44064) 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 -- 172.21.15.157:0/1199117269 learned_addr learned my addr 172.21.15.157:0/1199117269 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab36ffd700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab3815d540 0x7fab380b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab37fff700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 0x7fab380b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab37fff700 1 -- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 msgr2=0x7fab380b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab37fff700 1 -- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 msgr2=0x7fab380b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:17.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab37fff700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 0x7fab380b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab37fff700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 0x7fab380b1dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 -- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 msgr2=0x7fab380b1dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 0x7fab380b1dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 -- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab3815d540 msgr2=0x7fab380b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab3815d540 0x7fab380b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 -- 172.21.15.157:0/1199117269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3815dcb0 con 0x7fab3814e1e0 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab377fe700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab3814e1e0 0x7fab3815e210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fab2c007330 tx=0x7fab2c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab1ffff700 1 -- 172.21.15.157:0/1199117269 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c026070 con 0x7fab3814e1e0 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab1ffff700 1 -- 172.21.15.157:0/1199117269 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c001260 con 0x7fab3814e1e0 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab1ffff700 1 -- 172.21.15.157:0/1199117269 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0013f0 con 0x7fab3814e1e0 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab380c8100 con 0x7fab3814e1e0 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3815e750 con 0x7fab3814e1e0 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab1ffff700 1 -- 172.21.15.157:0/1199117269 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fab2c016b00 con 0x7fab3814e1e0 2024-04-18T03:37:17.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.475+0000 7fab1ffff700 1 -- 172.21.15.157:0/1199117269 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fab2c02b730 con 0x7fab3814e1e0 2024-04-18T03:37:17.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.479+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3804e6c0 con 0x7fab3814e1e0 2024-04-18T03:37:17.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.479+0000 7fab1ffff700 1 -- 172.21.15.157:0/1199117269 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fab2c04adc0 con 0x7fab3814e1e0 2024-04-18T03:37:17.546 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:17.542+0000 7fae05dbc2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T03:37:17.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.567+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fab3806be20 con 0x7fab3814e1e0 2024-04-18T03:37:17.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab1ffff700 1 -- 172.21.15.157:0/1199117269 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fab2c039020 con 0x7fab3814e1e0 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab3814e1e0 msgr2=0x7fab3815e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab3814e1e0 0x7fab3815e210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fab2c007330 tx=0x7fab2c001120 comp rx=0 tx=0).stop 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 shutdown_connections 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab3815d540 0x7fab380b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab3814e5c0 0x7fab380b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 --2- 172.21.15.157:0/1199117269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab3814e1e0 0x7fab3815e210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 >> 172.21.15.157:0/1199117269 conn(0x7fab380d0de0 msgr2=0x7fab38072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 shutdown_connections 2024-04-18T03:37:17.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:17.571+0000 7fab3db37700 1 -- 172.21.15.157:0/1199117269 wait complete. 2024-04-18T03:37:17.578 INFO:teuthology.orchestra.run.smithi157.stderr:adjusted tunables profile to default 2024-04-18T03:37:17.592 INFO:tasks.ceph:check_enable_crimson: False 2024-04-18T03:37:17.592 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-18T03:37:17.593 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:17.593 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-18T03:37:17.606 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:17.607 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-18T03:37:17.617 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:17.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-18T03:37:17.669 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:17.667+0000 7f3d4187d2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T03:37:17.675 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:17.675 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-18T03:37:17.685 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:17.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-18T03:37:17.698 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:17.699 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-18T03:37:17.756 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:17.756 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-18T03:37:17.761 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:17.759+0000 7fae05dbc2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T03:37:17.769 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:37:17.769 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-18T03:37:17.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 165c2f33-363d-484c-8207-ae6b65dac033 0 2024-04-18T03:37:17.812 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:17.807+0000 7fae05dbc2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T03:37:17.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.919+0000 7f0c5de4d700 1 Processor -- start 2024-04-18T03:37:17.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.919+0000 7f0c5de4d700 1 -- start start 2024-04-18T03:37:17.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5de4d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c5806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5de4d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c580d0330 con 0x7f0c5815e190 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5de4d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5815e690 con 0x7f0c58071010 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5de4d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580cfa00 con 0x7f0c5815d060 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0c58071010 0x7f0c580b30e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39086/0 (socket says 172.21.15.175:39086) 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5ce4b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c5806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 -- 172.21.15.175:0/718924571 learned_addr learned my addr 172.21.15.175:0/718924571 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5ce4b700 1 -- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 msgr2=0x7f0c5806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5ce4b700 1 -- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 msgr2=0x7f0c5806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5ce4b700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c5806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5ce4b700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c5806cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413191034 0 0) 0x7f0c5815e690 con 0x7f0c58071010 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c480035d0 con 0x7f0c58071010 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606651104 0 0) 0x7f0c580d0330 con 0x7f0c5815e190 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c5815e690 con 0x7f0c5815e190 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1863486879 0 0) 0x7f0c480035d0 con 0x7f0c58071010 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 msgr2=0x7f0c5806cb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c5806cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 >> v1:172.21.15.157:6789/0 conn(0x7f0c5815e190 legacy=0x7f0c58070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580cfce0 con 0x7f0c58071010 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7f0c500019f0 con 0x7f0c58071010 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 >> v1:172.21.15.175:6789/0 conn(0x7f0c58071010 legacy=0x7f0c580b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c48003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004110 0x7f0c48004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48004db0 0x7f0c48005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580cfa00 con 0x7f0c48004110 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4800bb90 con 0x7f0c48004db0 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4800bd50 con 0x7f0c5815d060 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48004db0 0x7f0c48005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5ce4b700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c48003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c57fff700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004110 0x7f0c48004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 -- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 msgr2=0x7f0c48003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c48003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 -- 172.21.15.175:0/718924571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004110 msgr2=0x7f0c48004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004110 0x7f0c48004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 -- 172.21.15.175:0/718924571 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480035d0 con 0x7f0c48004db0 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c57fff700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004110 0x7f0c48004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5ce4b700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c5815d060 0x7f0c48003bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c5d64c700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48004db0 0x7f0c48005230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c5806c600 tx=0x7f0c480058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89483a9124db7946 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500072d0 con 0x7f0c48004db0 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50007430 con 0x7f0c48004db0 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.923+0000 7f0c577fe700 1 -- 172.21.15.175:0/718924571 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500077e0 con 0x7f0c48004db0 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48004db0 msgr2=0x7f0c48005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 --2- 172.21.15.175:0/718924571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48004db0 0x7f0c48005230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c5806c600 tx=0x7f0c480058a0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5d64c700 1 -- 172.21.15.175:0/718924571 reap_dead start 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- 172.21.15.175:0/718924571 shutdown_connections 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- 172.21.15.175:0/718924571 >> 172.21.15.175:0/718924571 conn(0x7f0c5806b780 msgr2=0x7f0c5806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- 172.21.15.175:0/718924571 shutdown_connections 2024-04-18T03:37:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- 172.21.15.175:0/718924571 wait complete. 2024-04-18T03:37:17.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 Processor -- start 2024-04-18T03:37:17.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- start start 2024-04-18T03:37:17.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004db0 0x7f0c58158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 0x7f0c58140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c581f6250 0x7f0c581f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:17.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c581f6c10 con 0x7f0c48004db0 2024-04-18T03:37:17.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58153970 con 0x7f0c581f6250 2024-04-18T03:37:17.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.927+0000 7f0c5de4d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58153e00 con 0x7f0c58147770 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c57fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 0x7f0c58140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c581f6250 0x7f0c581f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c581f6250 0x7f0c581f66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55550/0 (socket says 172.21.15.175:55550) 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c57fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 0x7f0c58140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:50202/0 (socket says 172.21.15.175:50202) 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 -- 172.21.15.175:0/2376099468 learned_addr learned my addr 172.21.15.175:0/2376099468 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5ce4b700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004db0 0x7f0c58158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c57fff700 1 -- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 msgr2=0x7f0c58140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c57fff700 1 -- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 msgr2=0x7f0c58140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c57fff700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 0x7f0c58140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c57fff700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 0x7f0c58140dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 -- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 msgr2=0x7f0c58140dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 0x7f0c58140dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 -- 172.21.15.175:0/2376099468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004db0 msgr2=0x7f0c58158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004db0 0x7f0c58158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 -- 172.21.15.175:0/2376099468 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58152da0 con 0x7f0c581f6250 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5d64c700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c581f6250 0x7f0c581f66d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001c30 tx=0x7f0c50001d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c557fa700 1 -- 172.21.15.175:0/2376099468 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50024030 con 0x7f0c581f6250 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c557fa700 1 -- 172.21.15.175:0/2376099468 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50007ad0 con 0x7f0c581f6250 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c58147bf0 con 0x7f0c581f6250 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c557fa700 1 -- 172.21.15.175:0/2376099468 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5001f650 con 0x7f0c581f6250 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c58153320 con 0x7f0c581f6250 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c557fa700 1 -- 172.21.15.175:0/2376099468 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0c50027070 con 0x7f0c581f6250 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5804e650 con 0x7f0c581f6250 2024-04-18T03:37:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.931+0000 7f0c557fa700 1 -- 172.21.15.175:0/2376099468 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0c50025070 con 0x7f0c581f6250 2024-04-18T03:37:17.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:17.935+0000 7f0c557fa700 1 -- 172.21.15.175:0/2376099468 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0c4c00f040 con 0x7f0c581f6250 2024-04-18T03:37:17.992 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:17.987+0000 7fae05dbc2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T03:37:18.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.011+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "165c2f33-363d-484c-8207-ae6b65dac033", "id": 0} v 0) v1 -- 0x7f0c58071500 con 0x7f0c581f6250 2024-04-18T03:37:18.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.019+0000 7f0c557fa700 1 -- 172.21.15.175:0/2376099468 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "165c2f33-363d-484c-8207-ae6b65dac033", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c50018070 con 0x7f0c581f6250 2024-04-18T03:37:18.025 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c581f6250 msgr2=0x7f0c581f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c581f6250 0x7f0c581f66d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001c30 tx=0x7f0c50001d00 comp rx=0 tx=0).stop 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 shutdown_connections 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c581f6250 0x7f0c581f66d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c58147770 0x7f0c58140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 --2- 172.21.15.175:0/2376099468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c48004db0 0x7f0c58158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 >> 172.21.15.175:0/2376099468 conn(0x7f0c5806b780 msgr2=0x7f0c580cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 shutdown_connections 2024-04-18T03:37:18.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.023+0000 7f0c5de4d700 1 -- 172.21.15.175:0/2376099468 wait complete. 2024-04-18T03:37:18.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new d9a44f35-aaa1-4852-8915-e09a3db3a69b 1 2024-04-18T03:37:18.059 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:18.055+0000 7fae05dbc2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T03:37:18.125 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:18.119+0000 7fae05dbc2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T03:37:18.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 Processor -- start 2024-04-18T03:37:18.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- start start 2024-04-18T03:37:18.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f13bc071750 0x7f13bc0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f13bc06a7d0 0x7f13bc06ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc0cc590 con 0x7f13bc0cb3e0 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc0cbf50 con 0x7f13bc06a7d0 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc0cd060 con 0x7f13bc071750 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13bbfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f13bc071750 0x7f13bc0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13bb7fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f13bc0cb3e0 0x7f13bc0cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39094/0 (socket says 172.21.15.175:39094) 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13bb7fe700 1 -- 172.21.15.175:0/524233695 learned_addr learned my addr 172.21.15.175:0/524233695 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c0c23700 1 --2- 172.21.15.175:0/524233695 >> v2:172.21.15.157:3300/0 conn(0x7f13bc06a7d0 0x7f13bc06ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13bbfff700 1 -- 172.21.15.175:0/524233695 >> v2:172.21.15.157:3300/0 conn(0x7f13bc06a7d0 msgr2=0x7f13bc06ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13baffd700 1 -- 172.21.15.175:0/524233695 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230023601 0 0) 0x7f13bc0cc590 con 0x7f13bc0cb3e0 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13bbfff700 1 --2- 172.21.15.175:0/524233695 >> v2:172.21.15.157:3300/0 conn(0x7f13bc06a7d0 0x7f13bc06ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13bbfff700 1 -- 172.21.15.175:0/524233695 >> v1:172.21.15.175:6789/0 conn(0x7f13bc0cb3e0 legacy=0x7f13bc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13bbfff700 1 -- 172.21.15.175:0/524233695 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0cd340 con 0x7f13bc071750 2024-04-18T03:37:18.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13bbfff700 1 --2- 172.21.15.175:0/524233695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 0x7f13bc0cf230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0b37b0 tx=0x7f13ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0fc533147862a23 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13baffd700 1 -- 172.21.15.175:0/524233695 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00e070 con 0x7f13bc071750 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13baffd700 1 -- 172.21.15.175:0/524233695 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac00bb20 con 0x7f13bc071750 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13baffd700 1 -- 172.21.15.175:0/524233695 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac012430 con 0x7f13bc071750 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- 172.21.15.175:0/524233695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 msgr2=0x7f13bc0cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 --2- 172.21.15.175:0/524233695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 0x7f13bc0cf230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0b37b0 tx=0x7f13ac00b330 comp rx=0 tx=0).stop 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- 172.21.15.175:0/524233695 shutdown_connections 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 --2- 172.21.15.175:0/524233695 >> v2:172.21.15.157:3300/0 conn(0x7f13bc06a7d0 0x7f13bc06ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 --2- 172.21.15.175:0/524233695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 0x7f13bc0cf230 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- 172.21.15.175:0/524233695 >> 172.21.15.175:0/524233695 conn(0x7f13bc0d0c50 msgr2=0x7f13bc0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- 172.21.15.175:0/524233695 shutdown_connections 2024-04-18T03:37:18.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.143+0000 7f13c1424700 1 -- 172.21.15.175:0/524233695 wait complete. 2024-04-18T03:37:18.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c1424700 1 Processor -- start 2024-04-18T03:37:18.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c1424700 1 -- start start 2024-04-18T03:37:18.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c1424700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13bc06a7d0 0x7f13bc1f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c1424700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 0x7f13bc0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c1424700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 0x7f13bc0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c1424700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc1f6c20 con 0x7f13bc06a7d0 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c1424700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc14fb20 con 0x7f13bc071750 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c1424700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc14fd70 con 0x7f13bc0cb3e0 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 0x7f13bc0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c0c23700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 0x7f13bc0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c0c23700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 0x7f13bc0c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:50214/0 (socket says 172.21.15.175:50214) 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c0c23700 1 -- 172.21.15.175:0/1560641919 learned_addr learned my addr 172.21.15.175:0/1560641919 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c0c23700 1 -- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 msgr2=0x7f13bc0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c0c23700 1 -- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 msgr2=0x7f13bc0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c0c23700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 0x7f13bc0c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bbfff700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13bc06a7d0 0x7f13bc1f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13c0c23700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 0x7f13bc0c7180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:18.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bb7fe700 1 -- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 msgr2=0x7f13bc0c7180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bb7fe700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 0x7f13bc0c7180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bb7fe700 1 -- 172.21.15.175:0/1560641919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13bc06a7d0 msgr2=0x7f13bc1f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bb7fe700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13bc06a7d0 0x7f13bc1f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bb7fe700 1 -- 172.21.15.175:0/1560641919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac009a70 con 0x7f13bc071750 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bbfff700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13bc06a7d0 0x7f13bc1f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.147+0000 7f13bb7fe700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 0x7f13bc0c6c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c480 tx=0x7f13b000c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.151+0000 7f13b8ff9700 1 -- 172.21.15.175:0/1560641919 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0004ca0 con 0x7f13bc071750 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.151+0000 7f13b8ff9700 1 -- 172.21.15.175:0/1560641919 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b0004e00 con 0x7f13bc071750 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.151+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc150050 con 0x7f13bc071750 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.151+0000 7f13b8ff9700 1 -- 172.21.15.175:0/1560641919 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0007310 con 0x7f13bc071750 2024-04-18T03:37:18.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.151+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc150610 con 0x7f13bc071750 2024-04-18T03:37:18.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.151+0000 7f13b8ff9700 1 -- 172.21.15.175:0/1560641919 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f13b001d3f0 con 0x7f13bc071750 2024-04-18T03:37:18.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.151+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc0b0420 con 0x7f13bc071750 2024-04-18T03:37:18.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.151+0000 7f13b8ff9700 1 -- 172.21.15.175:0/1560641919 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f13b001dc80 con 0x7f13bc071750 2024-04-18T03:37:18.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.155+0000 7f13b8ff9700 1 -- 172.21.15.175:0/1560641919 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f13b00133c0 con 0x7f13bc071750 2024-04-18T03:37:18.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.231+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9a44f35-aaa1-4852-8915-e09a3db3a69b", "id": 1} v 0) v1 -- 0x7f13bc150b30 con 0x7f13bc071750 2024-04-18T03:37:18.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.239+0000 7f13b8ff9700 1 -- 172.21.15.175:0/1560641919 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9a44f35-aaa1-4852-8915-e09a3db3a69b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f13bc150b30 con 0x7f13bc071750 2024-04-18T03:37:18.244 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-18T03:37:18.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 msgr2=0x7f13bc0c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 0x7f13bc0c6c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c480 tx=0x7f13b000c840 comp rx=0 tx=0).stop 2024-04-18T03:37:18.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 shutdown_connections 2024-04-18T03:37:18.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13bc071750 0x7f13bc0c6c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13bc0cb3e0 0x7f13bc0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 --2- 172.21.15.175:0/1560641919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13bc06a7d0 0x7f13bc1f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 >> 172.21.15.175:0/1560641919 conn(0x7f13bc0d0c50 msgr2=0x7f13bc0b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 shutdown_connections 2024-04-18T03:37:18.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.243+0000 7f13c1424700 1 -- 172.21.15.175:0/1560641919 wait complete. 2024-04-18T03:37:18.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 1609c2d8-8c94-4fcc-83b8-814080945e18 2 2024-04-18T03:37:18.297 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:18.291+0000 7f3d4187d2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T03:37:18.355 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:18.351+0000 7f3d4187d2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T03:37:18.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.367+0000 7fba79d7d700 1 Processor -- start 2024-04-18T03:37:18.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.367+0000 7fba79d7d700 1 -- start start 2024-04-18T03:37:18.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fba740ac970 0x7fba740cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba740cc920 con 0x7fba740cddc0 2024-04-18T03:37:18.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba740cbd10 con 0x7fba7415b070 2024-04-18T03:37:18.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba740cbff0 con 0x7fba740ac970 2024-04-18T03:37:18.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba78d7b700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fba7415b070 0x7fba740ac260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39106/0 (socket says 172.21.15.175:39106) 2024-04-18T03:37:18.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba78d7b700 1 -- 172.21.15.175:0/1671707838 learned_addr learned my addr 172.21.15.175:0/1671707838 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-18T03:37:18.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba73fff700 1 --2- 172.21.15.175:0/1671707838 >> v2:172.21.15.157:3300/0 conn(0x7fba740ac970 0x7fba740cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba737fe700 1 -- 172.21.15.175:0/1671707838 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086009531 0 0) 0x7fba740cbd10 con 0x7fba7415b070 2024-04-18T03:37:18.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba737fe700 1 -- 172.21.15.175:0/1671707838 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba600035d0 con 0x7fba7415b070 2024-04-18T03:37:18.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba73fff700 1 -- 172.21.15.175:0/1671707838 >> v1:172.21.15.175:6789/0 conn(0x7fba7415b070 legacy=0x7fba740ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba73fff700 1 -- 172.21.15.175:0/1671707838 >> v1:172.21.15.157:6789/0 conn(0x7fba740cddc0 legacy=0x7fba74164ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba73fff700 1 -- 172.21.15.175:0/1671707838 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740cc2d0 con 0x7fba740ac970 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba73fff700 1 --2- 172.21.15.175:0/1671707838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba740ac970 0x7fba740cf8d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009850 tx=0x7fba5c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e0f9ee66f0a7f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba737fe700 1 -- 172.21.15.175:0/1671707838 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c011830 con 0x7fba740ac970 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba737fe700 1 -- 172.21.15.175:0/1671707838 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c011990 con 0x7fba740ac970 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba737fe700 1 -- 172.21.15.175:0/1671707838 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c011d00 con 0x7fba740ac970 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 -- 172.21.15.175:0/1671707838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba740ac970 msgr2=0x7fba740cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 --2- 172.21.15.175:0/1671707838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba740ac970 0x7fba740cf8d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009850 tx=0x7fba5c009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 -- 172.21.15.175:0/1671707838 shutdown_connections 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 --2- 172.21.15.175:0/1671707838 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba740ac970 0x7fba740cf8d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 -- 172.21.15.175:0/1671707838 >> 172.21.15.175:0/1671707838 conn(0x7fba74098a50 msgr2=0x7fba740b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 -- 172.21.15.175:0/1671707838 shutdown_connections 2024-04-18T03:37:18.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.371+0000 7fba79d7d700 1 -- 172.21.15.175:0/1671707838 wait complete. 2024-04-18T03:37:18.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 Processor -- start 2024-04-18T03:37:18.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 -- start start 2024-04-18T03:37:18.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba740ac970 0x7fba740993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 0x7fba7414c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba7415b070 0x7fba7409b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7415b580 con 0x7fba7415b070 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7409a600 con 0x7fba740ac970 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7409a8e0 con 0x7fba740cddc0 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba73fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 0x7fba7414c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba73fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 0x7fba7414c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:50224/0 (socket says 172.21.15.175:50224) 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba78d7b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba740ac970 0x7fba740993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba73fff700 1 -- 172.21.15.175:0/30752993 learned_addr learned my addr 172.21.15.175:0/30752993 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:18.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba73fff700 1 -- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 msgr2=0x7fba7414c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba73fff700 1 -- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 msgr2=0x7fba7414c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba7957c700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba7415b070 0x7fba7409b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba73fff700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 0x7fba7414c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba73fff700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 0x7fba7414c510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba78d7b700 1 -- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 msgr2=0x7fba7414c510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba78d7b700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 0x7fba7414c510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba78d7b700 1 -- 172.21.15.175:0/30752993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba7415b070 msgr2=0x7fba7409b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba78d7b700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba7415b070 0x7fba7409b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba78d7b700 1 -- 172.21.15.175:0/30752993 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0094b0 con 0x7fba740ac970 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba78d7b700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba740ac970 0x7fba740993e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba6400cbc0 tx=0x7fba6400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba717fa700 1 -- 172.21.15.175:0/30752993 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64007480 con 0x7fba740ac970 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba717fa700 1 -- 172.21.15.175:0/30752993 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba640075e0 con 0x7fba740ac970 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7409abc0 con 0x7fba740ac970 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba717fa700 1 -- 172.21.15.175:0/30752993 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64007950 con 0x7fba740ac970 2024-04-18T03:37:18.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.375+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7409aea0 con 0x7fba740ac970 2024-04-18T03:37:18.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.379+0000 7fba717fa700 1 -- 172.21.15.175:0/30752993 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fba6401c440 con 0x7fba740ac970 2024-04-18T03:37:18.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.379+0000 7fba717fa700 1 -- 172.21.15.175:0/30752993 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fba6401cb10 con 0x7fba740ac970 2024-04-18T03:37:18.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.379+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7404e650 con 0x7fba740ac970 2024-04-18T03:37:18.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.383+0000 7fba717fa700 1 -- 172.21.15.175:0/30752993 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fba64021060 con 0x7fba740ac970 2024-04-18T03:37:18.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.455+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1609c2d8-8c94-4fcc-83b8-814080945e18", "id": 2} v 0) v1 -- 0x7fba7415a6e0 con 0x7fba740ac970 2024-04-18T03:37:18.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.463+0000 7fba717fa700 1 -- 172.21.15.175:0/30752993 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1609c2d8-8c94-4fcc-83b8-814080945e18", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba64017070 con 0x7fba740ac970 2024-04-18T03:37:18.468 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-04-18T03:37:18.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba740ac970 msgr2=0x7fba740993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba740ac970 0x7fba740993e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba6400cbc0 tx=0x7fba6400cbf0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 shutdown_connections 2024-04-18T03:37:18.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba7415b070 0x7fba7409b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba740cddc0 0x7fba7414c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 --2- 172.21.15.175:0/30752993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba740ac970 0x7fba740993e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 >> 172.21.15.175:0/30752993 conn(0x7fba74098a50 msgr2=0x7fba740cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 shutdown_connections 2024-04-18T03:37:18.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.467+0000 7fba79d7d700 1 -- 172.21.15.175:0/30752993 wait complete. 2024-04-18T03:37:18.487 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 9ebb0677-95fc-47c6-84a7-12a33666c582 3 2024-04-18T03:37:18.527 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:18.523+0000 7f3d4187d2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T03:37:18.544 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:18.539+0000 7fae05dbc2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T03:37:18.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 Processor -- start 2024-04-18T03:37:18.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- start start 2024-04-18T03:37:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc06b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f89dc0b7290 0x7f89dc0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc06be60 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc140470 con 0x7f89dc0b7290 2024-04-18T03:37:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc1435a0 con 0x7f89dc06b4c0 2024-04-18T03:37:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89d3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89db7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f89dc0b7290 0x7f89dc0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89db7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f89dc0b7290 0x7f89dc0b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.175:36602/0 (socket says 172.21.15.175:36602) 2024-04-18T03:37:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89db7fe700 1 -- 172.21.15.175:0/581079732 learned_addr learned my addr 172.21.15.175:0/581079732 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89daffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f89dc0cf7c0 0x7f89dc142e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.175:46466/0 (socket says 172.21.15.175:46466) 2024-04-18T03:37:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89d3fff700 1 -- 172.21.15.175:0/581079732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 msgr2=0x7f89dc06b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T03:37:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89d3fff700 1 -- 172.21.15.175:0/581079732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 msgr2=0x7f89dc06b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89d3fff700 1 --2- 172.21.15.175:0/581079732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc06b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89d3fff700 1 --2- 172.21.15.175:0/581079732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc06b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89db7fe700 1 -- 172.21.15.175:0/581079732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 msgr2=0x7f89dc06b920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89db7fe700 1 --2- 172.21.15.175:0/581079732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc06b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89db7fe700 1 -- 172.21.15.175:0/581079732 >> v1:172.21.15.157:6789/0 conn(0x7f89dc0cf7c0 legacy=0x7f89dc142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89db7fe700 1 -- 172.21.15.175:0/581079732 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc160bf0 con 0x7f89dc0b7290 2024-04-18T03:37:18.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89db7fe700 1 --2- 172.21.15.175:0/581079732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 0x7f89dc0b7720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009e50 tx=0x7f89d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90867eb099eba0a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:18.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89da7fc700 1 -- 172.21.15.175:0/581079732 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400e070 con 0x7f89dc0b7290 2024-04-18T03:37:18.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89da7fc700 1 -- 172.21.15.175:0/581079732 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400b9c0 con 0x7f89dc0b7290 2024-04-18T03:37:18.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89da7fc700 1 -- 172.21.15.175:0/581079732 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400bd70 con 0x7f89dc0b7290 2024-04-18T03:37:18.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- 172.21.15.175:0/581079732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 msgr2=0x7f89dc0b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 --2- 172.21.15.175:0/581079732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 0x7f89dc0b7720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009e50 tx=0x7f89d400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:18.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- 172.21.15.175:0/581079732 shutdown_connections 2024-04-18T03:37:18.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 --2- 172.21.15.175:0/581079732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 0x7f89dc0b7720 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 --2- 172.21.15.175:0/581079732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc06b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- 172.21.15.175:0/581079732 >> 172.21.15.175:0/581079732 conn(0x7f89dc0b4e70 msgr2=0x7f89dc0b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- 172.21.15.175:0/581079732 shutdown_connections 2024-04-18T03:37:18.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.587+0000 7f89e18cb700 1 -- 172.21.15.175:0/581079732 wait complete. 2024-04-18T03:37:18.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 Processor -- start 2024-04-18T03:37:18.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 -- start start 2024-04-18T03:37:18.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 0x7f89dc13d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc0cf7c0 0x7f89dc141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc1425c0 con 0x7f89dc0b7290 2024-04-18T03:37:18.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc1428a0 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc143910 con 0x7f89dc06b4c0 2024-04-18T03:37:18.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc0cf7c0 0x7f89dc141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89daffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc0cf7c0 0x7f89dc141940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55588/0 (socket says 172.21.15.175:55588) 2024-04-18T03:37:18.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 -- 172.21.15.175:0/1208626003 learned_addr learned my addr 172.21.15.175:0/1208626003 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89d3fff700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 0x7f89dc13d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89daffd700 1 -- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 msgr2=0x7f89dc1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89daffd700 1 -- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 msgr2=0x7f89dc1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89daffd700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc1443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89daffd700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc1443f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 -- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 msgr2=0x7f89dc1443f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc1443f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 -- 172.21.15.175:0/1208626003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 msgr2=0x7f89dc13d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 0x7f89dc13d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 -- 172.21.15.175:0/1208626003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009b30 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89db7fe700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc0cf7c0 0x7f89dc141940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0b6130 tx=0x7f89d4004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:18.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89d8ff9700 1 -- 172.21.15.175:0/1208626003 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40048b0 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89d8ff9700 1 -- 172.21.15.175:0/1208626003 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d40099b0 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc143bf0 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89d8ff9700 1 -- 172.21.15.175:0/1208626003 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d401b670 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.591+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc144930 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.595+0000 7f89d8ff9700 1 -- 172.21.15.175:0/1208626003 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f89d401bad0 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.595+0000 7f89d8ff9700 1 -- 172.21.15.175:0/1208626003 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f89d4024d40 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.595+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc1440b0 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.599+0000 7f89d8ff9700 1 -- 172.21.15.175:0/1208626003 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f89d401f070 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.666 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:18.663+0000 7fae05dbc2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T03:37:18.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.671+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ebb0677-95fc-47c6-84a7-12a33666c582", "id": 3} v 0) v1 -- 0x7f89dc04e6c0 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89d8ff9700 1 -- 172.21.15.175:0/1208626003 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ebb0677-95fc-47c6-84a7-12a33666c582", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89d4032020 con 0x7f89dc0cf7c0 2024-04-18T03:37:18.683 INFO:teuthology.orchestra.run.smithi175.stdout:3 2024-04-18T03:37:18.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc0cf7c0 msgr2=0x7f89dc141940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc0cf7c0 0x7f89dc141940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0b6130 tx=0x7f89d4004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 shutdown_connections 2024-04-18T03:37:18.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc0cf7c0 0x7f89dc141940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89dc0b7290 0x7f89dc13d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 --2- 172.21.15.175:0/1208626003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc06b4c0 0x7f89dc1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 >> 172.21.15.175:0/1208626003 conn(0x7f89dc0b4e70 msgr2=0x7f89dc06a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 shutdown_connections 2024-04-18T03:37:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.679+0000 7f89e18cb700 1 -- 172.21.15.175:0/1208626003 wait complete. 2024-04-18T03:37:18.694 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new ddcb2147-b03c-478b-afb0-ab02c990eb37 4 2024-04-18T03:37:18.740 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:18.735+0000 7f3d4187d2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T03:37:18.790 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:18.787+0000 7f3d4187d2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T03:37:18.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.803+0000 7efdf32ef700 1 Processor -- start 2024-04-18T03:37:18.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.803+0000 7efdf32ef700 1 -- start start 2024-04-18T03:37:18.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efdec06e070 0x7efdec06e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 0x7efdec0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec15e3c0 con 0x7efdec1427f0 2024-04-18T03:37:18.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec15d5c0 con 0x7efdec06e070 2024-04-18T03:37:18.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec143720 con 0x7efdec0b5f90 2024-04-18T03:37:18.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf2aee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 0x7efdec0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf2aee700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 0x7efdec0b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:50258/0 (socket says 172.21.15.175:50258) 2024-04-18T03:37:18.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf2aee700 1 -- 172.21.15.175:0/556976923 learned_addr learned my addr 172.21.15.175:0/556976923 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf2aee700 1 -- 172.21.15.175:0/556976923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 msgr2=0x7efdec0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf2aee700 1 -- 172.21.15.175:0/556976923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 msgr2=0x7efdec0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf2aee700 1 --2- 172.21.15.175:0/556976923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 0x7efdec0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf22ed700 1 --2- 172.21.15.175:0/556976923 >> v2:172.21.15.157:3300/0 conn(0x7efdec06e070 0x7efdec06e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf2aee700 1 --2- 172.21.15.175:0/556976923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 0x7efdec0b6420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf22ed700 1 -- 172.21.15.175:0/556976923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 msgr2=0x7efdec0b6420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf22ed700 1 --2- 172.21.15.175:0/556976923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 0x7efdec0b6420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf22ed700 1 -- 172.21.15.175:0/556976923 >> v1:172.21.15.157:6789/0 conn(0x7efdec1427f0 legacy=0x7efdec143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf22ed700 1 -- 172.21.15.175:0/556976923 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec06e990 con 0x7efdec06e070 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf22ed700 1 --2- 172.21.15.175:0/556976923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec06e070 0x7efdec06e450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efde8009850 tx=0x7efde8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c601a80e1580b0c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf12eb700 1 -- 172.21.15.175:0/556976923 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8011830 con 0x7efdec06e070 2024-04-18T03:37:18.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf12eb700 1 -- 172.21.15.175:0/556976923 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8011990 con 0x7efdec06e070 2024-04-18T03:37:18.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf12eb700 1 -- 172.21.15.175:0/556976923 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8011d20 con 0x7efdec06e070 2024-04-18T03:37:18.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 -- 172.21.15.175:0/556976923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec06e070 msgr2=0x7efdec06e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 --2- 172.21.15.175:0/556976923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec06e070 0x7efdec06e450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efde8009850 tx=0x7efde8009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:18.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 -- 172.21.15.175:0/556976923 shutdown_connections 2024-04-18T03:37:18.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 --2- 172.21.15.175:0/556976923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec0b5f90 0x7efdec0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 --2- 172.21.15.175:0/556976923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec06e070 0x7efdec06e450 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 -- 172.21.15.175:0/556976923 >> 172.21.15.175:0/556976923 conn(0x7efdec0d3240 msgr2=0x7efdec0d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 -- 172.21.15.175:0/556976923 shutdown_connections 2024-04-18T03:37:18.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.807+0000 7efdf32ef700 1 -- 172.21.15.175:0/556976923 wait complete. 2024-04-18T03:37:18.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 Processor -- start 2024-04-18T03:37:18.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 -- start start 2024-04-18T03:37:18.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 0x7efdec13a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdec0b5f90 0x7efdec13aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec1427f0 0x7efdec1f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec13c880 con 0x7efdec1427f0 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec06bc30 con 0x7efdec0b5f90 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec13af60 con 0x7efdec06e070 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf22ed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 0x7efdec13a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf22ed700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 0x7efdec13a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:50262/0 (socket says 172.21.15.175:50262) 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf22ed700 1 -- 172.21.15.175:0/3919117458 learned_addr learned my addr 172.21.15.175:0/3919117458 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf1aec700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdec0b5f90 0x7efdec13aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf22ed700 1 -- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 msgr2=0x7efdec13a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf22ed700 1 -- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 msgr2=0x7efdec13a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf22ed700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 0x7efdec13a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:18.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf2aee700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec1427f0 0x7efdec1f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf22ed700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 0x7efdec13a4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf1aec700 1 -- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 msgr2=0x7efdec13a4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf1aec700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 0x7efdec13a4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf1aec700 1 -- 172.21.15.175:0/3919117458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec1427f0 msgr2=0x7efdec1f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf1aec700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec1427f0 0x7efdec1f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf1aec700 1 -- 172.21.15.175:0/3919117458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80094b0 con 0x7efdec0b5f90 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf1aec700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdec0b5f90 0x7efdec13aa20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c480 tx=0x7efddc00c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efde2ffd700 1 -- 172.21.15.175:0/3919117458 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0052d0 con 0x7efdec0b5f90 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efde2ffd700 1 -- 172.21.15.175:0/3919117458 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc005430 con 0x7efdec0b5f90 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.811+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec06b6d0 con 0x7efdec0b5f90 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.815+0000 7efde2ffd700 1 -- 172.21.15.175:0/3919117458 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0055a0 con 0x7efdec0b5f90 2024-04-18T03:37:18.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.815+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec13cd90 con 0x7efdec0b5f90 2024-04-18T03:37:18.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.815+0000 7efde2ffd700 1 -- 172.21.15.175:0/3919117458 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7efddc003be0 con 0x7efdec0b5f90 2024-04-18T03:37:18.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.815+0000 7efde2ffd700 1 -- 172.21.15.175:0/3919117458 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7efddc011d60 con 0x7efdec0b5f90 2024-04-18T03:37:18.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.815+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec04e650 con 0x7efdec0b5f90 2024-04-18T03:37:18.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.819+0000 7efde2ffd700 1 -- 172.21.15.175:0/3919117458 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7efddc017070 con 0x7efdec0b5f90 2024-04-18T03:37:18.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.903+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ddcb2147-b03c-478b-afb0-ab02c990eb37", "id": 4} v 0) v1 -- 0x7efdec0d2c00 con 0x7efdec0b5f90 2024-04-18T03:37:18.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.907+0000 7efde2ffd700 1 -- 172.21.15.175:0/3919117458 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ddcb2147-b03c-478b-afb0-ab02c990eb37", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efddc011590 con 0x7efdec0b5f90 2024-04-18T03:37:18.913 INFO:teuthology.orchestra.run.smithi175.stdout:4 2024-04-18T03:37:18.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdec0b5f90 msgr2=0x7efdec13aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:18.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdec0b5f90 0x7efdec13aa20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c480 tx=0x7efddc00c790 comp rx=0 tx=0).stop 2024-04-18T03:37:18.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 shutdown_connections 2024-04-18T03:37:18.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdec0b5f90 0x7efdec13aa20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdec1427f0 0x7efdec1f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 --2- 172.21.15.175:0/3919117458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdec06e070 0x7efdec13a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:18.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 >> 172.21.15.175:0/3919117458 conn(0x7efdec0d3240 msgr2=0x7efdec1403d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:18.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 shutdown_connections 2024-04-18T03:37:18.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:18.911+0000 7efdf32ef700 1 -- 172.21.15.175:0/3919117458 wait complete. 2024-04-18T03:37:18.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 61c6e576-8a03-4f71-a038-70c825757adf 5 2024-04-18T03:37:18.980 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:18.975+0000 7f3d4187d2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T03:37:19.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.027+0000 7f3e89bd4700 1 Processor -- start 2024-04-18T03:37:19.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.027+0000 7f3e89bd4700 1 -- start start 2024-04-18T03:37:19.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3e840cf740 0x7f3e8406a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e840ccb90 con 0x7f3e840cc2d0 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e840cc8b0 con 0x7f3e8415d340 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e84070860 con 0x7f3e840cf740 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e83fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3e840cf740 0x7f3e8406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e837fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3e8415d340 0x7f3e840cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39112/0 (socket says 172.21.15.175:39112) 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e837fe700 1 -- 172.21.15.175:0/1446822905 learned_addr learned my addr 172.21.15.175:0/1446822905 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e83fff700 1 -- 172.21.15.175:0/1446822905 >> v1:172.21.15.175:6789/0 conn(0x7f3e8415d340 legacy=0x7f3e840cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e83fff700 1 -- 172.21.15.175:0/1446822905 >> v1:172.21.15.157:6789/0 conn(0x7f3e840cc2d0 legacy=0x7f3e840cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e827fc700 1 -- 172.21.15.175:0/1446822905 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134423851 0 0) 0x7f3e840cc8b0 con 0x7f3e8415d340 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e83fff700 1 -- 172.21.15.175:0/1446822905 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840701a0 con 0x7f3e840cf740 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e83fff700 1 --2- 172.21.15.175:0/1446822905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e840cf740 0x7f3e8406a590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009d90 tx=0x7f3e7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f55b04da7fcf0478 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:19.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e827fc700 1 -- 172.21.15.175:0/1446822905 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c00e070 con 0x7f3e840cf740 2024-04-18T03:37:19.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e827fc700 1 -- 172.21.15.175:0/1446822905 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c00bbd0 con 0x7f3e840cf740 2024-04-18T03:37:19.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e827fc700 1 -- 172.21.15.175:0/1446822905 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c012430 con 0x7f3e840cf740 2024-04-18T03:37:19.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 -- 172.21.15.175:0/1446822905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e840cf740 msgr2=0x7f3e8406a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 --2- 172.21.15.175:0/1446822905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e840cf740 0x7f3e8406a590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009d90 tx=0x7f3e7c00b330 comp rx=0 tx=0).stop 2024-04-18T03:37:19.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 -- 172.21.15.175:0/1446822905 shutdown_connections 2024-04-18T03:37:19.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 --2- 172.21.15.175:0/1446822905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e840cf740 0x7f3e8406a590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 -- 172.21.15.175:0/1446822905 >> 172.21.15.175:0/1446822905 conn(0x7f3e840d0de0 msgr2=0x7f3e840d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:19.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 -- 172.21.15.175:0/1446822905 shutdown_connections 2024-04-18T03:37:19.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.031+0000 7f3e89bd4700 1 -- 172.21.15.175:0/1446822905 wait complete. 2024-04-18T03:37:19.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 Processor -- start 2024-04-18T03:37:19.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 -- start start 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e840cc2d0 0x7f3e841510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 0x7f3e840acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e8415d340 0x7f3e840ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840ac930 con 0x7f3e840cc2d0 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840abd20 con 0x7f3e8415d340 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840ac000 con 0x7f3e840cf740 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e8415d340 0x7f3e840ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e82ffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 0x7f3e840acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e8415d340 0x7f3e840ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55616/0 (socket says 172.21.15.175:55616) 2024-04-18T03:37:19.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 -- 172.21.15.175:0/419887324 learned_addr learned my addr 172.21.15.175:0/419887324 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e837fe700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e840cc2d0 0x7f3e841510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e82ffd700 1 -- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 msgr2=0x7f3e840acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e82ffd700 1 -- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 msgr2=0x7f3e840acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e82ffd700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 0x7f3e840acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e82ffd700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 0x7f3e840acdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 -- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 msgr2=0x7f3e840acdc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 0x7f3e840acdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 -- 172.21.15.175:0/419887324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e840cc2d0 msgr2=0x7f3e841510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e840cc2d0 0x7f3e841510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 -- 172.21.15.175:0/419887324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c009a70 con 0x7f3e8415d340 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e83fff700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e8415d340 0x7f3e840ca620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c014040 tx=0x7f3e7c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e6bfff700 1 -- 172.21.15.175:0/419887324 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c01b810 con 0x7f3e8415d340 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e6bfff700 1 -- 172.21.15.175:0/419887324 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c020070 con 0x7f3e8415d340 2024-04-18T03:37:19.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e6bfff700 1 -- 172.21.15.175:0/419887324 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c01bbb0 con 0x7f3e8415d340 2024-04-18T03:37:19.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8415d8a0 con 0x7f3e8415d340 2024-04-18T03:37:19.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e840ac5c0 con 0x7f3e8415d340 2024-04-18T03:37:19.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e6bfff700 1 -- 172.21.15.175:0/419887324 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3e7c027780 con 0x7f3e8415d340 2024-04-18T03:37:19.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.035+0000 7f3e6bfff700 1 -- 172.21.15.175:0/419887324 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3e7c022070 con 0x7f3e8415d340 2024-04-18T03:37:19.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.039+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e84070c60 con 0x7f3e8415d340 2024-04-18T03:37:19.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.043+0000 7f3e6bfff700 1 -- 172.21.15.175:0/419887324 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f3e84070c60 con 0x7f3e8415d340 2024-04-18T03:37:19.046 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:19.043+0000 7f3d4187d2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T03:37:19.047 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:19.043+0000 7fae05dbc2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T03:37:19.110 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:19.107+0000 7f3d4187d2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T03:37:19.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.115+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "61c6e576-8a03-4f71-a038-70c825757adf", "id": 5} v 0) v1 -- 0x7f3e840acaa0 con 0x7f3e8415d340 2024-04-18T03:37:19.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.119+0000 7f3e6bfff700 1 -- 172.21.15.175:0/419887324 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61c6e576-8a03-4f71-a038-70c825757adf", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3e7c02c060 con 0x7f3e8415d340 2024-04-18T03:37:19.124 INFO:teuthology.orchestra.run.smithi175.stdout:5 2024-04-18T03:37:19.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.119+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e8415d340 msgr2=0x7f3e840ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.119+0000 7f3e89bd4700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e8415d340 0x7f3e840ca620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c014040 tx=0x7f3e7c004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.119+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 shutdown_connections 2024-04-18T03:37:19.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.119+0000 7f3e89bd4700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e8415d340 0x7f3e840ca620 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.119+0000 7f3e89bd4700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e840cf740 0x7f3e840acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.119+0000 7f3e89bd4700 1 --2- 172.21.15.175:0/419887324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e840cc2d0 0x7f3e841510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.119+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 >> 172.21.15.175:0/419887324 conn(0x7f3e840d0de0 msgr2=0x7f3e840cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:19.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.123+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 shutdown_connections 2024-04-18T03:37:19.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.123+0000 7f3e89bd4700 1 -- 172.21.15.175:0/419887324 wait complete. 2024-04-18T03:37:19.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new d5efcff2-47ac-4251-b7a7-0824d81eada7 6 2024-04-18T03:37:19.246 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:19.243+0000 7fae05dbc2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T03:37:19.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.243+0000 7f414997f700 1 Processor -- start 2024-04-18T03:37:19.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.243+0000 7f414997f700 1 -- start start 2024-04-18T03:37:19.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.243+0000 7f414997f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f41440b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.243+0000 7f414997f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41440af5c0 0x7f41440afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.243+0000 7f414997f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41440acd20 con 0x7f4144159800 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.243+0000 7f414997f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41440aff90 con 0x7f41440af5c0 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.243+0000 7f414997f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41440ad000 con 0x7f41440ae8b0 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414897d700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4144159800 0x7f41440addc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39122/0 (socket says 172.21.15.175:39122) 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414897d700 1 -- 172.21.15.175:0/3323387707 learned_addr learned my addr 172.21.15.175:0/3323387707 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f4143fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f41440b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414917e700 1 --2- 172.21.15.175:0/3323387707 >> v2:172.21.15.175:3300/0 conn(0x7f41440af5c0 0x7f41440afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f4143fff700 1 -- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 msgr2=0x7f41440b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f4143fff700 1 -- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 msgr2=0x7f41440b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f4143fff700 1 --2- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f41440b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f4143fff700 1 --2- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f41440b4f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414917e700 1 -- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 msgr2=0x7f41440b4f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414917e700 1 --2- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f41440b4f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414917e700 1 -- 172.21.15.175:0/3323387707 >> v1:172.21.15.175:6789/0 conn(0x7f4144159800 legacy=0x7f41440addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414917e700 1 -- 172.21.15.175:0/3323387707 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440ad2e0 con 0x7f41440af5c0 2024-04-18T03:37:19.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f41437fe700 1 -- 172.21.15.175:0/3323387707 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537457147 0 0) 0x7f41440acd20 con 0x7f4144159800 2024-04-18T03:37:19.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414917e700 1 --2- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f41440afa50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f413c009850 tx=0x7f413c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fd39448580b4ef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:19.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f41437fe700 1 -- 172.21.15.175:0/3323387707 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c011830 con 0x7f41440af5c0 2024-04-18T03:37:19.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f41437fe700 1 -- 172.21.15.175:0/3323387707 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c011990 con 0x7f41440af5c0 2024-04-18T03:37:19.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f41437fe700 1 -- 172.21.15.175:0/3323387707 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c011d20 con 0x7f41440af5c0 2024-04-18T03:37:19.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414997f700 1 -- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 msgr2=0x7f41440afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414997f700 1 --2- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f41440afa50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f413c009850 tx=0x7f413c009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:19.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414997f700 1 -- 172.21.15.175:0/3323387707 shutdown_connections 2024-04-18T03:37:19.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414997f700 1 --2- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f41440afa50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414997f700 1 --2- 172.21.15.175:0/3323387707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f41440b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414997f700 1 -- 172.21.15.175:0/3323387707 >> 172.21.15.175:0/3323387707 conn(0x7f41440b41c0 msgr2=0x7f41440b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:19.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414997f700 1 -- 172.21.15.175:0/3323387707 shutdown_connections 2024-04-18T03:37:19.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.247+0000 7f414997f700 1 -- 172.21.15.175:0/3323387707 wait complete. 2024-04-18T03:37:19.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 Processor -- start 2024-04-18T03:37:19.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 -- start start 2024-04-18T03:37:19.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f4144146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f4144143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4144159800 0x7f414414d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144149930 con 0x7f4144159800 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144144530 con 0x7f41440af5c0 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414414cda0 con 0x7f41440ae8b0 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f4143fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f4144143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414897d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f4144146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414897d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f4144146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:50278/0 (socket says 172.21.15.175:50278) 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f4143fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f4144143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55648/0 (socket says 172.21.15.175:55648) 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414897d700 1 -- 172.21.15.175:0/3849724902 learned_addr learned my addr 172.21.15.175:0/3849724902 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414897d700 1 -- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 msgr2=0x7f4144146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414897d700 1 -- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 msgr2=0x7f4144146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414897d700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f4144146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414897d700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f4144146c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414917e700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4144159800 0x7f414414d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f4143fff700 1 -- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 msgr2=0x7f4144146c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f4143fff700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f4144146c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f4143fff700 1 -- 172.21.15.175:0/3849724902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4144159800 msgr2=0x7f414414d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f4143fff700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4144159800 0x7f414414d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f4143fff700 1 -- 172.21.15.175:0/3849724902 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c0094b0 con 0x7f41440af5c0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f4143fff700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f4144143ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f413800e810 tx=0x7f413800ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f41417fa700 1 -- 172.21.15.175:0/3849724902 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138004220 con 0x7f41440af5c0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f41417fa700 1 -- 172.21.15.175:0/3849724902 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138004380 con 0x7f41440af5c0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41441489d0 con 0x7f41440af5c0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f41417fa700 1 -- 172.21.15.175:0/3849724902 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380036c0 con 0x7f41440af5c0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4144148f90 con 0x7f41440af5c0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f41417fa700 1 -- 172.21.15.175:0/3849724902 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4138003b20 con 0x7f41440af5c0 2024-04-18T03:37:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f41417fa700 1 -- 172.21.15.175:0/3849724902 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4138013cd0 con 0x7f41440af5c0 2024-04-18T03:37:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.251+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414404e650 con 0x7f41440af5c0 2024-04-18T03:37:19.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.255+0000 7f41417fa700 1 -- 172.21.15.175:0/3849724902 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f4138020060 con 0x7f41440af5c0 2024-04-18T03:37:19.334 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:19.331+0000 7fae05dbc2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T03:37:19.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.339+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d5efcff2-47ac-4251-b7a7-0824d81eada7", "id": 6} v 0) v1 -- 0x7f414406c2f0 con 0x7f41440af5c0 2024-04-18T03:37:19.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f41417fa700 1 -- 172.21.15.175:0/3849724902 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5efcff2-47ac-4251-b7a7-0824d81eada7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4138017070 con 0x7f41440af5c0 2024-04-18T03:37:19.350 INFO:teuthology.orchestra.run.smithi175.stdout:6 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 msgr2=0x7f4144143ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f4144143ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f413800e810 tx=0x7f413800ebd0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 shutdown_connections 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41440af5c0 0x7f4144143ff0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4144159800 0x7f414414d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 --2- 172.21.15.175:0/3849724902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440ae8b0 0x7f4144146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 >> 172.21.15.175:0/3849724902 conn(0x7f41440b41c0 msgr2=0x7f41440709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 shutdown_connections 2024-04-18T03:37:19.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.347+0000 7f414997f700 1 -- 172.21.15.175:0/3849724902 wait complete. 2024-04-18T03:37:19.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 27fea2a0-4e98-4a08-b43c-de96cd113585 7 2024-04-18T03:37:19.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.475+0000 7f61daaad700 1 Processor -- start 2024-04-18T03:37:19.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.475+0000 7f61daaad700 1 -- start start 2024-04-18T03:37:19.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.475+0000 7f61daaad700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f61d4143c30 0x7f61d40b2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.475+0000 7f61daaad700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.475+0000 7f61daaad700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d406c450 con 0x7f61d4070850 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.475+0000 7f61daaad700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d40cfa90 con 0x7f61d4143c30 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.475+0000 7f61daaad700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d415eed0 con 0x7f61d406bff0 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d92aa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d9aab700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f61d4143c30 0x7f61d40b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d92aa700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:50294/0 (socket says 172.21.15.175:50294) 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d92aa700 1 -- 172.21.15.175:0/498476773 learned_addr learned my addr 172.21.15.175:0/498476773 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d92aa700 1 -- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 msgr2=0x7f61d415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d92aa700 1 -- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 msgr2=0x7f61d415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d92aa700 1 --2- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d92aa700 1 --2- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415f360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d9aab700 1 -- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 msgr2=0x7f61d415f360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d9aab700 1 --2- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415f360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d9aab700 1 -- 172.21.15.175:0/498476773 >> v1:172.21.15.157:6789/0 conn(0x7f61d4070850 legacy=0x7f61d40cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d9aab700 1 -- 172.21.15.175:0/498476773 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d415f8a0 con 0x7f61d4143c30 2024-04-18T03:37:19.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d9aab700 1 --2- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4143c30 0x7f61d40b2410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009850 tx=0x7f61d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab4e546c9a10c5a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:19.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d8aa9700 1 -- 172.21.15.175:0/498476773 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011830 con 0x7f61d4143c30 2024-04-18T03:37:19.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d8aa9700 1 -- 172.21.15.175:0/498476773 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0011990 con 0x7f61d4143c30 2024-04-18T03:37:19.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61d8aa9700 1 -- 172.21.15.175:0/498476773 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011d20 con 0x7f61d4143c30 2024-04-18T03:37:19.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61daaad700 1 -- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4143c30 msgr2=0x7f61d40b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61daaad700 1 --2- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4143c30 0x7f61d40b2410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009850 tx=0x7f61d0009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:19.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61daaad700 1 -- 172.21.15.175:0/498476773 shutdown_connections 2024-04-18T03:37:19.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61daaad700 1 --2- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61daaad700 1 --2- 172.21.15.175:0/498476773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4143c30 0x7f61d40b2410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61daaad700 1 -- 172.21.15.175:0/498476773 >> 172.21.15.175:0/498476773 conn(0x7f61d40b1920 msgr2=0x7f61d40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:19.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61daaad700 1 -- 172.21.15.175:0/498476773 shutdown_connections 2024-04-18T03:37:19.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.479+0000 7f61daaad700 1 -- 172.21.15.175:0/498476773 wait complete. 2024-04-18T03:37:19.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 Processor -- start 2024-04-18T03:37:19.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 -- start start 2024-04-18T03:37:19.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4070850 0x7f61d4135610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d4143c30 0x7f61d41ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4135060 con 0x7f61d4143c30 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d415d940 con 0x7f61d4070850 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d415ca90 con 0x7f61d406bff0 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d9aab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d92aa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4070850 0x7f61d4135610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d9aab700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:50300/0 (socket says 172.21.15.175:50300) 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d9aab700 1 -- 172.21.15.175:0/2295100734 learned_addr learned my addr 172.21.15.175:0/2295100734 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d9aab700 1 -- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 msgr2=0x7f61d415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d9aab700 1 -- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 msgr2=0x7f61d415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d9aab700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61da2ac700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d4143c30 0x7f61d41ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d9aab700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415c550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:19.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d92aa700 1 -- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 msgr2=0x7f61d415c550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d92aa700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415c550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d92aa700 1 -- 172.21.15.175:0/2295100734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d4143c30 msgr2=0x7f61d41ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d92aa700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d4143c30 0x7f61d41ef850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d92aa700 1 -- 172.21.15.175:0/2295100734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00094b0 con 0x7f61d4070850 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61d92aa700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4070850 0x7f61d4135610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f61c400e7e0 tx=0x7f61c400eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61ca7fc700 1 -- 172.21.15.175:0/2295100734 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c400c070 con 0x7f61d4070850 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61ca7fc700 1 -- 172.21.15.175:0/2295100734 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4004020 con 0x7f61d4070850 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d415cd30 con 0x7f61d4070850 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61ca7fc700 1 -- 172.21.15.175:0/2295100734 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40043d0 con 0x7f61d4070850 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d415d2f0 con 0x7f61d4070850 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61ca7fc700 1 -- 172.21.15.175:0/2295100734 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f61c40039c0 con 0x7f61d4070850 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61ca7fc700 1 -- 172.21.15.175:0/2295100734 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f61c4004530 con 0x7f61d4070850 2024-04-18T03:37:19.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.483+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d415eb50 con 0x7f61d4070850 2024-04-18T03:37:19.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.487+0000 7f61ca7fc700 1 -- 172.21.15.175:0/2295100734 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f61c4017030 con 0x7f61d4070850 2024-04-18T03:37:19.507 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:19.503+0000 7f3d4187d2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T03:37:19.509 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:19.507+0000 7fae05dbc2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T03:37:19.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.563+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "27fea2a0-4e98-4a08-b43c-de96cd113585", "id": 7} v 0) v1 -- 0x7f61d404e650 con 0x7f61d4070850 2024-04-18T03:37:19.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.567+0000 7f61ca7fc700 1 -- 172.21.15.175:0/2295100734 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27fea2a0-4e98-4a08-b43c-de96cd113585", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f61c400f040 con 0x7f61d4070850 2024-04-18T03:37:19.573 INFO:teuthology.orchestra.run.smithi175.stdout:7 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4070850 msgr2=0x7f61d4135610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4070850 0x7f61d4135610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f61c400e7e0 tx=0x7f61c400eaf0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 shutdown_connections 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61d4070850 0x7f61d4135610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61d4143c30 0x7f61d41ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 --2- 172.21.15.175:0/2295100734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61d406bff0 0x7f61d415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 >> 172.21.15.175:0/2295100734 conn(0x7f61d40b1920 msgr2=0x7f61d413e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 shutdown_connections 2024-04-18T03:37:19.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-18T03:37:19.571+0000 7f61daaad700 1 -- 172.21.15.175:0/2295100734 wait complete. 2024-04-18T03:37:19.586 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T03:37:19.586 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T03:37:19.588 INFO:tasks.ceph.osd.0:Started 2024-04-18T03:37:19.588 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T03:37:19.589 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T03:37:19.590 INFO:tasks.ceph.osd.1:Started 2024-04-18T03:37:19.591 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-18T03:37:19.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-18T03:37:19.592 INFO:tasks.ceph.osd.2:Started 2024-04-18T03:37:19.593 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-18T03:37:19.593 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-18T03:37:19.594 INFO:tasks.ceph.osd.3:Started 2024-04-18T03:37:19.595 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-18T03:37:19.595 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-18T03:37:19.597 INFO:tasks.ceph.osd.4:Started 2024-04-18T03:37:19.597 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-18T03:37:19.597 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-18T03:37:19.599 INFO:tasks.ceph.osd.5:Started 2024-04-18T03:37:19.599 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-18T03:37:19.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-18T03:37:19.601 INFO:tasks.ceph.osd.6:Started 2024-04-18T03:37:19.601 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-18T03:37:19.601 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-18T03:37:19.603 INFO:tasks.ceph.osd.7:Started 2024-04-18T03:37:19.603 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:19.629 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:19.627+0000 7f3d4187d2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T03:37:19.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 Processor -- start 2024-04-18T03:37:19.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- start start 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4d00b40e0 0x7fb4d0071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb4d0072010 0x7fb4d00af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d0070a30 con 0x7fb4d015cb20 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d00716b0 con 0x7fb4d0072010 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d0070d10 con 0x7fb4d00b40e0 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4cffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb4d0072010 0x7fb4d00af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4cffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb4d0072010 0x7fb4d00af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44090/0 (socket says 172.21.15.157:44090) 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4cffff700 1 -- 172.21.15.157:0/920202921 learned_addr learned my addr 172.21.15.157:0/920202921 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4ceffd700 1 --2- 172.21.15.157:0/920202921 >> v2:172.21.15.175:3300/0 conn(0x7fb4d00b40e0 0x7fb4d0071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4cffff700 1 -- 172.21.15.157:0/920202921 >> v2:172.21.15.175:3300/0 conn(0x7fb4d00b40e0 msgr2=0x7fb4d0071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4cffff700 1 --2- 172.21.15.157:0/920202921 >> v2:172.21.15.175:3300/0 conn(0x7fb4d00b40e0 0x7fb4d0071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4cffff700 1 -- 172.21.15.157:0/920202921 >> v1:172.21.15.175:6789/0 conn(0x7fb4d015cb20 legacy=0x7fb4d00cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4cffff700 1 -- 172.21.15.157:0/920202921 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d0070ff0 con 0x7fb4d0072010 2024-04-18T03:37:19.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4cffff700 1 --2- 172.21.15.157:0/920202921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d0072010 0x7fb4d00af4e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00b5140 tx=0x7fb4c800a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ca0b781a4870f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:19.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4ce7fc700 1 -- 172.21.15.157:0/920202921 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8003a40 con 0x7fb4d0072010 2024-04-18T03:37:19.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4ce7fc700 1 -- 172.21.15.157:0/920202921 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8003ba0 con 0x7fb4d0072010 2024-04-18T03:37:19.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4ce7fc700 1 -- 172.21.15.157:0/920202921 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800b920 con 0x7fb4d0072010 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- 172.21.15.157:0/920202921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d0072010 msgr2=0x7fb4d00af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 --2- 172.21.15.157:0/920202921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d0072010 0x7fb4d00af4e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00b5140 tx=0x7fb4c800a870 comp rx=0 tx=0).stop 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- 172.21.15.157:0/920202921 shutdown_connections 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 --2- 172.21.15.157:0/920202921 >> v2:172.21.15.175:3300/0 conn(0x7fb4d00b40e0 0x7fb4d0071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 --2- 172.21.15.157:0/920202921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d0072010 0x7fb4d00af4e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- 172.21.15.157:0/920202921 >> 172.21.15.157:0/920202921 conn(0x7fb4d0098a50 msgr2=0x7fb4d00b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- 172.21.15.157:0/920202921 shutdown_connections 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.715+0000 7fb4d4865700 1 -- 172.21.15.157:0/920202921 wait complete. 2024-04-18T03:37:19.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 Processor -- start 2024-04-18T03:37:19.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 -- start start 2024-04-18T03:37:19.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 0x7fb4d0156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4d00b40e0 0x7fb4d0158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d015cb20 0x7fb4d0145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:19.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d01e3a50 con 0x7fb4d015cb20 2024-04-18T03:37:19.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0156d10 con 0x7fb4d00b40e0 2024-04-18T03:37:19.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d01e3460 con 0x7fb4d0072010 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d015cb20 0x7fb4d0145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4ceffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4d00b40e0 0x7fb4d0158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d015cb20 0x7fb4d0145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44102/0 (socket says 172.21.15.157:44102) 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 -- 172.21.15.157:0/586125328 learned_addr learned my addr 172.21.15.157:0/586125328 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cf7fe700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 0x7fb4d0156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cf7fe700 1 -- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 msgr2=0x7fb4d0156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cf7fe700 1 -- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 msgr2=0x7fb4d0156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cf7fe700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 0x7fb4d0156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cf7fe700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 0x7fb4d0156070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 -- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 msgr2=0x7fb4d0156070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 0x7fb4d0156070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 -- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4d00b40e0 msgr2=0x7fb4d0158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4d00b40e0 0x7fb4d0158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 -- 172.21.15.157:0/586125328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c800ab50 con 0x7fb4d015cb20 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4cffff700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d015cb20 0x7fb4d0145d00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8015040 tx=0x7fb4c8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4b7fff700 1 -- 172.21.15.157:0/586125328 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800bd30 con 0x7fb4d015cb20 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4b7fff700 1 -- 172.21.15.157:0/586125328 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c800be90 con 0x7fb4d015cb20 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d0156750 con 0x7fb4d015cb20 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4b7fff700 1 -- 172.21.15.157:0/586125328 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8004270 con 0x7fb4d015cb20 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d01e3670 con 0x7fb4d015cb20 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4b7fff700 1 -- 172.21.15.157:0/586125328 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb4c8019030 con 0x7fb4d015cb20 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.719+0000 7fb4b7fff700 1 -- 172.21.15.157:0/586125328 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb4c8025450 con 0x7fb4d015cb20 2024-04-18T03:37:19.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.723+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d004e650 con 0x7fb4d015cb20 2024-04-18T03:37:19.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.727+0000 7fb4b7fff700 1 -- 172.21.15.157:0/586125328 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb4c802a060 con 0x7fb4d015cb20 2024-04-18T03:37:19.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.795+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4d00acb70 con 0x7fb4d015cb20 2024-04-18T03:37:19.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.795+0000 7fb4b7fff700 1 -- 172.21.15.157:0/586125328 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb4c8020070 con 0x7fb4d015cb20 2024-04-18T03:37:19.801 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:19.801 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":10,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:19.569434+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d015cb20 msgr2=0x7fb4d0145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d015cb20 0x7fb4d0145d00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8015040 tx=0x7fb4c8004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 shutdown_connections 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4d00b40e0 0x7fb4d0158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4d015cb20 0x7fb4d0145d00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 --2- 172.21.15.157:0/586125328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4d0072010 0x7fb4d0156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 >> 172.21.15.157:0/586125328 conn(0x7fb4d0098a50 msgr2=0x7fb4d00b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 shutdown_connections 2024-04-18T03:37:19.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:19.799+0000 7fb4d4865700 1 -- 172.21.15.157:0/586125328 wait complete. 2024-04-18T03:37:19.819 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-18T03:37:19.819 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-18T03:37:19.959 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-04-18T03:37:19.955+0000 7fb1cfa58880 -1 Falling back to public interface 2024-04-18T03:37:19.963 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-04-18T03:37:19.959+0000 7f60836e8880 -1 Falling back to public interface 2024-04-18T03:37:19.974 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-04-18T03:37:19.971+0000 7fd99e408880 -1 Falling back to public interface 2024-04-18T03:37:19.975 INFO:tasks.ceph.osd.0.smithi157.stderr:2024-04-18T03:37:19.971+0000 7fd91f08e880 -1 Falling back to public interface 2024-04-18T03:37:19.983 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-18T03:37:19.979+0000 7f8cdd225880 -1 Falling back to public interface 2024-04-18T03:37:20.009 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:20.003+0000 7f3d4187d2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T03:37:20.195 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:20.191+0000 7f3d4187d2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T03:37:20.211 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-18T03:37:20.207+0000 7f05d2346880 -1 Falling back to public interface 2024-04-18T03:37:20.211 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-18T03:37:20.207+0000 7f8130571880 -1 Falling back to public interface 2024-04-18T03:37:20.231 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-18T03:37:20.227+0000 7f5a577f4880 -1 Falling back to public interface 2024-04-18T03:37:20.263 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:20.259+0000 7f3d4187d2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T03:37:20.285 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:20.279+0000 7fae05dbc2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T03:37:20.354 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:20.351+0000 7fae05dbc2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T03:37:20.421 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:20.415+0000 7f3d4187d2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T03:37:20.507 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:20.503+0000 7fae05dbc2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T03:37:20.568 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:20.563+0000 7fae05dbc2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T03:37:20.624 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:20.636 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:20.631+0000 7fae05dbc2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T03:37:20.722 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 Processor -- start 2024-04-18T03:37:20.722 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 -- start start 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f96ac1446a0 0x7f96ac06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac06b270 0x7f96ac06b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac06bbc0 con 0x7f96ac06d0d0 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ac06a2a0 con 0x7f96ac1446a0 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac06a4b0 con 0x7f96ac06b270 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aa59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f96ac1446a0 0x7f96ac06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aa59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f96ac1446a0 0x7f96ac06dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44110/0 (socket says 172.21.15.157:44110) 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aa59c700 1 -- 172.21.15.157:0/1525186118 learned_addr learned my addr 172.21.15.157:0/1525186118 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96a9d9b700 1 --1- 172.21.15.157:0/1525186118 >> v1:172.21.15.157:6789/0 conn(0x7f96ac06d0d0 0x7f96ac15b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51738/0 (socket says 172.21.15.157:51738) 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aad9d700 1 --2- 172.21.15.157:0/1525186118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac06b270 0x7f96ac06b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aa59c700 1 -- 172.21.15.157:0/1525186118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac06b270 msgr2=0x7f96ac06b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aa59c700 1 --2- 172.21.15.157:0/1525186118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac06b270 0x7f96ac06b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.724 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aa59c700 1 -- 172.21.15.157:0/1525186118 >> v1:172.21.15.157:6789/0 conn(0x7f96ac06d0d0 legacy=0x7f96ac15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:20.725 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aa59c700 1 -- 172.21.15.157:0/1525186118 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac06a790 con 0x7f96ac1446a0 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96aa59c700 1 --2- 172.21.15.157:0/1525186118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac1446a0 0x7f96ac06dee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f969c009e50 tx=0x7f969c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34fb4b79e87ef41 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96a959a700 1 -- 172.21.15.157:0/1525186118 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c00e070 con 0x7f96ac1446a0 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96a959a700 1 -- 172.21.15.157:0/1525186118 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c00b9c0 con 0x7f96ac1446a0 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96a959a700 1 -- 172.21.15.157:0/1525186118 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c00bd70 con 0x7f96ac1446a0 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 -- 172.21.15.157:0/1525186118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac1446a0 msgr2=0x7f96ac06dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 --2- 172.21.15.157:0/1525186118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac1446a0 0x7f96ac06dee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f969c009e50 tx=0x7f969c00b330 comp rx=0 tx=0).stop 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.719+0000 7f96ab59e700 1 -- 172.21.15.157:0/1525186118 shutdown_connections 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 --2- 172.21.15.157:0/1525186118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac06b270 0x7f96ac06b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 --2- 172.21.15.157:0/1525186118 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac1446a0 0x7f96ac06dee0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.726 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 -- 172.21.15.157:0/1525186118 >> 172.21.15.157:0/1525186118 conn(0x7f96ac0b0e20 msgr2=0x7f96ac0cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:20.727 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 -- 172.21.15.157:0/1525186118 shutdown_connections 2024-04-18T03:37:20.727 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 -- 172.21.15.157:0/1525186118 wait complete. 2024-04-18T03:37:20.727 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 Processor -- start 2024-04-18T03:37:20.727 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 -- start start 2024-04-18T03:37:20.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac06b270 0x7f96ac0ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:20.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac06d0d0 0x7f96ac131c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:20.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac1446a0 0x7f96ac13e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0aec80 con 0x7f96ac06b270 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0aef60 con 0x7f96ac06d0d0 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96ab59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0af240 con 0x7f96ac1446a0 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac06b270 0x7f96ac0ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac06b270 0x7f96ac0ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:44114/0 (socket says 172.21.15.157:44114) 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 -- 172.21.15.157:0/3934117030 learned_addr learned my addr 172.21.15.157:0/3934117030 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96a9d9b700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac06d0d0 0x7f96ac131c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aad9d700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac1446a0 0x7f96ac13e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 -- 172.21.15.157:0/3934117030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac1446a0 msgr2=0x7f96ac13e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac1446a0 0x7f96ac13e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 -- 172.21.15.157:0/3934117030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac06d0d0 msgr2=0x7f96ac131c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac06d0d0 0x7f96ac131c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 -- 172.21.15.157:0/3934117030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c009b30 con 0x7f96ac06b270 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f96aa59c700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac06b270 0x7f96ac0ae580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f969c00b370 tx=0x7f969c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f969affd700 1 -- 172.21.15.157:0/3934117030 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0048b0 con 0x7f96ac06b270 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.723+0000 7f969affd700 1 -- 172.21.15.157:0/3934117030 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0092e0 con 0x7f96ac06b270 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.727+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ac0af520 con 0x7f96ac06b270 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.727+0000 7f969affd700 1 -- 172.21.15.157:0/3934117030 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c01b670 con 0x7f96ac06b270 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.727+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ac1321d0 con 0x7f96ac06b270 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.727+0000 7f969affd700 1 -- 172.21.15.157:0/3934117030 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f969c01bad0 con 0x7f96ac06b270 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.727+0000 7f969affd700 1 -- 172.21.15.157:0/3934117030 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f969c0123f0 con 0x7f96ac06b270 2024-04-18T03:37:20.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.727+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ac0742c0 con 0x7f96ac06b270 2024-04-18T03:37:20.734 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.731+0000 7f969affd700 1 -- 172.21.15.157:0/3934117030 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f969c043dc0 con 0x7f96ac06b270 2024-04-18T03:37:20.795 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96ac0cc0c0 con 0x7f96ac06b270 2024-04-18T03:37:20.796 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f969affd700 1 -- 172.21.15.157:0/3934117030 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f969c032070 con 0x7f96ac06b270 2024-04-18T03:37:20.796 INFO:teuthology.misc.health.smithi157.stdout: 2024-04-18T03:37:20.796 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":10,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:19.569434+0000","last_up_change":"0.000000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:20.797 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac06b270 msgr2=0x7f96ac0ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:20.797 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac06b270 0x7f96ac0ae580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f969c00b370 tx=0x7f969c004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.797 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 shutdown_connections 2024-04-18T03:37:20.798 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac06d0d0 0x7f96ac131c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.798 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ac1446a0 0x7f96ac13e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.798 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 --2- 172.21.15.157:0/3934117030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96ac06b270 0x7f96ac0ae580 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:20.798 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 >> 172.21.15.157:0/3934117030 conn(0x7f96ac0b0e20 msgr2=0x7f96ac06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:20.798 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.791+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 shutdown_connections 2024-04-18T03:37:20.798 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:20.795+0000 7f96ab59e700 1 -- 172.21.15.157:0/3934117030 wait complete. 2024-04-18T03:37:20.807 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-18T03:37:20.955 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:20.951+0000 7fae05dbc2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T03:37:21.031 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:21.027+0000 7fae05dbc2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T03:37:21.132 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:21.127+0000 7f3d4187d2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-18T03:37:21.203 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:21.199+0000 7f3d4187d2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T03:37:21.367 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:21.363+0000 7f3d4187d2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T03:37:21.433 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:21.427+0000 7f3d4187d2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T03:37:21.508 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:21.503+0000 7f3d4187d2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T03:37:21.726 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:21.723+0000 7fae05dbc2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T03:37:21.837 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:21.831+0000 7f3d4187d2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T03:37:21.908 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:21.903+0000 7f3d4187d2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T03:37:22.621 INFO:tasks.ceph.mgr.y.smithi157.stderr:2024-04-18T03:37:22.615+0000 7f3d4187d2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T03:37:22.779 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:22.775+0000 7fadec930700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-18T03:37:22.779 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-18T03:37:22.775+0000 7fadec930700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-18T03:37:23.314 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-04-18T03:37:23.311+0000 7fb1cfa58880 -1 osd.2 0 log_to_monitors true 2024-04-18T03:37:23.349 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-04-18T03:37:23.347+0000 7fd99e408880 -1 osd.3 0 log_to_monitors true 2024-04-18T03:37:23.518 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-18T03:37:23.515+0000 7f8130571880 -1 osd.7 0 log_to_monitors true 2024-04-18T03:37:23.583 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-18T03:37:23.579+0000 7f5a577f4880 -1 osd.5 0 log_to_monitors true 2024-04-18T03:37:23.816 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-18T03:37:23.811+0000 7f8cdd225880 -1 osd.4 0 log_to_monitors true 2024-04-18T03:37:23.865 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-04-18T03:37:23.863+0000 7f60836e8880 -1 osd.1 0 log_to_monitors true 2024-04-18T03:37:23.868 INFO:tasks.ceph.osd.0.smithi157.stderr:2024-04-18T03:37:23.863+0000 7fd91f08e880 -1 osd.0 0 log_to_monitors true 2024-04-18T03:37:24.022 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-18T03:37:24.019+0000 7f05d2346880 -1 osd.6 0 log_to_monitors true 2024-04-18T03:37:25.755 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-04-18T03:37:25.751+0000 7fb1cb897700 -1 osd.2 0 waiting for initial osdmap 2024-04-18T03:37:25.762 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-04-18T03:37:25.759+0000 7fb1c3346700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T03:37:25.778 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-04-18T03:37:25.775+0000 7fd99a247700 -1 osd.3 0 waiting for initial osdmap 2024-04-18T03:37:25.784 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-04-18T03:37:25.779+0000 7fd991cf6700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T03:37:26.324 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-18T03:37:26.319+0000 7f812cd37700 -1 osd.7 0 waiting for initial osdmap 2024-04-18T03:37:26.342 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-18T03:37:26.339+0000 7f8123e5f700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T03:37:26.411 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-18T03:37:26.407+0000 7f5a53633700 -1 osd.5 0 waiting for initial osdmap 2024-04-18T03:37:26.427 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-18T03:37:26.423+0000 7f5a4b0e2700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T03:37:26.728 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-04-18T03:37:26.723+0000 7f607f527700 -1 osd.1 0 waiting for initial osdmap 2024-04-18T03:37:26.732 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-04-18T03:37:26.727+0000 7f6076fd6700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T03:37:26.761 INFO:tasks.ceph.osd.0.smithi157.stderr:2024-04-18T03:37:26.759+0000 7fd91aecd700 -1 osd.0 0 waiting for initial osdmap 2024-04-18T03:37:26.767 INFO:tasks.ceph.osd.0.smithi157.stderr:2024-04-18T03:37:26.763+0000 7fd91297c700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T03:37:27.214 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-18T03:37:27.211+0000 7f8cd99eb700 -1 osd.4 0 waiting for initial osdmap 2024-04-18T03:37:27.223 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-18T03:37:27.219+0000 7f8cd0b13700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T03:37:27.246 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-18T03:37:27.243+0000 7f05ce185700 -1 osd.6 0 waiting for initial osdmap 2024-04-18T03:37:27.253 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-18T03:37:27.251+0000 7f05c5c34700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T03:37:27.614 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:27.725 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.719+0000 7eff8127e700 1 Processor -- start 2024-04-18T03:37:27.725 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.719+0000 7eff8127e700 1 -- start start 2024-04-18T03:37:27.727 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff8127e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c15e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:27.727 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff8127e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7c15e790 con 0x7eff7c0cbb90 2024-04-18T03:37:27.727 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff8127e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7c06bbc0 con 0x7eff7c0b4030 2024-04-18T03:37:27.728 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff8127e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c06c1b0 con 0x7eff7c06b7e0 2024-04-18T03:37:27.728 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7b7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7eff7c0cbb90 0x7eff7c0b3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47648/0 (socket says 172.21.15.157:47648) 2024-04-18T03:37:27.728 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7b7fe700 1 -- 172.21.15.157:0/3292804739 learned_addr learned my addr 172.21.15.157:0/3292804739 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:27.728 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7bfff700 1 --2- 172.21.15.157:0/3292804739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:27.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7bfff700 1 -- 172.21.15.157:0/3292804739 >> v1:172.21.15.175:6789/0 conn(0x7eff7c0b4030 legacy=0x7eff7c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:27.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7affd700 1 -- 172.21.15.157:0/3292804739 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820200802 0 0) 0x7eff7c15e790 con 0x7eff7c0cbb90 2024-04-18T03:37:27.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7bfff700 1 -- 172.21.15.157:0/3292804739 >> v1:172.21.15.157:6789/0 conn(0x7eff7c0cbb90 legacy=0x7eff7c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:27.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7bfff700 1 -- 172.21.15.157:0/3292804739 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c15a360 con 0x7eff7c06b7e0 2024-04-18T03:37:27.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7bfff700 1 --2- 172.21.15.157:0/3292804739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c15e250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009880 tx=0x7eff6c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6dd9d3ca3882157 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:27.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7affd700 1 -- 172.21.15.157:0/3292804739 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c011830 con 0x7eff7c06b7e0 2024-04-18T03:37:27.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7affd700 1 -- 172.21.15.157:0/3292804739 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c011990 con 0x7eff7c06b7e0 2024-04-18T03:37:27.729 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.723+0000 7eff7affd700 1 -- 172.21.15.157:0/3292804739 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c011d20 con 0x7eff7c06b7e0 2024-04-18T03:37:27.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 -- 172.21.15.157:0/3292804739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 msgr2=0x7eff7c15e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:27.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 --2- 172.21.15.157:0/3292804739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c15e250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009880 tx=0x7eff6c009b90 comp rx=0 tx=0).stop 2024-04-18T03:37:27.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 -- 172.21.15.157:0/3292804739 shutdown_connections 2024-04-18T03:37:27.730 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 --2- 172.21.15.157:0/3292804739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c15e250 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:27.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 -- 172.21.15.157:0/3292804739 >> 172.21.15.157:0/3292804739 conn(0x7eff7c06d550 msgr2=0x7eff7c06d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:27.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 -- 172.21.15.157:0/3292804739 shutdown_connections 2024-04-18T03:37:27.731 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 -- 172.21.15.157:0/3292804739 wait complete. 2024-04-18T03:37:27.732 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 Processor -- start 2024-04-18T03:37:27.733 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.727+0000 7eff8127e700 1 -- start start 2024-04-18T03:37:27.735 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff8127e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:27.735 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff8127e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff7c0b4030 0x7eff7c0ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff8127e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c0cbb90 0x7eff7c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff8127e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c0ad040 con 0x7eff7c0b4030 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff8127e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c14d160 con 0x7eff7c0cbb90 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff8127e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c0afa40 con 0x7eff7c06b7e0 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff7c0b4030 0x7eff7c0ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff7c0b4030 0x7eff7c0ab8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41042/0 (socket says 172.21.15.157:41042) 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 -- 172.21.15.157:0/2536981500 learned_addr learned my addr 172.21.15.157:0/2536981500 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7bfff700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff80a7d700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c0cbb90 0x7eff7c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 -- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 msgr2=0x7eff7c14cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c14cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 -- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c0cbb90 msgr2=0x7eff7c0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c0cbb90 0x7eff7c0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:27.736 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 -- 172.21.15.157:0/2536981500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0094b0 con 0x7eff7c0b4030 2024-04-18T03:37:27.737 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7bfff700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:27.737 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff7b7fe700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff7c0b4030 0x7eff7c0ab8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c4d0 tx=0x7eff7000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:27.737 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff78ff9700 1 -- 172.21.15.157:0/2536981500 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7000cea0 con 0x7eff7c0b4030 2024-04-18T03:37:27.737 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff78ff9700 1 -- 172.21.15.157:0/2536981500 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff70004ca0 con 0x7eff7c0b4030 2024-04-18T03:37:27.737 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7c0ac430 con 0x7eff7c0b4030 2024-04-18T03:37:27.737 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff78ff9700 1 -- 172.21.15.157:0/2536981500 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70007310 con 0x7eff7c0b4030 2024-04-18T03:37:27.737 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.731+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7c0ac9f0 con 0x7eff7c0b4030 2024-04-18T03:37:27.738 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.735+0000 7eff78ff9700 1 -- 172.21.15.157:0/2536981500 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7eff70007470 con 0x7eff7c0b4030 2024-04-18T03:37:27.738 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.735+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7c0ad1f0 con 0x7eff7c0b4030 2024-04-18T03:37:27.738 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.735+0000 7eff78ff9700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7eff680666a0 0x7eff68068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:27.738 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.735+0000 7eff78ff9700 1 -- 172.21.15.157:0/2536981500 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3911+0+0 (secure 0 0 0) 0x7eff700834b0 con 0x7eff7c0b4030 2024-04-18T03:37:27.738 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.735+0000 7eff7bfff700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7eff680666a0 0x7eff68068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:27.739 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.735+0000 7eff7bfff700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7eff680666a0 0x7eff68068b60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0090b0 tx=0x7eff6c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:27.747 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.743+0000 7eff78ff9700 1 -- 172.21.15.157:0/2536981500 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7eff7c0ad1f0 con 0x7eff7c0b4030 2024-04-18T03:37:27.922 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.919+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff7c0ad1f0 con 0x7eff7c0b4030 2024-04-18T03:37:27.924 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.919+0000 7eff78ff9700 1 -- 172.21.15.157:0/2536981500 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12388 (secure 0 0 0) 0x7eff7c0ad1f0 con 0x7eff7c0b4030 2024-04-18T03:37:27.924 INFO:teuthology.misc.health.smithi157.stdout: 2024-04-18T03:37:27.924 INFO:teuthology.misc.health.smithi157.stdout:{"epoch":15,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:27.828246+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:27.927 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7eff680666a0 msgr2=0x7eff68068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:27.927 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7eff680666a0 0x7eff68068b60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0090b0 tx=0x7eff6c008030 comp rx=0 tx=0).stop 2024-04-18T03:37:27.927 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff7c0b4030 msgr2=0x7eff7c0ab8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff7c0b4030 0x7eff7c0ab8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c4d0 tx=0x7eff7000c7e0 comp rx=0 tx=0).stop 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 shutdown_connections 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7eff680666a0 0x7eff68068b60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff7c0cbb90 0x7eff7c0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff7c0b4030 0x7eff7c0ab8c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 --2- 172.21.15.157:0/2536981500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff7c06b7e0 0x7eff7c14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 >> 172.21.15.157:0/2536981500 conn(0x7eff7c06d550 msgr2=0x7eff7c15bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 shutdown_connections 2024-04-18T03:37:27.928 INFO:teuthology.misc.health.smithi157.stderr:2024-04-18T03:37:27.923+0000 7eff8127e700 1 -- 172.21.15.157:0/2536981500 wait complete. 2024-04-18T03:37:27.938 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-18T03:37:27.938 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-18T03:37:27.938 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-18T03:37:27.938 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-18T03:37:27.940 INFO:tasks.ceph.mds.a:Started 2024-04-18T03:37:27.940 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-18T03:37:27.940 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-18T03:37:27.942 INFO:tasks.ceph.mds.c:Started 2024-04-18T03:37:27.942 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-18T03:37:27.942 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-18T03:37:27.945 INFO:tasks.ceph.mds.b:Started 2024-04-18T03:37:27.945 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-18T03:37:27.945 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-18T03:37:27.947 INFO:tasks.ceph.mds.d:Started 2024-04-18T03:37:27.948 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-18T03:37:27.950 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:28.014 INFO:tasks.ceph.mds.a.smithi157.stdout:starting mds.a at 2024-04-18T03:37:28.031 INFO:tasks.ceph.mds.c.smithi157.stdout:starting mds.c at 2024-04-18T03:37:28.038 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-04-18T03:37:28.043 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-04-18T03:37:28.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72d6206700 1 Processor -- start 2024-04-18T03:37:28.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72d6206700 1 -- start start 2024-04-18T03:37:28.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72d6206700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d0157780 0x7f72d015e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72d6206700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72d0161950 0x7f72d0071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72d6206700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d0157b60 con 0x7f72d00715c0 2024-04-18T03:37:28.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72d6206700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d0161530 con 0x7f72d0161950 2024-04-18T03:37:28.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72d6206700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d0071a70 con 0x7f72d0157780 2024-04-18T03:37:28.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72cffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f72d00715c0 0x7f72d00b1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47664/0 (socket says 172.21.15.157:47664) 2024-04-18T03:37:28.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72cffff700 1 -- 172.21.15.157:0/1123649613 learned_addr learned my addr 172.21.15.157:0/1123649613 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ceffd700 1 --2- 172.21.15.157:0/1123649613 >> v2:172.21.15.175:3300/0 conn(0x7f72d0161950 0x7f72d0071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72cf7fe700 1 --2- 172.21.15.157:0/1123649613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d0157780 0x7f72d015e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ce7fc700 1 -- 172.21.15.157:0/1123649613 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951463600 0 0) 0x7f72d0157b60 con 0x7f72d00715c0 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ce7fc700 1 -- 172.21.15.157:0/1123649613 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b80035d0 con 0x7f72d00715c0 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ceffd700 1 -- 172.21.15.157:0/1123649613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d0157780 msgr2=0x7f72d015e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ceffd700 1 --2- 172.21.15.157:0/1123649613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d0157780 0x7f72d015e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ce7fc700 1 -- 172.21.15.157:0/1123649613 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2510537687 0 0) 0x7f72b80035d0 con 0x7f72d00715c0 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ceffd700 1 -- 172.21.15.157:0/1123649613 >> v1:172.21.15.157:6789/0 conn(0x7f72d00715c0 legacy=0x7f72d00b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ceffd700 1 -- 172.21.15.157:0/1123649613 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d00ae3a0 con 0x7f72d0161950 2024-04-18T03:37:28.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ceffd700 1 --2- 172.21.15.157:0/1123649613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 0x7f72d0071080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009850 tx=0x7f72c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a2042ef0f960fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.059+0000 7f72ce7fc700 1 -- 172.21.15.157:0/1123649613 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c80019f0 con 0x7f72d0161950 2024-04-18T03:37:28.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ce7fc700 1 -- 172.21.15.157:0/1123649613 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4004030 con 0x7f72d0161950 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ce7fc700 1 -- 172.21.15.157:0/1123649613 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40043e0 con 0x7f72d0161950 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- 172.21.15.157:0/1123649613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 msgr2=0x7f72d0071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 --2- 172.21.15.157:0/1123649613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 0x7f72d0071080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009850 tx=0x7f72c4009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- 172.21.15.157:0/1123649613 shutdown_connections 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 --2- 172.21.15.157:0/1123649613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 0x7f72d0071080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 --2- 172.21.15.157:0/1123649613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d0157780 0x7f72d015e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- 172.21.15.157:0/1123649613 >> 172.21.15.157:0/1123649613 conn(0x7f72d006e190 msgr2=0x7f72d006e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- 172.21.15.157:0/1123649613 shutdown_connections 2024-04-18T03:37:28.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- 172.21.15.157:0/1123649613 wait complete. 2024-04-18T03:37:28.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 Processor -- start 2024-04-18T03:37:28.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- start start 2024-04-18T03:37:28.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d00715c0 0x7f72d00ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d0157780 0x7f72d00afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 0x7f72d013b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d00aee30 con 0x7f72d0157780 2024-04-18T03:37:28.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d00af110 con 0x7f72d0161950 2024-04-18T03:37:28.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72d6206700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d00af3f0 con 0x7f72d00715c0 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d0157780 0x7f72d00afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72cf7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d00715c0 0x7f72d00ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d0157780 0x7f72d00afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41092/0 (socket says 172.21.15.157:41092) 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 -- 172.21.15.157:0/615715538 learned_addr learned my addr 172.21.15.157:0/615715538 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72cffff700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 0x7f72d013b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 -- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d00715c0 msgr2=0x7f72d00ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d00715c0 0x7f72d00ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 -- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 msgr2=0x7f72d013b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 0x7f72d013b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 -- 172.21.15.157:0/615715538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40094b0 con 0x7f72d0157780 2024-04-18T03:37:28.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.063+0000 7f72ceffd700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d0157780 0x7f72d00afed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72c4000c00 tx=0x7f72c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.067+0000 7f72b7fff700 1 -- 172.21.15.157:0/615715538 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4003b00 con 0x7f72d0157780 2024-04-18T03:37:28.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.067+0000 7f72b7fff700 1 -- 172.21.15.157:0/615715538 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c401f070 con 0x7f72d0157780 2024-04-18T03:37:28.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.067+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d00af6d0 con 0x7f72d0157780 2024-04-18T03:37:28.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.067+0000 7f72b7fff700 1 -- 172.21.15.157:0/615715538 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4011630 con 0x7f72d0157780 2024-04-18T03:37:28.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.067+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d013b880 con 0x7f72d0157780 2024-04-18T03:37:28.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.067+0000 7f72b7fff700 1 -- 172.21.15.157:0/615715538 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f72c4021030 con 0x7f72d0157780 2024-04-18T03:37:28.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.067+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d004e6c0 con 0x7f72d0157780 2024-04-18T03:37:28.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.067+0000 7f72b7fff700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f72bc0666a0 0x7f72bc068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.071+0000 7f72cf7fe700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f72bc0666a0 0x7f72bc068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.071+0000 7f72b7fff700 1 -- 172.21.15.157:0/615715538 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f72c4084eb0 con 0x7f72d0157780 2024-04-18T03:37:28.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.071+0000 7f72cf7fe700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f72bc0666a0 0x7f72bc068b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009bf0 tx=0x7f72c0009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.079+0000 7f72b7fff700 1 -- 172.21.15.157:0/615715538 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f72c4052660 con 0x7f72d0157780 2024-04-18T03:37:28.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.247+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72d00ae3a0 con 0x7f72d0157780 2024-04-18T03:37:28.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.247+0000 7f72b7fff700 1 -- 172.21.15.157:0/615715538 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12388 (secure 0 0 0) 0x7f72d00ae3a0 con 0x7f72d0157780 2024-04-18T03:37:28.253 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:28.253 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":15,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:27.828246+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:28.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f72bc0666a0 msgr2=0x7f72bc068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f72bc0666a0 0x7f72bc068b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009bf0 tx=0x7f72c0009240 comp rx=0 tx=0).stop 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d0157780 msgr2=0x7f72d00afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d0157780 0x7f72d00afed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72c4000c00 tx=0x7f72c4004770 comp rx=0 tx=0).stop 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 shutdown_connections 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f72bc0666a0 0x7f72bc068b60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d0161950 0x7f72d013b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f72d0157780 0x7f72d00afed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 --2- 172.21.15.157:0/615715538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72d00715c0 0x7f72d00ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 >> 172.21.15.157:0/615715538 conn(0x7f72d006e190 msgr2=0x7f72d015be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 shutdown_connections 2024-04-18T03:37:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.251+0000 7f72d6206700 1 -- 172.21.15.157:0/615715538 wait complete. 2024-04-18T03:37:28.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T03:37:28.268 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:37:28.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.379+0000 7faa534bb700 1 Processor -- start 2024-04-18T03:37:28.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.379+0000 7faa534bb700 1 -- start start 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faa4c15cc20 0x7faa4c070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 0x7faa4c070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faa4c071380 0x7faa4c070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0b0a10 con 0x7faa4c15cc20 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0afd30 con 0x7faa4c071380 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0b5140 con 0x7faa4c071e90 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faa4c15cc20 0x7faa4c070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faa4c15cc20 0x7faa4c070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41096/0 (socket says 172.21.15.157:41096) 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 -- 172.21.15.157:0/407268328 learned_addr learned my addr 172.21.15.157:0/407268328 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa52cba700 1 --2- 172.21.15.157:0/407268328 >> v2:172.21.15.175:3300/0 conn(0x7faa4c071380 0x7faa4c070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa51cb8700 1 --2- 172.21.15.157:0/407268328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 0x7faa4c070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 -- 172.21.15.157:0/407268328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 msgr2=0x7faa4c070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 --2- 172.21.15.157:0/407268328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 0x7faa4c070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 -- 172.21.15.157:0/407268328 >> v2:172.21.15.175:3300/0 conn(0x7faa4c071380 msgr2=0x7faa4c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:28.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 --2- 172.21.15.157:0/407268328 >> v2:172.21.15.175:3300/0 conn(0x7faa4c071380 0x7faa4c070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 -- 172.21.15.157:0/407268328 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0b41f0 con 0x7faa4c15cc20 2024-04-18T03:37:28.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa524b9700 1 --2- 172.21.15.157:0/407268328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c15cc20 0x7faa4c070900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0aed00 tx=0x7faa3c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97598d8a93533053 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa514b7700 1 -- 172.21.15.157:0/407268328 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c011830 con 0x7faa4c15cc20 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa514b7700 1 -- 172.21.15.157:0/407268328 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c011990 con 0x7faa4c15cc20 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa514b7700 1 -- 172.21.15.157:0/407268328 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c011d20 con 0x7faa4c15cc20 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 -- 172.21.15.157:0/407268328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c15cc20 msgr2=0x7faa4c070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 --2- 172.21.15.157:0/407268328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c15cc20 0x7faa4c070900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0aed00 tx=0x7faa3c009bf0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 -- 172.21.15.157:0/407268328 shutdown_connections 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 --2- 172.21.15.157:0/407268328 >> v2:172.21.15.175:3300/0 conn(0x7faa4c071380 0x7faa4c070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 --2- 172.21.15.157:0/407268328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 0x7faa4c070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 --2- 172.21.15.157:0/407268328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c15cc20 0x7faa4c070900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 -- 172.21.15.157:0/407268328 >> 172.21.15.157:0/407268328 conn(0x7faa4c098a50 msgr2=0x7faa4c0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:28.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 -- 172.21.15.157:0/407268328 shutdown_connections 2024-04-18T03:37:28.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.383+0000 7faa534bb700 1 -- 172.21.15.157:0/407268328 wait complete. 2024-04-18T03:37:28.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa534bb700 1 Processor -- start 2024-04-18T03:37:28.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa534bb700 1 -- start start 2024-04-18T03:37:28.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa534bb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c071380 0x7faa4c09b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa534bb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 0x7faa4c0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa534bb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c15cc20 0x7faa4c14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa534bb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0c8c20 con 0x7faa4c071380 2024-04-18T03:37:28.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa534bb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c09c790 con 0x7faa4c15cc20 2024-04-18T03:37:28.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa534bb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c09b6f0 con 0x7faa4c071e90 2024-04-18T03:37:28.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa524b9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c071380 0x7faa4c09b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa524b9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c071380 0x7faa4c09b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41100/0 (socket says 172.21.15.157:41100) 2024-04-18T03:37:28.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa52cba700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c15cc20 0x7faa4c14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa51cb8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 0x7faa4c0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa524b9700 1 -- 172.21.15.157:0/1712467420 learned_addr learned my addr 172.21.15.157:0/1712467420 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:28.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa524b9700 1 -- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 msgr2=0x7faa4c0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa524b9700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 0x7faa4c0c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa524b9700 1 -- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c15cc20 msgr2=0x7faa4c14ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa524b9700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c15cc20 0x7faa4c14ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.387+0000 7faa524b9700 1 -- 172.21.15.157:0/1712467420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009570 con 0x7faa4c071380 2024-04-18T03:37:28.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.391+0000 7faa524b9700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c071380 0x7faa4c09b110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa3c014040 tx=0x7faa3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.391+0000 7faa42ffd700 1 -- 172.21.15.157:0/1712467420 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004450 con 0x7faa4c071380 2024-04-18T03:37:28.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.391+0000 7faa42ffd700 1 -- 172.21.15.157:0/1712467420 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c01e070 con 0x7faa4c071380 2024-04-18T03:37:28.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.391+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c09b9d0 con 0x7faa4c071380 2024-04-18T03:37:28.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.391+0000 7faa42ffd700 1 -- 172.21.15.157:0/1712467420 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c003900 con 0x7faa4c071380 2024-04-18T03:37:28.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.391+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c09bf90 con 0x7faa4c071380 2024-04-18T03:37:28.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.391+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c0af480 con 0x7faa4c071380 2024-04-18T03:37:28.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.391+0000 7faa42ffd700 1 -- 172.21.15.157:0/1712467420 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7faa3c003a60 con 0x7faa4c071380 2024-04-18T03:37:28.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.395+0000 7faa42ffd700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faa300666a0 0x7faa30068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.395+0000 7faa42ffd700 1 -- 172.21.15.157:0/1712467420 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7faa3c084a90 con 0x7faa4c071380 2024-04-18T03:37:28.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.395+0000 7faa51cb8700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faa300666a0 0x7faa30068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.395+0000 7faa51cb8700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faa300666a0 0x7faa30068b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0cefc0 tx=0x7faa48009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.403+0000 7faa42ffd700 1 -- 172.21.15.157:0/1712467420 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7faa3c0522d0 con 0x7faa4c071380 2024-04-18T03:37:28.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.563+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa4c0af6b0 con 0x7faa4c071380 2024-04-18T03:37:28.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.567+0000 7faa42ffd700 1 -- 172.21.15.157:0/1712467420 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa3c020020 con 0x7faa4c071380 2024-04-18T03:37:28.570 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:37:28.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.567+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faa300666a0 msgr2=0x7faa30068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.567+0000 7faa534bb700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faa300666a0 0x7faa30068b60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0cefc0 tx=0x7faa48009240 comp rx=0 tx=0).stop 2024-04-18T03:37:28.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.567+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c071380 msgr2=0x7faa4c09b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.567+0000 7faa534bb700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c071380 0x7faa4c09b110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa3c014040 tx=0x7faa3c004770 comp rx=0 tx=0).stop 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.571+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 shutdown_connections 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.571+0000 7faa534bb700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faa300666a0 0x7faa30068b60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.571+0000 7faa534bb700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4c15cc20 0x7faa4c14ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.571+0000 7faa534bb700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa4c071e90 0x7faa4c0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.571+0000 7faa534bb700 1 --2- 172.21.15.157:0/1712467420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa4c071380 0x7faa4c09b110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.571+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 >> 172.21.15.157:0/1712467420 conn(0x7faa4c098a50 msgr2=0x7faa4c158720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.571+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 shutdown_connections 2024-04-18T03:37:28.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.571+0000 7faa534bb700 1 -- 172.21.15.157:0/1712467420 wait complete. 2024-04-18T03:37:28.585 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:37:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.691+0000 7f22632c6700 1 Processor -- start 2024-04-18T03:37:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.691+0000 7f22632c6700 1 -- start start 2024-04-18T03:37:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f225c145d20 0x7f225c06b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c06b750 0x7f225c071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c146100 con 0x7f225c0715c0 2024-04-18T03:37:28.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c071a70 con 0x7f225c145d20 2024-04-18T03:37:28.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c1617d0 con 0x7f225c06b750 2024-04-18T03:37:28.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22622c4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f225c145d20 0x7f225c06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22622c4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f225c145d20 0x7f225c06b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41108/0 (socket says 172.21.15.157:41108) 2024-04-18T03:37:28.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22622c4700 1 -- 172.21.15.157:0/107443009 learned_addr learned my addr 172.21.15.157:0/107443009 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:28.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f2261ac3700 1 --2- 172.21.15.157:0/107443009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c06b750 0x7f225c071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22622c4700 1 -- 172.21.15.157:0/107443009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c06b750 msgr2=0x7f225c071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:28.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22622c4700 1 --2- 172.21.15.157:0/107443009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c06b750 0x7f225c071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22622c4700 1 -- 172.21.15.157:0/107443009 >> v1:172.21.15.175:6789/0 conn(0x7f225c0715c0 legacy=0x7f225c0d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22622c4700 1 -- 172.21.15.157:0/107443009 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c06a730 con 0x7f225c145d20 2024-04-18T03:37:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22622c4700 1 --2- 172.21.15.157:0/107443009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c145d20 0x7f225c06b210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f224c009910 tx=0x7f224c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d5ce20ae4c45d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22612c2700 1 -- 172.21.15.157:0/107443009 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c011830 con 0x7f225c145d20 2024-04-18T03:37:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22612c2700 1 -- 172.21.15.157:0/107443009 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c011990 con 0x7f225c145d20 2024-04-18T03:37:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22612c2700 1 -- 172.21.15.157:0/107443009 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c011d40 con 0x7f225c145d20 2024-04-18T03:37:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 -- 172.21.15.157:0/107443009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c145d20 msgr2=0x7f225c06b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 --2- 172.21.15.157:0/107443009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c145d20 0x7f225c06b210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f224c009910 tx=0x7f224c009c20 comp rx=0 tx=0).stop 2024-04-18T03:37:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 -- 172.21.15.157:0/107443009 shutdown_connections 2024-04-18T03:37:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 --2- 172.21.15.157:0/107443009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c06b750 0x7f225c071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 --2- 172.21.15.157:0/107443009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c145d20 0x7f225c06b210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 -- 172.21.15.157:0/107443009 >> 172.21.15.157:0/107443009 conn(0x7f225c06e320 msgr2=0x7f225c06e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 -- 172.21.15.157:0/107443009 shutdown_connections 2024-04-18T03:37:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.695+0000 7f22632c6700 1 -- 172.21.15.157:0/107443009 wait complete. 2024-04-18T03:37:28.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22632c6700 1 Processor -- start 2024-04-18T03:37:28.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22632c6700 1 -- start start 2024-04-18T03:37:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22632c6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c06b750 0x7f225c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22632c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f225c0715c0 0x7f225c13c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22632c6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c145d20 0x7f225c14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22632c6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c14cd60 con 0x7f225c06b750 2024-04-18T03:37:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22632c6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c14d040 con 0x7f225c0715c0 2024-04-18T03:37:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22632c6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c14d320 con 0x7f225c145d20 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22622c4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c06b750 0x7f225c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22622c4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c06b750 0x7f225c14de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41120/0 (socket says 172.21.15.157:41120) 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f22622c4700 1 -- 172.21.15.157:0/4078966790 learned_addr learned my addr 172.21.15.157:0/4078966790 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f2261ac3700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f225c0715c0 0x7f225c13c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.699+0000 7f2262ac5700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c145d20 0x7f225c14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22622c4700 1 -- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c145d20 msgr2=0x7f225c14c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22622c4700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c145d20 0x7f225c14c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22622c4700 1 -- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f225c0715c0 msgr2=0x7f225c13c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22622c4700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f225c0715c0 0x7f225c13c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22622c4700 1 -- 172.21.15.157:0/4078966790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c009570 con 0x7f225c06b750 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f2262ac5700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c145d20 0x7f225c14c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22622c4700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c06b750 0x7f225c14de00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f225c0b5d50 tx=0x7f224c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f2252ffd700 1 -- 172.21.15.157:0/4078966790 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c004510 con 0x7f225c06b750 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f2252ffd700 1 -- 172.21.15.157:0/4078966790 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c01e070 con 0x7f225c06b750 2024-04-18T03:37:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c14d600 con 0x7f225c06b750 2024-04-18T03:37:28.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f2252ffd700 1 -- 172.21.15.157:0/4078966790 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c003900 con 0x7f225c06b750 2024-04-18T03:37:28.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c15cb20 con 0x7f225c06b750 2024-04-18T03:37:28.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f2252ffd700 1 -- 172.21.15.157:0/4078966790 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f224c003a60 con 0x7f225c06b750 2024-04-18T03:37:28.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.703+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c14db20 con 0x7f225c06b750 2024-04-18T03:37:28.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.707+0000 7f2252ffd700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f22400666d0 0x7f2240068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:28.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.707+0000 7f2252ffd700 1 -- 172.21.15.157:0/4078966790 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f224c084900 con 0x7f225c06b750 2024-04-18T03:37:28.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.707+0000 7f2261ac3700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f22400666d0 0x7f2240068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:28.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.707+0000 7f2261ac3700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f22400666d0 0x7f2240068b90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f225c06bbb0 tx=0x7f2258009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:28.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.715+0000 7f2252ffd700 1 -- 172.21.15.157:0/4078966790 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f225c14db20 con 0x7f225c06b750 2024-04-18T03:37:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.923+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f225c14db20 con 0x7f225c06b750 2024-04-18T03:37:28.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.923+0000 7f2252ffd700 1 -- 172.21.15.157:0/4078966790 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f224c015500 con 0x7f225c06b750 2024-04-18T03:37:28.928 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:28.928 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-18T03:37:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f22400666d0 msgr2=0x7f2240068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f22400666d0 0x7f2240068b90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f225c06bbb0 tx=0x7f2258009240 comp rx=0 tx=0).stop 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c06b750 msgr2=0x7f225c14de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c06b750 0x7f225c14de00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f225c0b5d50 tx=0x7f224c004770 comp rx=0 tx=0).stop 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 shutdown_connections 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f22400666d0 0x7f2240068b90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f225c0715c0 0x7f225c13c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f225c145d20 0x7f225c14c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 --2- 172.21.15.157:0/4078966790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f225c06b750 0x7f225c14de00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 >> 172.21.15.157:0/4078966790 conn(0x7f225c06e320 msgr2=0x7f225c146680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 shutdown_connections 2024-04-18T03:37:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:28.927+0000 7f22632c6700 1 -- 172.21.15.157:0/4078966790 wait complete. 2024-04-18T03:37:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 2 2024-04-18T03:37:30.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:37:31.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3bb59e700 1 Processor -- start 2024-04-18T03:37:31.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3bb59e700 1 -- start start 2024-04-18T03:37:31.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3bb59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3bc071890 0x7fa3bc15a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3bb59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3bb59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc15bf10 con 0x7fa3bc0adf00 2024-04-18T03:37:31.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3bb59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc15b5c0 con 0x7fa3bc071890 2024-04-18T03:37:31.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3bb59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0ae2e0 con 0x7fa3bc15aac0 2024-04-18T03:37:31.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3b9d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3bc071890 0x7fa3bc15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3bad9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3b9d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3bc071890 0x7fa3bc15a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:38240/0 (socket says 172.21.15.157:38240) 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3b9d9b700 1 -- 172.21.15.157:0/2423841147 learned_addr learned my addr 172.21.15.157:0/2423841147 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3ba59c700 1 --1- 172.21.15.157:0/2423841147 >> v1:172.21.15.175:6789/0 conn(0x7fa3bc0adf00 0x7fa3bc071180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:41938/0 (socket says 172.21.15.157:41938) 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3b9d9b700 1 -- 172.21.15.157:0/2423841147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 msgr2=0x7fa3bc15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.067+0000 7fa3b9d9b700 1 --2- 172.21.15.157:0/2423841147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc15c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3b9d9b700 1 -- 172.21.15.157:0/2423841147 >> v1:172.21.15.175:6789/0 conn(0x7fa3bc0adf00 legacy=0x7fa3bc071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3b9d9b700 1 -- 172.21.15.157:0/2423841147 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc15b2e0 con 0x7fa3bc071890 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bad9d700 1 --2- 172.21.15.157:0/2423841147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3b959a700 1 -- 172.21.15.157:0/2423841147 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378508064 0 0) 0x7fa3bc15bf10 con 0x7fa3bc0adf00 2024-04-18T03:37:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3b9d9b700 1 --2- 172.21.15.157:0/2423841147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 0x7fa3bc15a580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00d150 tx=0x7fa3ac00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ae99bbe5265f96 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3b959a700 1 -- 172.21.15.157:0/2423841147 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac010070 con 0x7fa3bc071890 2024-04-18T03:37:31.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3b959a700 1 -- 172.21.15.157:0/2423841147 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac00dd10 con 0x7fa3bc071890 2024-04-18T03:37:31.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3b959a700 1 -- 172.21.15.157:0/2423841147 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00b310 con 0x7fa3bc071890 2024-04-18T03:37:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- 172.21.15.157:0/2423841147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 msgr2=0x7fa3bc15a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/2423841147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 0x7fa3bc15a580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00d150 tx=0x7fa3ac00d460 comp rx=0 tx=0).stop 2024-04-18T03:37:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- 172.21.15.157:0/2423841147 shutdown_connections 2024-04-18T03:37:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/2423841147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/2423841147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 0x7fa3bc15a580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- 172.21.15.157:0/2423841147 >> 172.21.15.157:0/2423841147 conn(0x7fa3bc0b1330 msgr2=0x7fa3bc06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:31.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- 172.21.15.157:0/2423841147 shutdown_connections 2024-04-18T03:37:31.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- 172.21.15.157:0/2423841147 wait complete. 2024-04-18T03:37:31.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 Processor -- start 2024-04-18T03:37:31.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- start start 2024-04-18T03:37:31.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 0x7fa3bc1edf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3bc0adf00 0x7fa3bc156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0b3d30 con 0x7fa3bc0adf00 2024-04-18T03:37:31.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0b3120 con 0x7fa3bc071890 2024-04-18T03:37:31.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.071+0000 7fa3bb59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0b3400 con 0x7fa3bc15aac0 2024-04-18T03:37:31.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3bc0adf00 0x7fa3bc156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3ba59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 0x7fa3bc1edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3bc0adf00 0x7fa3bc156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41134/0 (socket says 172.21.15.157:41134) 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 -- 172.21.15.157:0/1061789077 learned_addr learned my addr 172.21.15.157:0/1061789077 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3bad9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 -- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 msgr2=0x7fa3bc1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 -- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 msgr2=0x7fa3bc1edf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 0x7fa3bc1edf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 -- 172.21.15.157:0/1061789077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40094b0 con 0x7fa3bc0adf00 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b9d9b700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3bc0adf00 0x7fa3bc156390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc06c5e0 tx=0x7fa3ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b2ffd700 1 -- 172.21.15.157:0/1061789077 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00b4c0 con 0x7fa3bc0adf00 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b2ffd700 1 -- 172.21.15.157:0/1061789077 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac00ac80 con 0x7fa3bc0adf00 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac00bd40 con 0x7fa3bc0adf00 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b2ffd700 1 -- 172.21.15.157:0/1061789077 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac004040 con 0x7fa3bc0adf00 2024-04-18T03:37:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc0b39c0 con 0x7fa3bc0adf00 2024-04-18T03:37:31.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b2ffd700 1 -- 172.21.15.157:0/1061789077 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3ac0041a0 con 0x7fa3bc0adf00 2024-04-18T03:37:31.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc0b3b80 con 0x7fa3bc0adf00 2024-04-18T03:37:31.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.075+0000 7fa3b2ffd700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa39c066730 0x7fa39c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.079+0000 7fa3b2ffd700 1 -- 172.21.15.157:0/1061789077 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3ac087a50 con 0x7fa3bc0adf00 2024-04-18T03:37:31.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.079+0000 7fa3ba59c700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa39c066730 0x7fa39c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.079+0000 7fa3ba59c700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa39c066730 0x7fa39c068bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4000f60 tx=0x7fa3a4007e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.087+0000 7fa3b2ffd700 1 -- 172.21.15.157:0/1061789077 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa3ac055240 con 0x7fa3bc0adf00 2024-04-18T03:37:31.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.291+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3bc04e650 con 0x7fa3bc0adf00 2024-04-18T03:37:31.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.291+0000 7fa3b2ffd700 1 -- 172.21.15.157:0/1061789077 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7fa3ac022de0 con 0x7fa3bc0adf00 2024-04-18T03:37:31.296 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:31.296 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-04-18T03:37:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa39c066730 msgr2=0x7fa39c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa39c066730 0x7fa39c068bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4000f60 tx=0x7fa3a4007e00 comp rx=0 tx=0).stop 2024-04-18T03:37:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3bc0adf00 msgr2=0x7fa3bc156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3bc0adf00 0x7fa3bc156390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc06c5e0 tx=0x7fa3ac004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 shutdown_connections 2024-04-18T03:37:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa39c066730 0x7fa39c068bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3bc15aac0 0x7fa3bc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3bc0adf00 0x7fa3bc156390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 --2- 172.21.15.157:0/1061789077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3bc071890 0x7fa3bc1edf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 >> 172.21.15.157:0/1061789077 conn(0x7fa3bc0b1330 msgr2=0x7fa3bc0aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:31.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 shutdown_connections 2024-04-18T03:37:31.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.295+0000 7fa3bb59e700 1 -- 172.21.15.157:0/1061789077 wait complete. 2024-04-18T03:37:31.300 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 3 2024-04-18T03:37:31.311 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:31.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f8848700 1 Processor -- start 2024-04-18T03:37:31.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f8848700 1 -- start start 2024-04-18T03:37:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f8848700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cb7c0 0x7fb1f40cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f8848700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb1f40cf290 0x7fb1f40cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f8848700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f406ad60 con 0x7fb1f415d1e0 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f8848700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f40cfc30 con 0x7fb1f40cf290 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f8848700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f406b040 con 0x7fb1f40cb7c0 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f259c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb1f415d1e0 0x7fb1f406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47666/0 (socket says 172.21.15.157:47666) 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f259c700 1 -- 172.21.15.157:0/3691870415 learned_addr learned my addr 172.21.15.157:0/3691870415 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f2d9d700 1 --2- 172.21.15.157:0/3691870415 >> v2:172.21.15.157:3300/0 conn(0x7fb1f40cf290 0x7fb1f40cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f1d9b700 1 --2- 172.21.15.157:0/3691870415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cb7c0 0x7fb1f40cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f159a700 1 -- 172.21.15.157:0/3691870415 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984948384 0 0) 0x7fb1f406ad60 con 0x7fb1f415d1e0 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f159a700 1 -- 172.21.15.157:0/3691870415 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e00035d0 con 0x7fb1f415d1e0 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f2d9d700 1 -- 172.21.15.157:0/3691870415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cb7c0 msgr2=0x7fb1f40cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f2d9d700 1 --2- 172.21.15.157:0/3691870415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cb7c0 0x7fb1f40cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f2d9d700 1 -- 172.21.15.157:0/3691870415 >> v1:172.21.15.157:6789/0 conn(0x7fb1f415d1e0 legacy=0x7fb1f406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f2d9d700 1 -- 172.21.15.157:0/3691870415 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40cea90 con 0x7fb1f40cf290 2024-04-18T03:37:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f2d9d700 1 --2- 172.21.15.157:0/3691870415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f40cf290 0x7fb1f40cf6f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009850 tx=0x7fb1e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa68e7def121499 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f159a700 1 -- 172.21.15.157:0/3691870415 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4011830 con 0x7fb1f40cf290 2024-04-18T03:37:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f159a700 1 -- 172.21.15.157:0/3691870415 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4011990 con 0x7fb1f40cf290 2024-04-18T03:37:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.423+0000 7fb1f159a700 1 -- 172.21.15.157:0/3691870415 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4011d00 con 0x7fb1f40cf290 2024-04-18T03:37:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 -- 172.21.15.157:0/3691870415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f40cf290 msgr2=0x7fb1f40cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 --2- 172.21.15.157:0/3691870415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f40cf290 0x7fb1f40cf6f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009850 tx=0x7fb1e4009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 -- 172.21.15.157:0/3691870415 shutdown_connections 2024-04-18T03:37:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 --2- 172.21.15.157:0/3691870415 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f40cf290 0x7fb1f40cf6f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 --2- 172.21.15.157:0/3691870415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cb7c0 0x7fb1f40cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 -- 172.21.15.157:0/3691870415 >> 172.21.15.157:0/3691870415 conn(0x7fb1f40d1000 msgr2=0x7fb1f40d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 -- 172.21.15.157:0/3691870415 shutdown_connections 2024-04-18T03:37:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 -- 172.21.15.157:0/3691870415 wait complete. 2024-04-18T03:37:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 Processor -- start 2024-04-18T03:37:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.427+0000 7fb1f8848700 1 -- start start 2024-04-18T03:37:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f40cb7c0 0x7fb1f40b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cf290 0x7fb1f40ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f415d1e0 0x7fb1f41f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41f3600 con 0x7fb1f415d1e0 2024-04-18T03:37:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40b5620 con 0x7fb1f40cb7c0 2024-04-18T03:37:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41f3040 con 0x7fb1f40cf290 2024-04-18T03:37:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f415d1e0 0x7fb1f41f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f40cb7c0 0x7fb1f40b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f1d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cf290 0x7fb1f40ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f40cb7c0 0x7fb1f40b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:38258/0 (socket says 172.21.15.157:38258) 2024-04-18T03:37:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f259c700 1 -- 172.21.15.157:0/871802660 learned_addr learned my addr 172.21.15.157:0/871802660 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f415d1e0 0x7fb1f41f23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41148/0 (socket says 172.21.15.157:41148) 2024-04-18T03:37:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f2d9d700 1 -- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cf290 msgr2=0x7fb1f40ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f2d9d700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cf290 0x7fb1f40ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f2d9d700 1 -- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f40cb7c0 msgr2=0x7fb1f40b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f2d9d700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f40cb7c0 0x7fb1f40b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f2d9d700 1 -- 172.21.15.157:0/871802660 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40094b0 con 0x7fb1f415d1e0 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f2d9d700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f415d1e0 0x7fb1f41f23b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4016000 tx=0x7fb1e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1eaffd700 1 -- 172.21.15.157:0/871802660 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4004510 con 0x7fb1f415d1e0 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1eaffd700 1 -- 172.21.15.157:0/871802660 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e401f070 con 0x7fb1f415d1e0 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f41f3320 con 0x7fb1f415d1e0 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1eaffd700 1 -- 172.21.15.157:0/871802660 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4003900 con 0x7fb1f415d1e0 2024-04-18T03:37:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f41f3cf0 con 0x7fb1f415d1e0 2024-04-18T03:37:31.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.431+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f40676b0 con 0x7fb1f415d1e0 2024-04-18T03:37:31.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.435+0000 7fb1eaffd700 1 -- 172.21.15.157:0/871802660 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1e4003a60 con 0x7fb1f415d1e0 2024-04-18T03:37:31.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.435+0000 7fb1eaffd700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb1d4066760 0x7fb1d4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.435+0000 7fb1eaffd700 1 -- 172.21.15.157:0/871802660 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb1e4021070 con 0x7fb1f415d1e0 2024-04-18T03:37:31.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.435+0000 7fb1f259c700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb1d4066760 0x7fb1d4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.435+0000 7fb1f259c700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb1d4066760 0x7fb1d4068c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec005cb0 tx=0x7fb1ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.443+0000 7fb1eaffd700 1 -- 172.21.15.157:0/871802660 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb1e4052b00 con 0x7fb1f415d1e0 2024-04-18T03:37:31.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.615+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1f41f3870 con 0x7fb1f415d1e0 2024-04-18T03:37:31.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.615+0000 7fb1eaffd700 1 -- 172.21.15.157:0/871802660 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fb1f41f3870 con 0x7fb1f415d1e0 2024-04-18T03:37:31.619 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:31.619 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":17,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:29.855146+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:31.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb1d4066760 msgr2=0x7fb1d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb1d4066760 0x7fb1d4068c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec005cb0 tx=0x7fb1ec009040 comp rx=0 tx=0).stop 2024-04-18T03:37:31.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f415d1e0 msgr2=0x7fb1f41f23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f415d1e0 0x7fb1f41f23b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4016000 tx=0x7fb1e4004770 comp rx=0 tx=0).stop 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 shutdown_connections 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb1d4066760 0x7fb1d4068c20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb1f415d1e0 0x7fb1f41f23b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f40cf290 0x7fb1f40ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 --2- 172.21.15.157:0/871802660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f40cb7c0 0x7fb1f40b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 >> 172.21.15.157:0/871802660 conn(0x7fb1f40d1000 msgr2=0x7fb1f40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 shutdown_connections 2024-04-18T03:37:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.619+0000 7fb1f8848700 1 -- 172.21.15.157:0/871802660 wait complete. 2024-04-18T03:37:31.633 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-18T03:37:31.634 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:37:31.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.747+0000 7f81c4820700 1 Processor -- start 2024-04-18T03:37:31.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.747+0000 7f81c4820700 1 -- start start 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.747+0000 7f81c4820700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81c0071080 0x7f81c0071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.747+0000 7f81c4820700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c00719a0 con 0x7f81c00d12b0 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.747+0000 7f81c4820700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c006a770 con 0x7f81c0161660 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.747+0000 7f81c4820700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c006aa50 con 0x7f81c0071080 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.747+0000 7f81bffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f81c00d12b0 0x7f81c00d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47678/0 (socket says 172.21.15.157:47678) 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.747+0000 7f81bffff700 1 -- 172.21.15.157:0/93098082 learned_addr learned my addr 172.21.15.157:0/93098082 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81bf7fe700 1 --2- 172.21.15.157:0/93098082 >> v2:172.21.15.175:3300/0 conn(0x7f81c0071080 0x7f81c0071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81be7fc700 1 -- 172.21.15.157:0/93098082 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893162222 0 0) 0x7f81c00719a0 con 0x7f81c00d12b0 2024-04-18T03:37:31.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81be7fc700 1 -- 172.21.15.157:0/93098082 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a80035d0 con 0x7f81c00d12b0 2024-04-18T03:37:31.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81bf7fe700 1 -- 172.21.15.157:0/93098082 >> v1:172.21.15.175:6789/0 conn(0x7f81c0161660 legacy=0x7f81c006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81be7fc700 1 -- 172.21.15.157:0/93098082 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 461314346 0 0) 0x7f81a80035d0 con 0x7f81c00d12b0 2024-04-18T03:37:31.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81bf7fe700 1 -- 172.21.15.157:0/93098082 >> v1:172.21.15.157:6789/0 conn(0x7f81c00d12b0 legacy=0x7f81c00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81bf7fe700 1 -- 172.21.15.157:0/93098082 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c006ad30 con 0x7f81c0071080 2024-04-18T03:37:31.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81bf7fe700 1 --2- 172.21.15.157:0/93098082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0071080 0x7f81c0071460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009850 tx=0x7f81b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68fcc9d8345d945f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81be7fc700 1 -- 172.21.15.157:0/93098082 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4011830 con 0x7f81c0071080 2024-04-18T03:37:31.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81be7fc700 1 -- 172.21.15.157:0/93098082 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b4011990 con 0x7f81c0071080 2024-04-18T03:37:31.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81be7fc700 1 -- 172.21.15.157:0/93098082 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4011d00 con 0x7f81c0071080 2024-04-18T03:37:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81c4820700 1 -- 172.21.15.157:0/93098082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0071080 msgr2=0x7f81c0071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81c4820700 1 --2- 172.21.15.157:0/93098082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0071080 0x7f81c0071460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009850 tx=0x7f81b4009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81c4820700 1 -- 172.21.15.157:0/93098082 shutdown_connections 2024-04-18T03:37:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81c4820700 1 --2- 172.21.15.157:0/93098082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0071080 0x7f81c0071460 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81c4820700 1 -- 172.21.15.157:0/93098082 >> 172.21.15.157:0/93098082 conn(0x7f81c006e020 msgr2=0x7f81c006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81c4820700 1 -- 172.21.15.157:0/93098082 shutdown_connections 2024-04-18T03:37:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.751+0000 7f81c4820700 1 -- 172.21.15.157:0/93098082 wait complete. 2024-04-18T03:37:31.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 Processor -- start 2024-04-18T03:37:31.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 -- start start 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c0071080 0x7f81c0147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c00d12b0 0x7f81c00b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0161660 0x7f81c00ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c0157ef0 con 0x7f81c00d12b0 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00b20c0 con 0x7f81c0161660 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00ac480 con 0x7f81c0071080 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c00d12b0 0x7f81c00b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c00d12b0 0x7f81c00b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41156/0 (socket says 172.21.15.157:41156) 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 -- 172.21.15.157:0/1480252765 learned_addr learned my addr 172.21.15.157:0/1480252765 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81bf7fe700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c0071080 0x7f81c0147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81bffff700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0161660 0x7f81c00ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 -- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c0071080 msgr2=0x7f81c0147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c0071080 0x7f81c0147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 -- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0161660 msgr2=0x7f81c00ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0161660 0x7f81c00ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 -- 172.21.15.157:0/1480252765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b40094b0 con 0x7f81c00d12b0 2024-04-18T03:37:31.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81beffd700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c00d12b0 0x7f81c00b2550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81b000c530 tx=0x7f81b000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81a7fff700 1 -- 172.21.15.157:0/1480252765 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000cea0 con 0x7f81c00d12b0 2024-04-18T03:37:31.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81a7fff700 1 -- 172.21.15.157:0/1480252765 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b00052d0 con 0x7f81c00d12b0 2024-04-18T03:37:31.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00b1a70 con 0x7f81c00d12b0 2024-04-18T03:37:31.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81a7fff700 1 -- 172.21.15.157:0/1480252765 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00036a0 con 0x7f81c00d12b0 2024-04-18T03:37:31.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.755+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c01476d0 con 0x7f81c00d12b0 2024-04-18T03:37:31.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.759+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c00b18d0 con 0x7f81c00d12b0 2024-04-18T03:37:31.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.759+0000 7f81a7fff700 1 -- 172.21.15.157:0/1480252765 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81b0003800 con 0x7f81c00d12b0 2024-04-18T03:37:31.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.759+0000 7f81a7fff700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f81ac066730 0x7f81ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:31.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.759+0000 7f81a7fff700 1 -- 172.21.15.157:0/1480252765 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f81b0083180 con 0x7f81c00d12b0 2024-04-18T03:37:31.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.759+0000 7f81bf7fe700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f81ac066730 0x7f81ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:31.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.759+0000 7f81bf7fe700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f81ac066730 0x7f81ac068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81b40090b0 tx=0x7f81b4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:31.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.767+0000 7f81a7fff700 1 -- 172.21.15.157:0/1480252765 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f81c00b18d0 con 0x7f81c00d12b0 2024-04-18T03:37:31.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81c00b18d0 con 0x7f81c00d12b0 2024-04-18T03:37:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81a7fff700 1 -- 172.21.15.157:0/1480252765 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81c00b18d0 con 0x7f81c00d12b0 2024-04-18T03:37:31.942 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:37:31.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f81ac066730 msgr2=0x7f81ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f81ac066730 0x7f81ac068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81b40090b0 tx=0x7f81b4008030 comp rx=0 tx=0).stop 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c00d12b0 msgr2=0x7f81c00b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c00d12b0 0x7f81c00b2550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81b000c530 tx=0x7f81b000c840 comp rx=0 tx=0).stop 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 shutdown_connections 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f81ac066730 0x7f81ac068bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c0161660 0x7f81c00ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f81c00d12b0 0x7f81c00b2550 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 --2- 172.21.15.157:0/1480252765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c0071080 0x7f81c0147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 >> 172.21.15.157:0/1480252765 conn(0x7f81c006e020 msgr2=0x7f81c015f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 shutdown_connections 2024-04-18T03:37:31.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:31.939+0000 7f81c4820700 1 -- 172.21.15.157:0/1480252765 wait complete. 2024-04-18T03:37:31.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-18T03:37:32.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 Processor -- start 2024-04-18T03:37:32.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- start start 2024-04-18T03:37:32.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5180e3700 0x7fd518039bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51803b920 con 0x7fd5180e77f0 2024-04-18T03:37:32.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51803bc00 con 0x7fd5180e7c80 2024-04-18T03:37:32.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51803bee0 con 0x7fd5180e3700 2024-04-18T03:37:32.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd524950700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd5180e77f0 0x7fd518054950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47694/0 (socket says 172.21.15.157:47694) 2024-04-18T03:37:32.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd524950700 1 -- 172.21.15.157:0/2828763003 learned_addr learned my addr 172.21.15.157:0/2828763003 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:32.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51ffff700 1 --2- 172.21.15.157:0/2828763003 >> v2:172.21.15.175:3300/0 conn(0x7fd5180e3700 0x7fd518039bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51effd700 1 -- 172.21.15.157:0/2828763003 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863335865 0 0) 0x7fd51803b920 con 0x7fd5180e77f0 2024-04-18T03:37:32.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51effd700 1 -- 172.21.15.157:0/2828763003 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5100035d0 con 0x7fd5180e77f0 2024-04-18T03:37:32.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51ffff700 1 -- 172.21.15.157:0/2828763003 >> v1:172.21.15.175:6789/0 conn(0x7fd5180e7c80 legacy=0x7fd5180e70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51ffff700 1 -- 172.21.15.157:0/2828763003 >> v1:172.21.15.157:6789/0 conn(0x7fd5180e77f0 legacy=0x7fd518054950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51ffff700 1 -- 172.21.15.157:0/2828763003 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51803c1c0 con 0x7fd5180e3700 2024-04-18T03:37:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51ffff700 1 --2- 172.21.15.157:0/2828763003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e3700 0x7fd518039bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd514009850 tx=0x7fd514009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40527d09cdd549d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51effd700 1 -- 172.21.15.157:0/2828763003 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514011830 con 0x7fd5180e3700 2024-04-18T03:37:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51effd700 1 -- 172.21.15.157:0/2828763003 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514011990 con 0x7fd5180e3700 2024-04-18T03:37:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd51effd700 1 -- 172.21.15.157:0/2828763003 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514011d40 con 0x7fd5180e3700 2024-04-18T03:37:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- 172.21.15.157:0/2828763003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e3700 msgr2=0x7fd518039bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 --2- 172.21.15.157:0/2828763003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e3700 0x7fd518039bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd514009850 tx=0x7fd514009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- 172.21.15.157:0/2828763003 shutdown_connections 2024-04-18T03:37:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 --2- 172.21.15.157:0/2828763003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e3700 0x7fd518039bd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- 172.21.15.157:0/2828763003 >> 172.21.15.157:0/2828763003 conn(0x7fd518056d80 msgr2=0x7fd518057190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- 172.21.15.157:0/2828763003 shutdown_connections 2024-04-18T03:37:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.063+0000 7fd525151700 1 -- 172.21.15.157:0/2828763003 wait complete. 2024-04-18T03:37:32.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.067+0000 7fd525151700 1 Processor -- start 2024-04-18T03:37:32.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.067+0000 7fd525151700 1 -- start start 2024-04-18T03:37:32.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.067+0000 7fd525151700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180e3700 0x7fd51817cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.067+0000 7fd525151700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e77f0 0x7fd5180de9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd525151700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5180e7c80 0x7fd5180e25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd525151700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51817c700 con 0x7fd5180e3700 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd525151700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518050710 con 0x7fd5180e77f0 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd525151700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180509f0 con 0x7fd5180e7c80 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180e3700 0x7fd51817cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180e3700 0x7fd51817cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41170/0 (socket says 172.21.15.157:41170) 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 -- 172.21.15.157:0/2588833605 learned_addr learned my addr 172.21.15.157:0/2588833605 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51f7fe700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e77f0 0x7fd5180de9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd524950700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5180e7c80 0x7fd5180e25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 -- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5180e7c80 msgr2=0x7fd5180e25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5180e7c80 0x7fd5180e25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 -- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e77f0 msgr2=0x7fd5180de9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e77f0 0x7fd5180de9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 -- 172.21.15.157:0/2588833605 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140094b0 con 0x7fd5180e3700 2024-04-18T03:37:32.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd524950700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5180e7c80 0x7fd5180e25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:32.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51ffff700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180e3700 0x7fd51817cb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd5140090b0 tx=0x7fd514004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:32.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51cff9700 1 -- 172.21.15.157:0/2588833605 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140036c0 con 0x7fd5180e3700 2024-04-18T03:37:32.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51cff9700 1 -- 172.21.15.157:0/2588833605 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51401f070 con 0x7fd5180e3700 2024-04-18T03:37:32.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd518050cd0 con 0x7fd5180e3700 2024-04-18T03:37:32.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51cff9700 1 -- 172.21.15.157:0/2588833605 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514003a80 con 0x7fd5180e3700 2024-04-18T03:37:32.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51817d0d0 con 0x7fd5180e3700 2024-04-18T03:37:32.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51817d290 con 0x7fd5180e3700 2024-04-18T03:37:32.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51cff9700 1 -- 172.21.15.157:0/2588833605 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd514003be0 con 0x7fd5180e3700 2024-04-18T03:37:32.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.071+0000 7fd51cff9700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd504066730 0x7fd504068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.075+0000 7fd51cff9700 1 -- 172.21.15.157:0/2588833605 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd514021070 con 0x7fd5180e3700 2024-04-18T03:37:32.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.075+0000 7fd51f7fe700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd504066730 0x7fd504068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.075+0000 7fd51f7fe700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd504066730 0x7fd504068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd5180e6470 tx=0x7fd50c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:32.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.079+0000 7fd51cff9700 1 -- 172.21.15.157:0/2588833605 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd514052a00 con 0x7fd5180e3700 2024-04-18T03:37:32.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.251+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd518005890 con 0x7fd5180e3700 2024-04-18T03:37:32.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.251+0000 7fd51cff9700 1 -- 172.21.15.157:0/2588833605 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd514056020 con 0x7fd5180e3700 2024-04-18T03:37:32.256 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:32.256 INFO:teuthology.orchestra.run.smithi157.stdout:[ 2024-04-18T03:37:32.256 INFO:teuthology.orchestra.run.smithi157.stdout: { 2024-04-18T03:37:32.256 INFO:teuthology.orchestra.run.smithi157.stdout: "poolnum": 1, 2024-04-18T03:37:32.256 INFO:teuthology.orchestra.run.smithi157.stdout: "poolname": ".mgr" 2024-04-18T03:37:32.256 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-18T03:37:32.256 INFO:teuthology.orchestra.run.smithi157.stdout:] 2024-04-18T03:37:32.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd504066730 msgr2=0x7fd504068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd504066730 0x7fd504068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd5180e6470 tx=0x7fd50c009040 comp rx=0 tx=0).stop 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180e3700 msgr2=0x7fd51817cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180e3700 0x7fd51817cb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd5140090b0 tx=0x7fd514004770 comp rx=0 tx=0).stop 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 shutdown_connections 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd504066730 0x7fd504068bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5180e77f0 0x7fd5180de9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5180e7c80 0x7fd5180e25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 --2- 172.21.15.157:0/2588833605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5180e3700 0x7fd51817cb90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 >> 172.21.15.157:0/2588833605 conn(0x7fd518056d80 msgr2=0x7fd518054e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 shutdown_connections 2024-04-18T03:37:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.255+0000 7fd525151700 1 -- 172.21.15.157:0/2588833605 wait complete. 2024-04-18T03:37:32.270 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-18T03:37:32.270 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-18T03:37:32.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.387+0000 7fd3960f5700 1 Processor -- start 2024-04-18T03:37:32.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.387+0000 7fd3960f5700 1 -- start start 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd390143620 0x7fd39015a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd39006d0a0 0x7fd3900b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd390143a00 con 0x7fd3900b3450 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3900b3f50 con 0x7fd39006d0a0 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3900cdda0 con 0x7fd390143620 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3948f2700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd3900b3450 0x7fd39006c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46440/0 (socket says 172.21.15.157:46440) 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3948f2700 1 -- 172.21.15.157:0/1013585630 learned_addr learned my addr 172.21.15.157:0/1013585630 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3958f4700 1 --2- 172.21.15.157:0/1013585630 >> v2:172.21.15.157:3300/0 conn(0x7fd39006d0a0 0x7fd3900b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3950f3700 1 --2- 172.21.15.157:0/1013585630 >> v2:172.21.15.175:3300/0 conn(0x7fd390143620 0x7fd39015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3958f4700 1 -- 172.21.15.157:0/1013585630 >> v2:172.21.15.175:3300/0 conn(0x7fd390143620 msgr2=0x7fd39015a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3958f4700 1 --2- 172.21.15.157:0/1013585630 >> v2:172.21.15.175:3300/0 conn(0x7fd390143620 0x7fd39015a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3958f4700 1 -- 172.21.15.157:0/1013585630 >> v1:172.21.15.157:6789/0 conn(0x7fd3900b3450 legacy=0x7fd39006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd387fff700 1 -- 172.21.15.157:0/1013585630 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705937578 0 0) 0x7fd390143a00 con 0x7fd3900b3450 2024-04-18T03:37:32.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3958f4700 1 -- 172.21.15.157:0/1013585630 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900ce020 con 0x7fd39006d0a0 2024-04-18T03:37:32.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3958f4700 1 --2- 172.21.15.157:0/1013585630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd39006d0a0 0x7fd3900b38e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd39006eb30 tx=0x7fd38800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df3b01b5b8f5ad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:32.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd387fff700 1 -- 172.21.15.157:0/1013585630 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800e070 con 0x7fd39006d0a0 2024-04-18T03:37:32.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd387fff700 1 -- 172.21.15.157:0/1013585630 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800bb20 con 0x7fd39006d0a0 2024-04-18T03:37:32.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd387fff700 1 -- 172.21.15.157:0/1013585630 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388012430 con 0x7fd39006d0a0 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 -- 172.21.15.157:0/1013585630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd39006d0a0 msgr2=0x7fd3900b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 --2- 172.21.15.157:0/1013585630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd39006d0a0 0x7fd3900b38e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd39006eb30 tx=0x7fd38800b330 comp rx=0 tx=0).stop 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 -- 172.21.15.157:0/1013585630 shutdown_connections 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 --2- 172.21.15.157:0/1013585630 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd39006d0a0 0x7fd3900b38e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 --2- 172.21.15.157:0/1013585630 >> v2:172.21.15.175:3300/0 conn(0x7fd390143620 0x7fd39015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 -- 172.21.15.157:0/1013585630 >> 172.21.15.157:0/1013585630 conn(0x7fd3900b17a0 msgr2=0x7fd3900b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 -- 172.21.15.157:0/1013585630 shutdown_connections 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 -- 172.21.15.157:0/1013585630 wait complete. 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.391+0000 7fd3960f5700 1 Processor -- start 2024-04-18T03:37:32.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 -- start start 2024-04-18T03:37:32.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd39006d0a0 0x7fd39013cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3900b3450 0x7fd3901f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd390143620 0x7fd390152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39013d440 con 0x7fd390143620 2024-04-18T03:37:32.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39013ca70 con 0x7fd39006d0a0 2024-04-18T03:37:32.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3901f5300 con 0x7fd3900b3450 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd390143620 0x7fd390152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd390143620 0x7fd390152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37444/0 (socket says 172.21.15.157:37444) 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 -- 172.21.15.157:0/465461061 learned_addr learned my addr 172.21.15.157:0/465461061 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3950f3700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd39006d0a0 0x7fd39013cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3948f2700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3900b3450 0x7fd3901f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 -- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3900b3450 msgr2=0x7fd3901f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3900b3450 0x7fd3901f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 -- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd39006d0a0 msgr2=0x7fd39013cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd39006d0a0 0x7fd39013cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 -- 172.21.15.157:0/465461061 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009a70 con 0x7fd390143620 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3948f2700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3900b3450 0x7fd3901f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3958f4700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd390143620 0x7fd390152bc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd388013000 tx=0x7fd388004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd385ffb700 1 -- 172.21.15.157:0/465461061 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388012430 con 0x7fd390143620 2024-04-18T03:37:32.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd385ffb700 1 -- 172.21.15.157:0/465461061 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd388020070 con 0x7fd390143620 2024-04-18T03:37:32.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd390153100 con 0x7fd390143620 2024-04-18T03:37:32.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd385ffb700 1 -- 172.21.15.157:0/465461061 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388004280 con 0x7fd390143620 2024-04-18T03:37:32.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39013c140 con 0x7fd390143620 2024-04-18T03:37:32.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.395+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39004e650 con 0x7fd390143620 2024-04-18T03:37:32.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.399+0000 7fd385ffb700 1 -- 172.21.15.157:0/465461061 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3880043e0 con 0x7fd390143620 2024-04-18T03:37:32.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.399+0000 7fd385ffb700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd374066730 0x7fd374068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.399+0000 7fd385ffb700 1 -- 172.21.15.157:0/465461061 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd388022070 con 0x7fd390143620 2024-04-18T03:37:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.399+0000 7fd3950f3700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd374066730 0x7fd374068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:32.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.399+0000 7fd3950f3700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd374066730 0x7fd374068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0044d0 tx=0x7fd38c00b450 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:32.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.403+0000 7fd385ffb700 1 -- 172.21.15.157:0/465461061 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd388053640 con 0x7fd390143620 2024-04-18T03:37:32.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.575+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd3900b0c60 con 0x7fd390143620 2024-04-18T03:37:32.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.891+0000 7fd385ffb700 1 -- 172.21.15.157:0/465461061 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd388056c60 con 0x7fd390143620 2024-04-18T03:37:32.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd374066730 msgr2=0x7fd374068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd374066730 0x7fd374068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0044d0 tx=0x7fd38c00b450 comp rx=0 tx=0).stop 2024-04-18T03:37:32.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd390143620 msgr2=0x7fd390152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:32.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd390143620 0x7fd390152bc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd388013000 tx=0x7fd388004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 shutdown_connections 2024-04-18T03:37:32.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd374066730 0x7fd374068bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd390143620 0x7fd390152bc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3900b3450 0x7fd3901f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 --2- 172.21.15.157:0/465461061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd39006d0a0 0x7fd39013cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:32.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 >> 172.21.15.157:0/465461061 conn(0x7fd3900b17a0 msgr2=0x7fd3900b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:32.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 shutdown_connections 2024-04-18T03:37:32.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:32.899+0000 7fd3960f5700 1 -- 172.21.15.157:0/465461061 wait complete. 2024-04-18T03:37:32.904 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_metadata' created 2024-04-18T03:37:32.918 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-18T03:37:33.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade161b700 1 Processor -- start 2024-04-18T03:37:33.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade161b700 1 -- start start 2024-04-18T03:37:33.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade161b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faddc142a30 0x7faddc0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:33.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade161b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faddc06bcf0 0x7faddc0b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:33.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade161b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc0cf500 con 0x7faddc142e10 2024-04-18T03:37:33.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade161b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc143a80 con 0x7faddc06bcf0 2024-04-18T03:37:33.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade161b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0b5050 con 0x7faddc142a30 2024-04-18T03:37:33.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade0e1a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faddc06bcf0 0x7faddc0b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:33.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7faddb7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7faddc142e10 0x7faddc06b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46452/0 (socket says 172.21.15.157:46452) 2024-04-18T03:37:33.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7faddb7fe700 1 -- 172.21.15.157:0/3116612654 learned_addr learned my addr 172.21.15.157:0/3116612654 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:33.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7faddbfff700 1 --2- 172.21.15.157:0/3116612654 >> v2:172.21.15.175:3300/0 conn(0x7faddc142a30 0x7faddc0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7faddaffd700 1 -- 172.21.15.157:0/3116612654 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439391693 0 0) 0x7faddc0cf500 con 0x7faddc142e10 2024-04-18T03:37:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7faddaffd700 1 -- 172.21.15.157:0/3116612654 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc40035d0 con 0x7faddc142e10 2024-04-18T03:37:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade0e1a700 1 -- 172.21.15.157:0/3116612654 >> v2:172.21.15.175:3300/0 conn(0x7faddc142a30 msgr2=0x7faddc0b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade0e1a700 1 --2- 172.21.15.157:0/3116612654 >> v2:172.21.15.175:3300/0 conn(0x7faddc142a30 0x7faddc0b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade0e1a700 1 -- 172.21.15.157:0/3116612654 >> v1:172.21.15.157:6789/0 conn(0x7faddc142e10 legacy=0x7faddc06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.043+0000 7fade0e1a700 1 -- 172.21.15.157:0/3116612654 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0ceeb0 con 0x7faddc06bcf0 2024-04-18T03:37:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade0e1a700 1 --2- 172.21.15.157:0/3116612654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc0b2f00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faddc066a30 tx=0x7fadd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff379478b70eade7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7faddaffd700 1 -- 172.21.15.157:0/3116612654 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400e070 con 0x7faddc06bcf0 2024-04-18T03:37:33.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7faddaffd700 1 -- 172.21.15.157:0/3116612654 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd400bb20 con 0x7faddc06bcf0 2024-04-18T03:37:33.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7faddaffd700 1 -- 172.21.15.157:0/3116612654 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4012430 con 0x7faddc06bcf0 2024-04-18T03:37:33.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 -- 172.21.15.157:0/3116612654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 msgr2=0x7faddc0b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:33.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 --2- 172.21.15.157:0/3116612654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc0b2f00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faddc066a30 tx=0x7fadd400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:33.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 -- 172.21.15.157:0/3116612654 shutdown_connections 2024-04-18T03:37:33.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 --2- 172.21.15.157:0/3116612654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc0b2f00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 --2- 172.21.15.157:0/3116612654 >> v2:172.21.15.175:3300/0 conn(0x7faddc142a30 0x7faddc0b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 -- 172.21.15.157:0/3116612654 >> 172.21.15.157:0/3116612654 conn(0x7faddc0b1920 msgr2=0x7faddc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:33.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 -- 172.21.15.157:0/3116612654 shutdown_connections 2024-04-18T03:37:33.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 -- 172.21.15.157:0/3116612654 wait complete. 2024-04-18T03:37:33.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 Processor -- start 2024-04-18T03:37:33.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.047+0000 7fade161b700 1 -- start start 2024-04-18T03:37:33.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc13e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faddc142a30 0x7faddc157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faddc142e10 0x7faddc1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0b2e00 con 0x7faddc06bcf0 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc1f0270 con 0x7faddc142a30 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc152bc0 con 0x7faddc142e10 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc13e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc13e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37466/0 (socket says 172.21.15.157:37466) 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 -- 172.21.15.157:0/2301194028 learned_addr learned my addr 172.21.15.157:0/2301194028 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddb7fe700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faddc142a30 0x7faddc157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade0e1a700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faddc142e10 0x7faddc1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 -- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faddc142e10 msgr2=0x7faddc1587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faddc142e10 0x7faddc1587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 -- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faddc142a30 msgr2=0x7faddc157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:33.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faddc142a30 0x7faddc157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 -- 172.21.15.157:0/2301194028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4009a70 con 0x7faddc06bcf0 2024-04-18T03:37:33.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddb7fe700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faddc142a30 0x7faddc157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:33.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7faddbfff700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc13e360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadd000e9d0 tx=0x7fadd000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:33.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fadd8ff9700 1 -- 172.21.15.157:0/2301194028 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0009720 con 0x7faddc06bcf0 2024-04-18T03:37:33.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fadd8ff9700 1 -- 172.21.15.157:0/2301194028 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000c850 con 0x7faddc06bcf0 2024-04-18T03:37:33.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc1520a0 con 0x7faddc06bcf0 2024-04-18T03:37:33.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fadd8ff9700 1 -- 172.21.15.157:0/2301194028 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000cbc0 con 0x7faddc06bcf0 2024-04-18T03:37:33.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc1528e0 con 0x7faddc06bcf0 2024-04-18T03:37:33.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.051+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc0ccef0 con 0x7faddc06bcf0 2024-04-18T03:37:33.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.055+0000 7fadd8ff9700 1 -- 172.21.15.157:0/2301194028 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fadd000cd20 con 0x7faddc06bcf0 2024-04-18T03:37:33.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.055+0000 7fadd8ff9700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fadc8066730 0x7fadc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:33.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.055+0000 7fadd8ff9700 1 -- 172.21.15.157:0/2301194028 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fadd0084820 con 0x7faddc06bcf0 2024-04-18T03:37:33.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.059+0000 7faddb7fe700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fadc8066730 0x7fadc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:33.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.059+0000 7faddb7fe700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fadc8066730 0x7fadc8068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faddc159bd0 tx=0x7fadcc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:33.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.063+0000 7fadd8ff9700 1 -- 172.21.15.157:0/2301194028 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fadd0051de0 con 0x7faddc06bcf0 2024-04-18T03:37:33.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.231+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7faddc04e650 con 0x7faddc06bcf0 2024-04-18T03:37:33.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.899+0000 7fadd8ff9700 1 -- 172.21.15.157:0/2301194028 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fadd00170d0 con 0x7faddc06bcf0 2024-04-18T03:37:33.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.919+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fadc8066730 msgr2=0x7fadc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:33.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.919+0000 7fade161b700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fadc8066730 0x7fadc8068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faddc159bd0 tx=0x7fadcc009040 comp rx=0 tx=0).stop 2024-04-18T03:37:33.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.919+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 msgr2=0x7faddc13e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:33.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.919+0000 7fade161b700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc13e360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadd000e9d0 tx=0x7fadd000ed90 comp rx=0 tx=0).stop 2024-04-18T03:37:33.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.923+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 shutdown_connections 2024-04-18T03:37:33.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.923+0000 7fade161b700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fadc8066730 0x7fadc8068bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.923+0000 7fade161b700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faddc142a30 0x7faddc157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.923+0000 7fade161b700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faddc142e10 0x7faddc1587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.923+0000 7fade161b700 1 --2- 172.21.15.157:0/2301194028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faddc06bcf0 0x7faddc13e360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:33.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.923+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 >> 172.21.15.157:0/2301194028 conn(0x7faddc0b1920 msgr2=0x7faddc159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:33.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.923+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 shutdown_connections 2024-04-18T03:37:33.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:33.923+0000 7fade161b700 1 -- 172.21.15.157:0/2301194028 wait complete. 2024-04-18T03:37:33.928 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_data' created 2024-04-18T03:37:33.940 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-18T03:37:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb88b29700 1 Processor -- start 2024-04-18T03:37:34.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb88b29700 1 -- start start 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb88b29700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb8415b320 0x7feb840b6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb88b29700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feb84071080 0x7feb84071510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb88b29700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb840d00e0 con 0x7feb840aff20 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb88b29700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb84071a50 con 0x7feb84071080 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb88b29700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b6d60 con 0x7feb8415b320 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb82d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feb84071080 0x7feb84071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb81d9b700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7feb840aff20 0x7feb840d0570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:39298/0 (socket says 172.21.15.157:39298) 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb8259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb8415b320 0x7feb840b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb81d9b700 1 -- 172.21.15.157:0/2175170825 learned_addr learned my addr 172.21.15.157:0/2175170825 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:34.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb82d9d700 1 -- 172.21.15.157:0/2175170825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb8415b320 msgr2=0x7feb840b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb82d9d700 1 --2- 172.21.15.157:0/2175170825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb8415b320 0x7feb840b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb82d9d700 1 -- 172.21.15.157:0/2175170825 >> v1:172.21.15.175:6789/0 conn(0x7feb840aff20 legacy=0x7feb840d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb8159a700 1 -- 172.21.15.157:0/2175170825 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642239682 0 0) 0x7feb840d00e0 con 0x7feb840aff20 2024-04-18T03:37:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb82d9d700 1 -- 172.21.15.157:0/2175170825 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8415b700 con 0x7feb84071080 2024-04-18T03:37:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb82d9d700 1 --2- 172.21.15.157:0/2175170825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb84071080 0x7feb84071510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0098b0 tx=0x7feb7c009bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc769db6ad021100 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb8159a700 1 -- 172.21.15.157:0/2175170825 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c011830 con 0x7feb84071080 2024-04-18T03:37:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb8159a700 1 -- 172.21.15.157:0/2175170825 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c011990 con 0x7feb84071080 2024-04-18T03:37:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.047+0000 7feb8159a700 1 -- 172.21.15.157:0/2175170825 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c011d20 con 0x7feb84071080 2024-04-18T03:37:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 -- 172.21.15.157:0/2175170825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb84071080 msgr2=0x7feb84071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 --2- 172.21.15.157:0/2175170825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb84071080 0x7feb84071510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0098b0 tx=0x7feb7c009bc0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 -- 172.21.15.157:0/2175170825 shutdown_connections 2024-04-18T03:37:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 --2- 172.21.15.157:0/2175170825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb84071080 0x7feb84071510 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 --2- 172.21.15.157:0/2175170825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb8415b320 0x7feb840b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 -- 172.21.15.157:0/2175170825 >> 172.21.15.157:0/2175170825 conn(0x7feb840d0de0 msgr2=0x7feb840d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:34.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 -- 172.21.15.157:0/2175170825 shutdown_connections 2024-04-18T03:37:34.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 -- 172.21.15.157:0/2175170825 wait complete. 2024-04-18T03:37:34.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 Processor -- start 2024-04-18T03:37:34.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.051+0000 7feb88b29700 1 -- start start 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb88b29700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb84071080 0x7feb840c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb88b29700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb840aff20 0x7feb8414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb88b29700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb8415b320 0x7feb84146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb88b29700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8414a650 con 0x7feb84071080 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb88b29700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb84147710 con 0x7feb8415b320 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb88b29700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb841479f0 con 0x7feb840aff20 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb84071080 0x7feb840c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb84071080 0x7feb840c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37482/0 (socket says 172.21.15.157:37482) 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 -- 172.21.15.157:0/1592794407 learned_addr learned my addr 172.21.15.157:0/1592794407 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb81d9b700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb840aff20 0x7feb8414a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb82d9d700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb8415b320 0x7feb84146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 -- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb840aff20 msgr2=0x7feb8414a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb840aff20 0x7feb8414a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 -- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb8415b320 msgr2=0x7feb84146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb8415b320 0x7feb84146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 -- 172.21.15.157:0/1592794407 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c0094b0 con 0x7feb84071080 2024-04-18T03:37:34.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb8259c700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb84071080 0x7feb840c8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb7800e870 tx=0x7feb7800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:34.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb72ffd700 1 -- 172.21.15.157:0/1592794407 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780095c0 con 0x7feb84071080 2024-04-18T03:37:34.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb72ffd700 1 -- 172.21.15.157:0/1592794407 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb78013680 con 0x7feb84071080 2024-04-18T03:37:34.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb84147cd0 con 0x7feb84071080 2024-04-18T03:37:34.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb72ffd700 1 -- 172.21.15.157:0/1592794407 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78013a10 con 0x7feb84071080 2024-04-18T03:37:34.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.055+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb84148290 con 0x7feb84071080 2024-04-18T03:37:34.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.059+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb841484b0 con 0x7feb84071080 2024-04-18T03:37:34.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.059+0000 7feb72ffd700 1 -- 172.21.15.157:0/1592794407 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb78013b70 con 0x7feb84071080 2024-04-18T03:37:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.059+0000 7feb72ffd700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7feb64066730 0x7feb64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.059+0000 7feb72ffd700 1 -- 172.21.15.157:0/1592794407 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7feb78083ff0 con 0x7feb84071080 2024-04-18T03:37:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.059+0000 7feb81d9b700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7feb64066730 0x7feb64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.059+0000 7feb81d9b700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7feb64066730 0x7feb64068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb840d1a30 tx=0x7feb74001b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:34.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.063+0000 7feb72ffd700 1 -- 172.21.15.157:0/1592794407 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7feb780513c0 con 0x7feb84071080 2024-04-18T03:37:34.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.267+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feb8404e6a0 con 0x7feb84071080 2024-04-18T03:37:34.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.279+0000 7feb72ffd700 1 -- 172.21.15.157:0/1592794407 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7feb780549e0 con 0x7feb84071080 2024-04-18T03:37:34.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.283+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7feb64066730 msgr2=0x7feb64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.283+0000 7feb88b29700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7feb64066730 0x7feb64068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb840d1a30 tx=0x7feb74001b70 comp rx=0 tx=0).stop 2024-04-18T03:37:34.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.283+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb84071080 msgr2=0x7feb840c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.283+0000 7feb88b29700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb84071080 0x7feb840c8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb7800e870 tx=0x7feb7800eb80 comp rx=0 tx=0).stop 2024-04-18T03:37:34.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.287+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 shutdown_connections 2024-04-18T03:37:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.287+0000 7feb88b29700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7feb64066730 0x7feb64068bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.287+0000 7feb88b29700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb8415b320 0x7feb84146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.287+0000 7feb88b29700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb840aff20 0x7feb8414a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.287+0000 7feb88b29700 1 --2- 172.21.15.157:0/1592794407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb84071080 0x7feb840c8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.287+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 >> 172.21.15.157:0/1592794407 conn(0x7feb840d0de0 msgr2=0x7feb840b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.287+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 shutdown_connections 2024-04-18T03:37:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.287+0000 7feb88b29700 1 -- 172.21.15.157:0/1592794407 wait complete. 2024-04-18T03:37:34.291 INFO:teuthology.orchestra.run.smithi157.stderr:new fs with metadata pool 2 and data pool 3 2024-04-18T03:37:34.308 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-18T03:37:34.309 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-18T03:37:34.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d53fff700 1 Processor -- start 2024-04-18T03:37:34.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d53fff700 1 -- start start 2024-04-18T03:37:34.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d53fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d5415e3d0 0x7f9d5406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d53fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d54071080 0x7f9d54071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d53fff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d540b67c0 con 0x7f9d54146a90 2024-04-18T03:37:34.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d53fff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d54071a70 con 0x7f9d5415e3d0 2024-04-18T03:37:34.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d53fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d540b6aa0 con 0x7f9d54071080 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d537fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d54071080 0x7f9d54071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d527fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d5415e3d0 0x7f9d5406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d527fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d5415e3d0 0x7f9d5406a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:57462/0 (socket says 172.21.15.157:57462) 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d527fc700 1 -- 172.21.15.157:0/327331085 learned_addr learned my addr 172.21.15.157:0/327331085 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d52ffd700 1 --1- 172.21.15.157:0/327331085 >> v1:172.21.15.175:6789/0 conn(0x7f9d54146a90 0x7f9d540b5f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:39308/0 (socket says 172.21.15.157:39308) 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d527fc700 1 -- 172.21.15.157:0/327331085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d54071080 msgr2=0x7f9d54071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d527fc700 1 --2- 172.21.15.157:0/327331085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d54071080 0x7f9d54071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d527fc700 1 -- 172.21.15.157:0/327331085 >> v1:172.21.15.175:6789/0 conn(0x7f9d54146a90 legacy=0x7f9d540b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d527fc700 1 -- 172.21.15.157:0/327331085 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d540b6d80 con 0x7f9d5415e3d0 2024-04-18T03:37:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d51ffb700 1 -- 172.21.15.157:0/327331085 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273270424 0 0) 0x7f9d540b67c0 con 0x7f9d54146a90 2024-04-18T03:37:34.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d527fc700 1 --2- 172.21.15.157:0/327331085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d5415e3d0 0x7f9d5406a770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009910 tx=0x7f9d44009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882785cb94e6a9e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:34.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d51ffb700 1 -- 172.21.15.157:0/327331085 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44011830 con 0x7f9d5415e3d0 2024-04-18T03:37:34.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d51ffb700 1 -- 172.21.15.157:0/327331085 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d44011990 con 0x7f9d5415e3d0 2024-04-18T03:37:34.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.415+0000 7f9d51ffb700 1 -- 172.21.15.157:0/327331085 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44011d40 con 0x7f9d5415e3d0 2024-04-18T03:37:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- 172.21.15.157:0/327331085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d5415e3d0 msgr2=0x7f9d5406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 --2- 172.21.15.157:0/327331085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d5415e3d0 0x7f9d5406a770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009910 tx=0x7f9d44009c20 comp rx=0 tx=0).stop 2024-04-18T03:37:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- 172.21.15.157:0/327331085 shutdown_connections 2024-04-18T03:37:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 --2- 172.21.15.157:0/327331085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d54071080 0x7f9d54071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 --2- 172.21.15.157:0/327331085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d5415e3d0 0x7f9d5406a770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- 172.21.15.157:0/327331085 >> 172.21.15.157:0/327331085 conn(0x7f9d5406e200 msgr2=0x7f9d5406e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- 172.21.15.157:0/327331085 shutdown_connections 2024-04-18T03:37:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- 172.21.15.157:0/327331085 wait complete. 2024-04-18T03:37:34.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 Processor -- start 2024-04-18T03:37:34.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- start start 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d54071080 0x7f9d54150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d54146a90 0x7f9d541401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d5415e3d0 0x7f9d541430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54150c70 con 0x7f9d54071080 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54142040 con 0x7f9d54146a90 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d53fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d54142320 con 0x7f9d5415e3d0 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.419+0000 7f9d52ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d54071080 0x7f9d54150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d52ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d54071080 0x7f9d54150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37496/0 (socket says 172.21.15.157:37496) 2024-04-18T03:37:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d537fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d5415e3d0 0x7f9d541430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d52ffd700 1 -- 172.21.15.157:0/788986136 learned_addr learned my addr 172.21.15.157:0/788986136 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:34.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d527fc700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d54146a90 0x7f9d541401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d52ffd700 1 -- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d5415e3d0 msgr2=0x7f9d541430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d52ffd700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d5415e3d0 0x7f9d541430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d52ffd700 1 -- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d54146a90 msgr2=0x7f9d541401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:34.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d52ffd700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d54146a90 0x7f9d541401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:34.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d52ffd700 1 -- 172.21.15.157:0/788986136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d44009570 con 0x7f9d54071080 2024-04-18T03:37:34.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d52ffd700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d54071080 0x7f9d54150730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c580 tx=0x7f9d4800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:34.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d3bfff700 1 -- 172.21.15.157:0/788986136 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48004ca0 con 0x7f9d54071080 2024-04-18T03:37:34.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d3bfff700 1 -- 172.21.15.157:0/788986136 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48004e20 con 0x7f9d54071080 2024-04-18T03:37:34.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d54142600 con 0x7f9d54071080 2024-04-18T03:37:34.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d3bfff700 1 -- 172.21.15.157:0/788986136 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48007310 con 0x7f9d54071080 2024-04-18T03:37:34.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d54142bc0 con 0x7f9d54071080 2024-04-18T03:37:34.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.423+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5404e650 con 0x7f9d54071080 2024-04-18T03:37:34.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.427+0000 7f9d3bfff700 1 -- 172.21.15.157:0/788986136 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d48007470 con 0x7f9d54071080 2024-04-18T03:37:34.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.427+0000 7f9d3bfff700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9d40066780 0x7f9d40068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:34.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.427+0000 7f9d3bfff700 1 -- 172.21.15.157:0/788986136 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d48083eb0 con 0x7f9d54071080 2024-04-18T03:37:34.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.427+0000 7f9d527fc700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9d40066780 0x7f9d40068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:34.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.427+0000 7f9d527fc700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9d40066780 0x7f9d40068c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d44014040 tx=0x7f9d44008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:34.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.431+0000 7f9d3bfff700 1 -- 172.21.15.157:0/788986136 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9d48051170 con 0x7f9d54071080 2024-04-18T03:37:34.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:34.611+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9d540674c0 con 0x7f9d54071080 2024-04-18T03:37:35.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.283+0000 7f9d3bfff700 1 -- 172.21.15.157:0/788986136 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f9d48007720 con 0x7f9d54071080 2024-04-18T03:37:35.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9d40066780 msgr2=0x7f9d40068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:35.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9d40066780 0x7f9d40068c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d44014040 tx=0x7f9d44008030 comp rx=0 tx=0).stop 2024-04-18T03:37:35.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d54071080 msgr2=0x7f9d54150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:35.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d54071080 0x7f9d54150730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c580 tx=0x7f9d4800c890 comp rx=0 tx=0).stop 2024-04-18T03:37:35.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 shutdown_connections 2024-04-18T03:37:35.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9d40066780 0x7f9d40068c40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d54146a90 0x7f9d541401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d5415e3d0 0x7f9d541430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 --2- 172.21.15.157:0/788986136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d54071080 0x7f9d54150730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 >> 172.21.15.157:0/788986136 conn(0x7f9d5406e200 msgr2=0x7f9d5415f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:35.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 shutdown_connections 2024-04-18T03:37:35.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.291+0000 7f9d53fff700 1 -- 172.21.15.157:0/788986136 wait complete. 2024-04-18T03:37:35.309 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-18T03:37:35.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c1fbc700 1 Processor -- start 2024-04-18T03:37:35.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c1fbc700 1 -- start start 2024-04-18T03:37:35.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c1fbc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f31bc071080 0x7f31bc071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:35.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c1fbc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31bc0d12b0 0x7f31bc0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:35.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c1fbc700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc0719a0 con 0x7f31bc161660 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c1fbc700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc06a770 con 0x7f31bc071080 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c1fbc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc06aa50 con 0x7f31bc0d12b0 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c0fba700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f31bc071080 0x7f31bc071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c0fba700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f31bc071080 0x7f31bc071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37510/0 (socket says 172.21.15.157:37510) 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c0fba700 1 -- 172.21.15.157:0/881665881 learned_addr learned my addr 172.21.15.157:0/881665881 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31bbfff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f31bc161660 0x7f31bc06c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46456/0 (socket says 172.21.15.157:46456) 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c17bb700 1 --2- 172.21.15.157:0/881665881 >> v2:172.21.15.175:3300/0 conn(0x7f31bc0d12b0 0x7f31bc0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c0fba700 1 -- 172.21.15.157:0/881665881 >> v2:172.21.15.175:3300/0 conn(0x7f31bc0d12b0 msgr2=0x7f31bc0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c0fba700 1 --2- 172.21.15.157:0/881665881 >> v2:172.21.15.175:3300/0 conn(0x7f31bc0d12b0 0x7f31bc0d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c0fba700 1 -- 172.21.15.157:0/881665881 >> v1:172.21.15.157:6789/0 conn(0x7f31bc161660 legacy=0x7f31bc06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c0fba700 1 -- 172.21.15.157:0/881665881 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc06ad30 con 0x7f31bc071080 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31c0fba700 1 --2- 172.21.15.157:0/881665881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc071080 0x7f31bc071460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31bc06c010 tx=0x7f31ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a28026c68f6862 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31bb7fe700 1 -- 172.21.15.157:0/881665881 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00e070 con 0x7f31bc071080 2024-04-18T03:37:35.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31bb7fe700 1 -- 172.21.15.157:0/881665881 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00b9c0 con 0x7f31bc071080 2024-04-18T03:37:35.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.439+0000 7f31bb7fe700 1 -- 172.21.15.157:0/881665881 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00bd70 con 0x7f31bc071080 2024-04-18T03:37:35.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 -- 172.21.15.157:0/881665881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc071080 msgr2=0x7f31bc071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:35.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/881665881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc071080 0x7f31bc071460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31bc06c010 tx=0x7f31ac00b330 comp rx=0 tx=0).stop 2024-04-18T03:37:35.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 -- 172.21.15.157:0/881665881 shutdown_connections 2024-04-18T03:37:35.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/881665881 >> v2:172.21.15.175:3300/0 conn(0x7f31bc0d12b0 0x7f31bc0d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/881665881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc071080 0x7f31bc071460 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 -- 172.21.15.157:0/881665881 >> 172.21.15.157:0/881665881 conn(0x7f31bc06e020 msgr2=0x7f31bc06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:35.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 -- 172.21.15.157:0/881665881 shutdown_connections 2024-04-18T03:37:35.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 -- 172.21.15.157:0/881665881 wait complete. 2024-04-18T03:37:35.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 Processor -- start 2024-04-18T03:37:35.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.443+0000 7f31c1fbc700 1 -- start start 2024-04-18T03:37:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c1fbc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31bc071080 0x7f31bc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c1fbc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc0d12b0 0x7f31bc1e8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c1fbc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31bc161660 0x7f31bc1e6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c1fbc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1e7d70 con 0x7f31bc0d12b0 2024-04-18T03:37:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c1fbc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1e70f0 con 0x7f31bc071080 2024-04-18T03:37:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c1fbc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1e73d0 con 0x7f31bc161660 2024-04-18T03:37:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc0d12b0 0x7f31bc1e8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc0d12b0 0x7f31bc1e8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37518/0 (socket says 172.21.15.157:37518) 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 -- 172.21.15.157:0/2750765342 learned_addr learned my addr 172.21.15.157:0/2750765342 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c0fba700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31bc071080 0x7f31bc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c17bb700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31bc161660 0x7f31bc1e6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 -- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31bc161660 msgr2=0x7f31bc1e6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31bc161660 0x7f31bc1e6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 -- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31bc071080 msgr2=0x7f31bc1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31bc071080 0x7f31bc1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 -- 172.21.15.157:0/2750765342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009b30 con 0x7f31bc0d12b0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31bbfff700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc0d12b0 0x7f31bc1e8190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c4d0 tx=0x7f31a400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31b97fa700 1 -- 172.21.15.157:0/2750765342 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400cea0 con 0x7f31bc0d12b0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc1e76b0 con 0x7f31bc0d12b0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31b97fa700 1 -- 172.21.15.157:0/2750765342 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a4005cd0 con 0x7f31bc0d12b0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31b97fa700 1 -- 172.21.15.157:0/2750765342 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a40072d0 con 0x7f31bc0d12b0 2024-04-18T03:37:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.447+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc1e86d0 con 0x7f31bc0d12b0 2024-04-18T03:37:35.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.451+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc1e7eb0 con 0x7f31bc0d12b0 2024-04-18T03:37:35.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.451+0000 7f31b97fa700 1 -- 172.21.15.157:0/2750765342 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f31a4007430 con 0x7f31bc0d12b0 2024-04-18T03:37:35.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.451+0000 7f31b97fa700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f319c066730 0x7f319c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:35.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.451+0000 7f31b97fa700 1 -- 172.21.15.157:0/2750765342 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f31a40833a0 con 0x7f31bc0d12b0 2024-04-18T03:37:35.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.451+0000 7f31c0fba700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f319c066730 0x7f319c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:35.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.451+0000 7f31c0fba700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f319c066730 0x7f319c068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31ac000f80 tx=0x7f31ac009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:35.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.455+0000 7f31b97fa700 1 -- 172.21.15.157:0/2750765342 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f31bc1e7eb0 con 0x7f31bc0d12b0 2024-04-18T03:37:35.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:35.627+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f31bc1e7eb0 con 0x7f31bc0d12b0 2024-04-18T03:37:37.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.295+0000 7f31b97fa700 1 -- 172.21.15.157:0/2750765342 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f31bc1e7eb0 con 0x7f31bc0d12b0 2024-04-18T03:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f319c066730 msgr2=0x7f319c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f319c066730 0x7f319c068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31ac000f80 tx=0x7f31ac009000 comp rx=0 tx=0).stop 2024-04-18T03:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc0d12b0 msgr2=0x7f31bc1e8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc0d12b0 0x7f31bc1e8190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c4d0 tx=0x7f31a400c7e0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 shutdown_connections 2024-04-18T03:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f319c066730 0x7f319c068bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31bc161660 0x7f31bc1e6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f31bc0d12b0 0x7f31bc1e8190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 --2- 172.21.15.157:0/2750765342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31bc071080 0x7f31bc1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 >> 172.21.15.157:0/2750765342 conn(0x7f31bc06e020 msgr2=0x7f31bc0b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 shutdown_connections 2024-04-18T03:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.311+0000 7f31c1fbc700 1 -- 172.21.15.157:0/2750765342 wait complete. 2024-04-18T03:37:37.316 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_data_ec' created 2024-04-18T03:37:37.326 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-18T03:37:37.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff938c700 1 Processor -- start 2024-04-18T03:37:37.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff938c700 1 -- start start 2024-04-18T03:37:37.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff938c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff406bab0 0x7faff406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:37.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff938c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faff406a9f0 0x7faff4070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:37.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff938c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff415c150 con 0x7faff41556a0 2024-04-18T03:37:37.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff938c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff4155a80 con 0x7faff406a9f0 2024-04-18T03:37:37.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff938c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff415b550 con 0x7faff406bab0 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff2ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7faff41556a0 0x7faff406b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46460/0 (socket says 172.21.15.157:46460) 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff2ffd700 1 -- 172.21.15.157:0/1466813221 learned_addr learned my addr 172.21.15.157:0/1466813221 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff37fe700 1 --2- 172.21.15.157:0/1466813221 >> v2:172.21.15.175:3300/0 conn(0x7faff406a9f0 0x7faff4070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff27fc700 1 --2- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff406bab0 0x7faff406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff1ffb700 1 -- 172.21.15.157:0/1466813221 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517299266 0 0) 0x7faff415c150 con 0x7faff41556a0 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.435+0000 7faff1ffb700 1 -- 172.21.15.157:0/1466813221 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe00035d0 con 0x7faff41556a0 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff37fe700 1 -- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff406bab0 msgr2=0x7faff406a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff37fe700 1 --2- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff406bab0 0x7faff406a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff37fe700 1 -- 172.21.15.157:0/1466813221 >> v1:172.21.15.157:6789/0 conn(0x7faff41556a0 legacy=0x7faff406b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff37fe700 1 -- 172.21.15.157:0/1466813221 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff406ae80 con 0x7faff406a9f0 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff27fc700 1 --2- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff406bab0 0x7faff406a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:37.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff37fe700 1 --2- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 0x7faff4070070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fafec009850 tx=0x7fafec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc367a5e68611cc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff1ffb700 1 -- 172.21.15.157:0/1466813221 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec011830 con 0x7faff406a9f0 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff1ffb700 1 -- 172.21.15.157:0/1466813221 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec011990 con 0x7faff406a9f0 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff1ffb700 1 -- 172.21.15.157:0/1466813221 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec011d40 con 0x7faff406a9f0 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 -- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 msgr2=0x7faff4070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 --2- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 0x7faff4070070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fafec009850 tx=0x7fafec009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 -- 172.21.15.157:0/1466813221 shutdown_connections 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 --2- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 0x7faff4070070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 --2- 172.21.15.157:0/1466813221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff406bab0 0x7faff406a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 -- 172.21.15.157:0/1466813221 >> 172.21.15.157:0/1466813221 conn(0x7faff40b1040 msgr2=0x7faff40cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:37.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 -- 172.21.15.157:0/1466813221 shutdown_connections 2024-04-18T03:37:37.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 -- 172.21.15.157:0/1466813221 wait complete. 2024-04-18T03:37:37.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 Processor -- start 2024-04-18T03:37:37.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.439+0000 7faff938c700 1 -- start start 2024-04-18T03:37:37.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff938c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 0x7faff415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:37.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff938c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faff406bab0 0x7faff40a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff938c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff41556a0 0x7faff40a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff938c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff415cf60 con 0x7faff406bab0 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff938c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff415d1b0 con 0x7faff406a9f0 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff938c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff415d490 con 0x7faff41556a0 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faff406bab0 0x7faff40a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faff406bab0 0x7faff40a7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37520/0 (socket says 172.21.15.157:37520) 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 -- 172.21.15.157:0/304901741 learned_addr learned my addr 172.21.15.157:0/304901741 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff2ffd700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 0x7faff415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff37fe700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff41556a0 0x7faff40a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 -- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff41556a0 msgr2=0x7faff40a8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff41556a0 0x7faff40a8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 -- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 msgr2=0x7faff415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 0x7faff415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 -- 172.21.15.157:0/304901741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe4009a70 con 0x7faff406bab0 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff27fc700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faff406bab0 0x7faff40a7ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafe400efc0 tx=0x7fafe400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7fafeb7fe700 1 -- 172.21.15.157:0/304901741 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe400cdd0 con 0x7faff406bab0 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7fafeb7fe700 1 -- 172.21.15.157:0/304901741 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe400f040 con 0x7faff406bab0 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec0094b0 con 0x7faff406bab0 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7fafeb7fe700 1 -- 172.21.15.157:0/304901741 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40146a0 con 0x7faff406bab0 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.443+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff415da50 con 0x7faff406bab0 2024-04-18T03:37:37.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.447+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff4067190 con 0x7faff406bab0 2024-04-18T03:37:37.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.447+0000 7fafeb7fe700 1 -- 172.21.15.157:0/304901741 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fafe4014800 con 0x7faff406bab0 2024-04-18T03:37:37.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.447+0000 7fafeb7fe700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fafd4066730 0x7fafd4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:37.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.447+0000 7fafeb7fe700 1 -- 172.21.15.157:0/304901741 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fafe4085700 con 0x7faff406bab0 2024-04-18T03:37:37.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.447+0000 7faff2ffd700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fafd4066730 0x7fafd4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:37.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.447+0000 7faff2ffd700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fafd4066730 0x7fafd4068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007fd0 tx=0x7fafdc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:37.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.455+0000 7fafeb7fe700 1 -- 172.21.15.157:0/304901741 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fafe4052790 con 0x7faff406bab0 2024-04-18T03:37:37.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:37.623+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7faff40cc2b0 con 0x7faff406bab0 2024-04-18T03:37:38.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.311+0000 7fafeb7fe700 1 -- 172.21.15.157:0/304901741 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fafe4055db0 con 0x7faff406bab0 2024-04-18T03:37:38.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fafd4066730 msgr2=0x7fafd4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fafd4066730 0x7fafd4068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007fd0 tx=0x7fafdc009040 comp rx=0 tx=0).stop 2024-04-18T03:37:38.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faff406bab0 msgr2=0x7faff40a7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faff406bab0 0x7faff40a7ec0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafe400efc0 tx=0x7fafe400c3a0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 shutdown_connections 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fafd4066730 0x7fafd4068bf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faff41556a0 0x7faff40a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faff406bab0 0x7faff40a7ec0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 --2- 172.21.15.157:0/304901741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faff406a9f0 0x7faff415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 >> 172.21.15.157:0/304901741 conn(0x7faff40b1040 msgr2=0x7faff40ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 shutdown_connections 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.323+0000 7faff938c700 1 -- 172.21.15.157:0/304901741 wait complete. 2024-04-18T03:37:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:set pool 4 allow_ec_overwrites to true 2024-04-18T03:37:38.347 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-18T03:37:38.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.455+0000 7f341ffff700 1 Processor -- start 2024-04-18T03:37:38.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.455+0000 7f341ffff700 1 -- start start 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3420143500 0x7f34200b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34200b2690 con 0x7f342006ef20 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34200ad530 con 0x7f34200ab8c0 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342015dcb0 con 0x7f3420143500 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341effd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3420143500 0x7f34200b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f342006ef20 0x7f34200ad9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46474/0 (socket says 172.21.15.157:46474) 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341f7fe700 1 -- 172.21.15.157:0/4104318958 learned_addr learned my addr 172.21.15.157:0/4104318958 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341effd700 1 -- 172.21.15.157:0/4104318958 >> v1:172.21.15.175:6789/0 conn(0x7f34200ab8c0 legacy=0x7f342006e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341effd700 1 -- 172.21.15.157:0/4104318958 >> v1:172.21.15.157:6789/0 conn(0x7f342006ef20 legacy=0x7f34200ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341effd700 1 -- 172.21.15.157:0/4104318958 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342015df90 con 0x7f3420143500 2024-04-18T03:37:38.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341e7fc700 1 -- 172.21.15.157:0/4104318958 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937433991 0 0) 0x7f34200b2690 con 0x7f342006ef20 2024-04-18T03:37:38.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341effd700 1 --2- 172.21.15.157:0/4104318958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3420143500 0x7f34200b2150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3410009850 tx=0x7f3410009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153e9a86ad2c1778 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:38.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341e7fc700 1 -- 172.21.15.157:0/4104318958 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410011830 con 0x7f3420143500 2024-04-18T03:37:38.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341e7fc700 1 -- 172.21.15.157:0/4104318958 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3410011990 con 0x7f3420143500 2024-04-18T03:37:38.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341e7fc700 1 -- 172.21.15.157:0/4104318958 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410011d20 con 0x7f3420143500 2024-04-18T03:37:38.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- 172.21.15.157:0/4104318958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3420143500 msgr2=0x7f34200b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 --2- 172.21.15.157:0/4104318958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3420143500 0x7f34200b2150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3410009850 tx=0x7f3410009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:38.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- 172.21.15.157:0/4104318958 shutdown_connections 2024-04-18T03:37:38.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 --2- 172.21.15.157:0/4104318958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3420143500 0x7f34200b2150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- 172.21.15.157:0/4104318958 >> 172.21.15.157:0/4104318958 conn(0x7f34200b12d0 msgr2=0x7f342006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:38.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- 172.21.15.157:0/4104318958 shutdown_connections 2024-04-18T03:37:38.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- 172.21.15.157:0/4104318958 wait complete. 2024-04-18T03:37:38.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 Processor -- start 2024-04-18T03:37:38.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.459+0000 7f341ffff700 1 -- start start 2024-04-18T03:37:38.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006ef20 0x7f34200add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34200ab8c0 0x7f342013b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3420143500 0x7f342013bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34200ae430 con 0x7f342006ef20 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34200ae710 con 0x7f3420143500 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34200ae9f0 con 0x7f34200ab8c0 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006ef20 0x7f34200add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006ef20 0x7f34200add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37550/0 (socket says 172.21.15.157:37550) 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 -- 172.21.15.157:0/2923875855 learned_addr learned my addr 172.21.15.157:0/2923875855 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f34167fc700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34200ab8c0 0x7f342013b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341f7fe700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3420143500 0x7f342013bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 -- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34200ab8c0 msgr2=0x7f342013b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34200ab8c0 0x7f342013b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 -- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3420143500 msgr2=0x7f342013bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3420143500 0x7f342013bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 -- 172.21.15.157:0/2923875855 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34100094b0 con 0x7f342006ef20 2024-04-18T03:37:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341effd700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006ef20 0x7f34200add30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3410000c00 tx=0x7f3410004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f3417fff700 1 -- 172.21.15.157:0/2923875855 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100036c0 con 0x7f342006ef20 2024-04-18T03:37:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f3417fff700 1 -- 172.21.15.157:0/2923875855 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341001e070 con 0x7f342006ef20 2024-04-18T03:37:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34200aecd0 con 0x7f342006ef20 2024-04-18T03:37:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f3417fff700 1 -- 172.21.15.157:0/2923875855 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410003a60 con 0x7f342006ef20 2024-04-18T03:37:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34200af4d0 con 0x7f342006ef20 2024-04-18T03:37:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34200af1f0 con 0x7f342006ef20 2024-04-18T03:37:38.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.463+0000 7f3417fff700 1 -- 172.21.15.157:0/2923875855 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3410003bc0 con 0x7f342006ef20 2024-04-18T03:37:38.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.467+0000 7f3417fff700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3400066730 0x7f3400068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.467+0000 7f3417fff700 1 -- 172.21.15.157:0/2923875855 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f3410085710 con 0x7f342006ef20 2024-04-18T03:37:38.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.467+0000 7f34167fc700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3400066730 0x7f3400068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.467+0000 7f34167fc700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3400066730 0x7f3400068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f34201381f0 tx=0x7f3408009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:38.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.471+0000 7f3417fff700 1 -- 172.21.15.157:0/2923875855 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f34200af1f0 con 0x7f342006ef20 2024-04-18T03:37:38.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.683+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f34200af720 con 0x7f342006ef20 2024-04-18T03:37:38.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.691+0000 7f3417fff700 1 -- 172.21.15.157:0/2923875855 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f34100527a0 con 0x7f342006ef20 2024-04-18T03:37:38.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3400066730 msgr2=0x7f3400068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3400066730 0x7f3400068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f34201381f0 tx=0x7f3408009040 comp rx=0 tx=0).stop 2024-04-18T03:37:38.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006ef20 msgr2=0x7f34200add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006ef20 0x7f34200add30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3410000c00 tx=0x7f3410004770 comp rx=0 tx=0).stop 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 shutdown_connections 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3400066730 0x7f3400068bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3420143500 0x7f342013bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34200ab8c0 0x7f342013b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 --2- 172.21.15.157:0/2923875855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f342006ef20 0x7f34200add30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 >> 172.21.15.157:0/2923875855 conn(0x7f34200b12d0 msgr2=0x7f34200abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 shutdown_connections 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.695+0000 7f341ffff700 1 -- 172.21.15.157:0/2923875855 wait complete. 2024-04-18T03:37:38.700 INFO:teuthology.orchestra.run.smithi157.stderr:added data pool 4 to fsmap 2024-04-18T03:37:38.714 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:37:38.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.819+0000 7f5831ba8700 1 Processor -- start 2024-04-18T03:37:38.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.819+0000 7f5831ba8700 1 -- start start 2024-04-18T03:37:38.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c06ef20 0x7f582c0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0b1c20 con 0x7f582c14a360 2024-04-18T03:37:38.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0b1f00 con 0x7f582c0cdd20 2024-04-18T03:37:38.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0b25c0 con 0x7f582c06ef20 2024-04-18T03:37:38.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5830ba6700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f582c14a360 0x7f582c161ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46482/0 (socket says 172.21.15.157:46482) 2024-04-18T03:37:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5830ba6700 1 -- 172.21.15.157:0/1907635638 learned_addr learned my addr 172.21.15.157:0/1907635638 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f58313a7700 1 --2- 172.21.15.157:0/1907635638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c06ef20 0x7f582c0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f582b7fe700 1 -- 172.21.15.157:0/1907635638 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518486470 0 0) 0x7f582c0b1c20 con 0x7f582c14a360 2024-04-18T03:37:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f582b7fe700 1 -- 172.21.15.157:0/1907635638 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58140035d0 con 0x7f582c14a360 2024-04-18T03:37:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f58313a7700 1 -- 172.21.15.157:0/1907635638 >> v1:172.21.15.175:6789/0 conn(0x7f582c0cdd20 legacy=0x7f582c06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f58313a7700 1 -- 172.21.15.157:0/1907635638 >> v1:172.21.15.157:6789/0 conn(0x7f582c14a360 legacy=0x7f582c161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f58313a7700 1 -- 172.21.15.157:0/1907635638 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0b21e0 con 0x7f582c06ef20 2024-04-18T03:37:38.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f58313a7700 1 --2- 172.21.15.157:0/1907635638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c06ef20 0x7f582c0ce1b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5824009880 tx=0x7f5824009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36a5dc4aabacca09 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:38.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f582b7fe700 1 -- 172.21.15.157:0/1907635638 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824011830 con 0x7f582c06ef20 2024-04-18T03:37:38.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f582b7fe700 1 -- 172.21.15.157:0/1907635638 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824011990 con 0x7f582c06ef20 2024-04-18T03:37:38.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f582b7fe700 1 -- 172.21.15.157:0/1907635638 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824011d20 con 0x7f582c06ef20 2024-04-18T03:37:38.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 -- 172.21.15.157:0/1907635638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c06ef20 msgr2=0x7f582c0ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 --2- 172.21.15.157:0/1907635638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c06ef20 0x7f582c0ce1b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5824009880 tx=0x7f5824009b90 comp rx=0 tx=0).stop 2024-04-18T03:37:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 -- 172.21.15.157:0/1907635638 shutdown_connections 2024-04-18T03:37:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 --2- 172.21.15.157:0/1907635638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c06ef20 0x7f582c0ce1b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 -- 172.21.15.157:0/1907635638 >> 172.21.15.157:0/1907635638 conn(0x7f582c0b1330 msgr2=0x7f582c06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 -- 172.21.15.157:0/1907635638 shutdown_connections 2024-04-18T03:37:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.823+0000 7f5831ba8700 1 -- 172.21.15.157:0/1907635638 wait complete. 2024-04-18T03:37:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 Processor -- start 2024-04-18T03:37:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 -- start start 2024-04-18T03:37:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582c06ef20 0x7f582c160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0cdd20 0x7f582c0ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c14a360 0x7f582c1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1621f0 con 0x7f582c06ef20 2024-04-18T03:37:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0a84c0 con 0x7f582c14a360 2024-04-18T03:37:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0ada00 con 0x7f582c0cdd20 2024-04-18T03:37:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582c06ef20 0x7f582c160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582c06ef20 0x7f582c160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37556/0 (socket says 172.21.15.157:37556) 2024-04-18T03:37:38.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f58313a7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c14a360 0x7f582c1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 -- 172.21.15.157:0/251019885 learned_addr learned my addr 172.21.15.157:0/251019885 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:38.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f582bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0cdd20 0x7f582c0ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 -- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0cdd20 msgr2=0x7f582c0ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0cdd20 0x7f582c0ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 -- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c14a360 msgr2=0x7f582c1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c14a360 0x7f582c1469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 -- 172.21.15.157:0/251019885 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240094b0 con 0x7f582c06ef20 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f58313a7700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c14a360 0x7f582c1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5830ba6700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582c06ef20 0x7f582c160960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c4d0 tx=0x7f581c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f58297fa700 1 -- 172.21.15.157:0/251019885 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c005d90 con 0x7f582c06ef20 2024-04-18T03:37:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f58297fa700 1 -- 172.21.15.157:0/251019885 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0070d0 con 0x7f582c06ef20 2024-04-18T03:37:38.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c0ad0a0 con 0x7f582c06ef20 2024-04-18T03:37:38.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f58297fa700 1 -- 172.21.15.157:0/251019885 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c007480 con 0x7f582c06ef20 2024-04-18T03:37:38.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.827+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c0a81e0 con 0x7f582c06ef20 2024-04-18T03:37:38.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.831+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c04e650 con 0x7f582c06ef20 2024-04-18T03:37:38.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.831+0000 7f58297fa700 1 -- 172.21.15.157:0/251019885 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f581c0075e0 con 0x7f582c06ef20 2024-04-18T03:37:38.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.831+0000 7f58297fa700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5818066730 0x7f5818068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:38.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.831+0000 7f58297fa700 1 -- 172.21.15.157:0/251019885 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f581c0838e0 con 0x7f582c06ef20 2024-04-18T03:37:38.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.831+0000 7f582bfff700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5818066730 0x7f5818068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:38.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.835+0000 7f582bfff700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5818066730 0x7f5818068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f582c147760 tx=0x7f5820009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:38.839+0000 7f58297fa700 1 -- 172.21.15.157:0/251019885 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f581c0508e0 con 0x7f582c06ef20 2024-04-18T03:37:39.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.055+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f582c164c80 con 0x7f582c06ef20 2024-04-18T03:37:39.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f58297fa700 1 -- 172.21.15.157:0/251019885 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4742 (secure 0 0 0) 0x7f581c053f00 con 0x7f582c06ef20 2024-04-18T03:37:39.061 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:39.061 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T03:37:34.273529+0000","modified":"2024-04-18T03:37:38.689670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-18T03:37:39.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5818066730 msgr2=0x7f5818068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5818066730 0x7f5818068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f582c147760 tx=0x7f5820009040 comp rx=0 tx=0).stop 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582c06ef20 msgr2=0x7f582c160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582c06ef20 0x7f582c160960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c4d0 tx=0x7f581c00c7e0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 shutdown_connections 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5818066730 0x7f5818068bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f582c14a360 0x7f582c1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f582c0cdd20 0x7f582c0ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 --2- 172.21.15.157:0/251019885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f582c06ef20 0x7f582c160960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 >> 172.21.15.157:0/251019885 conn(0x7f582c0b1330 msgr2=0x7f582c0cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 shutdown_connections 2024-04-18T03:37:39.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.059+0000 7f5831ba8700 1 -- 172.21.15.157:0/251019885 wait complete. 2024-04-18T03:37:39.065 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 7 2024-04-18T03:37:39.076 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:39.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f359e700 1 Processor -- start 2024-04-18T03:37:39.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f359e700 1 -- start start 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa0f406e810 0x7fa0f4141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f359e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa0f41445a0 0x7fa0f41433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f359e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f4142300 con 0x7fa0f415b590 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f359e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f4142f80 con 0x7fa0f41445a0 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f41425e0 con 0x7fa0f406e810 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f2d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa0f41445a0 0x7fa0f41433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f2d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa0f41445a0 0x7fa0f41433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37568/0 (socket says 172.21.15.157:37568) 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f2d9d700 1 -- 172.21.15.157:0/3953076165 learned_addr learned my addr 172.21.15.157:0/3953076165 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f259c700 1 --2- 172.21.15.157:0/3953076165 >> v2:172.21.15.175:3300/0 conn(0x7fa0f406e810 0x7fa0f4141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f2d9d700 1 -- 172.21.15.157:0/3953076165 >> v2:172.21.15.175:3300/0 conn(0x7fa0f406e810 msgr2=0x7fa0f4141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f2d9d700 1 --2- 172.21.15.157:0/3953076165 >> v2:172.21.15.175:3300/0 conn(0x7fa0f406e810 0x7fa0f4141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f2d9d700 1 -- 172.21.15.157:0/3953076165 >> v1:172.21.15.175:6789/0 conn(0x7fa0f415b590 legacy=0x7fa0f406ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f2d9d700 1 -- 172.21.15.157:0/3953076165 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f41428c0 con 0x7fa0f41445a0 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f259c700 1 --2- 172.21.15.157:0/3953076165 >> v2:172.21.15.175:3300/0 conn(0x7fa0f406e810 0x7fa0f4141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.187+0000 7fa0f2d9d700 1 --2- 172.21.15.157:0/3953076165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f41445a0 0x7fa0f41433a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0f406f3d0 tx=0x7fa0ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc03c184e54a6f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f1d9b700 1 -- 172.21.15.157:0/3953076165 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00e070 con 0x7fa0f41445a0 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f1d9b700 1 -- 172.21.15.157:0/3953076165 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec00b9c0 con 0x7fa0f41445a0 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f1d9b700 1 -- 172.21.15.157:0/3953076165 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00bd70 con 0x7fa0f41445a0 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 -- 172.21.15.157:0/3953076165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f41445a0 msgr2=0x7fa0f41433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 --2- 172.21.15.157:0/3953076165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f41445a0 0x7fa0f41433a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0f406f3d0 tx=0x7fa0ec00b330 comp rx=0 tx=0).stop 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 -- 172.21.15.157:0/3953076165 shutdown_connections 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 --2- 172.21.15.157:0/3953076165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f41445a0 0x7fa0f41433a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 --2- 172.21.15.157:0/3953076165 >> v2:172.21.15.175:3300/0 conn(0x7fa0f406e810 0x7fa0f4141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 -- 172.21.15.157:0/3953076165 >> 172.21.15.157:0/3953076165 conn(0x7fa0f40b1330 msgr2=0x7fa0f406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:39.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 -- 172.21.15.157:0/3953076165 shutdown_connections 2024-04-18T03:37:39.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 -- 172.21.15.157:0/3953076165 wait complete. 2024-04-18T03:37:39.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 Processor -- start 2024-04-18T03:37:39.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.191+0000 7fa0f359e700 1 -- start start 2024-04-18T03:37:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f406e810 0x7fa0f40af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0f41445a0 0x7fa0f40a8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0f415b590 0x7fa0f4138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f40afbb0 con 0x7fa0f406e810 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4137f20 con 0x7fa0f41445a0 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4138200 con 0x7fa0f415b590 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f406e810 0x7fa0f40af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f406e810 0x7fa0f40af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37578/0 (socket says 172.21.15.157:37578) 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 -- 172.21.15.157:0/2253817098 learned_addr learned my addr 172.21.15.157:0/2253817098 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0e9d9b700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0f41445a0 0x7fa0f40a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f2d9d700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0f415b590 0x7fa0f4138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 -- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0f415b590 msgr2=0x7fa0f4138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0f415b590 0x7fa0f4138fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 -- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0f41445a0 msgr2=0x7fa0f40a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0f41445a0 0x7fa0f40a8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 -- 172.21.15.157:0/2253817098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec009b30 con 0x7fa0f406e810 2024-04-18T03:37:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f259c700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f406e810 0x7fa0f40af670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400e760 tx=0x7fa0e400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0eb7fe700 1 -- 172.21.15.157:0/2253817098 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4004230 con 0x7fa0f406e810 2024-04-18T03:37:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0eb7fe700 1 -- 172.21.15.157:0/2253817098 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e4004390 con 0x7fa0f406e810 2024-04-18T03:37:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0eb7fe700 1 -- 172.21.15.157:0/2253817098 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e40036c0 con 0x7fa0f406e810 2024-04-18T03:37:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f41384e0 con 0x7fa0f406e810 2024-04-18T03:37:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f4138aa0 con 0x7fa0f406e810 2024-04-18T03:37:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.195+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f404e650 con 0x7fa0f406e810 2024-04-18T03:37:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.199+0000 7fa0eb7fe700 1 -- 172.21.15.157:0/2253817098 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa0e4003840 con 0x7fa0f406e810 2024-04-18T03:37:39.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.199+0000 7fa0eb7fe700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa0d4066730 0x7fa0d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.199+0000 7fa0eb7fe700 1 -- 172.21.15.157:0/2253817098 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0e40843a0 con 0x7fa0f406e810 2024-04-18T03:37:39.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.199+0000 7fa0e9d9b700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa0d4066730 0x7fa0d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.199+0000 7fa0e9d9b700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa0d4066730 0x7fa0d4068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0f41f3b50 tx=0x7fa0dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.207+0000 7fa0eb7fe700 1 -- 172.21.15.157:0/2253817098 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa0e4051400 con 0x7fa0f406e810 2024-04-18T03:37:39.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.375+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f415e450 con 0x7fa0f406e810 2024-04-18T03:37:39.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.379+0000 7fa0eb7fe700 1 -- 172.21.15.157:0/2253817098 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fa0e4054a20 con 0x7fa0f406e810 2024-04-18T03:37:39.383 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:39.384 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa0d4066730 msgr2=0x7fa0d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa0d4066730 0x7fa0d4068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0f41f3b50 tx=0x7fa0dc009040 comp rx=0 tx=0).stop 2024-04-18T03:37:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f406e810 msgr2=0x7fa0f40af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f406e810 0x7fa0f40af670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400e760 tx=0x7fa0e400ea70 comp rx=0 tx=0).stop 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 shutdown_connections 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa0d4066730 0x7fa0d4068bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0f41445a0 0x7fa0f40a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0f415b590 0x7fa0f4138fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 --2- 172.21.15.157:0/2253817098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0f406e810 0x7fa0f40af670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 >> 172.21.15.157:0/2253817098 conn(0x7fa0f40b1330 msgr2=0x7fa0f4070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 shutdown_connections 2024-04-18T03:37:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.383+0000 7fa0f359e700 1 -- 172.21.15.157:0/2253817098 wait complete. 2024-04-18T03:37:39.398 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:39.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 Processor -- start 2024-04-18T03:37:39.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 -- start start 2024-04-18T03:37:39.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3de806ebc0 0x7f3de80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de815e450 con 0x7f3de806e730 2024-04-18T03:37:39.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de8146d70 con 0x7f3de8146990 2024-04-18T03:37:39.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80d2d30 con 0x7f3de806ebc0 2024-04-18T03:37:39.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3de77fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3de806e730 0x7f3de80b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46498/0 (socket says 172.21.15.157:46498) 2024-04-18T03:37:39.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3de77fe700 1 -- 172.21.15.157:0/3436119350 learned_addr learned my addr 172.21.15.157:0/3436119350 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:39.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3decf87700 1 --2- 172.21.15.157:0/3436119350 >> v2:172.21.15.157:3300/0 conn(0x7f3de806ebc0 0x7f3de80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3de6ffd700 1 -- 172.21.15.157:0/3436119350 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541262246 0 0) 0x7f3de815e450 con 0x7f3de806e730 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3de6ffd700 1 -- 172.21.15.157:0/3436119350 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd40035d0 con 0x7f3de806e730 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3decf87700 1 -- 172.21.15.157:0/3436119350 >> v1:172.21.15.175:6789/0 conn(0x7f3de8146990 legacy=0x7f3de806c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3decf87700 1 -- 172.21.15.157:0/3436119350 >> v1:172.21.15.157:6789/0 conn(0x7f3de806e730 legacy=0x7f3de80b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3decf87700 1 -- 172.21.15.157:0/3436119350 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de815d8d0 con 0x7f3de806ebc0 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3decf87700 1 --2- 172.21.15.157:0/3436119350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de806ebc0 0x7f3de80b6960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009850 tx=0x7f3de0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0aa7d424f9600a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3de6ffd700 1 -- 172.21.15.157:0/3436119350 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0004230 con 0x7f3de806ebc0 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3de6ffd700 1 -- 172.21.15.157:0/3436119350 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0004390 con 0x7f3de806ebc0 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3de6ffd700 1 -- 172.21.15.157:0/3436119350 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00036c0 con 0x7f3de806ebc0 2024-04-18T03:37:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 -- 172.21.15.157:0/3436119350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de806ebc0 msgr2=0x7f3de80b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 --2- 172.21.15.157:0/3436119350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de806ebc0 0x7f3de80b6960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009850 tx=0x7f3de0009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:39.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 -- 172.21.15.157:0/3436119350 shutdown_connections 2024-04-18T03:37:39.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 --2- 172.21.15.157:0/3436119350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de806ebc0 0x7f3de80b6960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 -- 172.21.15.157:0/3436119350 >> 172.21.15.157:0/3436119350 conn(0x7f3de80b5630 msgr2=0x7f3de806e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:39.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.503+0000 7f3ded788700 1 -- 172.21.15.157:0/3436119350 shutdown_connections 2024-04-18T03:37:39.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 -- 172.21.15.157:0/3436119350 wait complete. 2024-04-18T03:37:39.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 Processor -- start 2024-04-18T03:37:39.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 -- start start 2024-04-18T03:37:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de806e730 0x7f3de8142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3de806ebc0 0x7f3de813e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8146990 0x7f3de81e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81e4a40 con 0x7f3de8146990 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de815a570 con 0x7f3de806e730 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3ded788700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de813edc0 con 0x7f3de806ebc0 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3decf87700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8146990 0x7f3de81e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3decf87700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8146990 0x7f3de81e6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37594/0 (socket says 172.21.15.157:37594) 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3decf87700 1 -- 172.21.15.157:0/623891642 learned_addr learned my addr 172.21.15.157:0/623891642 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3de77fe700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3de806ebc0 0x7f3de813e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3de7fff700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de806e730 0x7f3de8142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3decf87700 1 -- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3de806ebc0 msgr2=0x7f3de813e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3decf87700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3de806ebc0 0x7f3de813e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3decf87700 1 -- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de806e730 msgr2=0x7f3de8142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3decf87700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de806e730 0x7f3de8142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.507+0000 7f3decf87700 1 -- 172.21.15.157:0/623891642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00094b0 con 0x7f3de8146990 2024-04-18T03:37:39.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.511+0000 7f3decf87700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8146990 0x7f3de81e6e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3de0004000 tx=0x7f3de0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.511+0000 7f3de4ff9700 1 -- 172.21.15.157:0/623891642 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0006ea0 con 0x7f3de8146990 2024-04-18T03:37:39.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.511+0000 7f3de4ff9700 1 -- 172.21.15.157:0/623891642 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0011830 con 0x7f3de8146990 2024-04-18T03:37:39.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.511+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de813f2f0 con 0x7f3de8146990 2024-04-18T03:37:39.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.511+0000 7f3de4ff9700 1 -- 172.21.15.157:0/623891642 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011be0 con 0x7f3de8146990 2024-04-18T03:37:39.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.511+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de813f8b0 con 0x7f3de8146990 2024-04-18T03:37:39.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.511+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de80676b0 con 0x7f3de8146990 2024-04-18T03:37:39.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.511+0000 7f3de4ff9700 1 -- 172.21.15.157:0/623891642 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3de0011d40 con 0x7f3de8146990 2024-04-18T03:37:39.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.515+0000 7f3de4ff9700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3dc8066760 0x7f3dc8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.515+0000 7f3de4ff9700 1 -- 172.21.15.157:0/623891642 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3de0085a80 con 0x7f3de8146990 2024-04-18T03:37:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.515+0000 7f3de7fff700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3dc8066760 0x7f3dc8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.515+0000 7f3de7fff700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3dc8066760 0x7f3dc8068c20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8004f70 tx=0x7f3dd8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.519+0000 7f3de4ff9700 1 -- 172.21.15.157:0/623891642 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3de0052c40 con 0x7f3de8146990 2024-04-18T03:37:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.687+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3de804e650 con 0x7f3de8146990 2024-04-18T03:37:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.687+0000 7f3de4ff9700 1 -- 172.21.15.157:0/623891642 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f3de001f090 con 0x7f3de8146990 2024-04-18T03:37:39.691 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:39.691 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3dc8066760 msgr2=0x7f3dc8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3dc8066760 0x7f3dc8068c20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8004f70 tx=0x7f3dd8009040 comp rx=0 tx=0).stop 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8146990 msgr2=0x7f3de81e6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8146990 0x7f3de81e6e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3de0004000 tx=0x7f3de0004770 comp rx=0 tx=0).stop 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 shutdown_connections 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3dc8066760 0x7f3dc8068c20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8146990 0x7f3de81e6e10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3de806ebc0 0x7f3de813e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 --2- 172.21.15.157:0/623891642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de806e730 0x7f3de8142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 >> 172.21.15.157:0/623891642 conn(0x7f3de80b5630 msgr2=0x7f3de806ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 shutdown_connections 2024-04-18T03:37:39.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.691+0000 7f3ded788700 1 -- 172.21.15.157:0/623891642 wait complete. 2024-04-18T03:37:39.720 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:37:39.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.831+0000 7f2d64c4f700 1 Processor -- start 2024-04-18T03:37:39.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.831+0000 7f2d64c4f700 1 -- start start 2024-04-18T03:37:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2d600cdd20 0x7f2d600ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d6006e810 0x7f2d6006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d600b1c20 con 0x7f2d6014a360 2024-04-18T03:37:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d600b25c0 con 0x7f2d600cdd20 2024-04-18T03:37:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601621f0 con 0x7f2d6006e810 2024-04-18T03:37:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d6006e810 0x7f2d6006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5effd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2d600cdd20 0x7f2d600ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5f7fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2d6014a360 0x7f2d60161ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:39354/0 (socket says 172.21.15.157:39354) 2024-04-18T03:37:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5f7fe700 1 -- 172.21.15.157:0/1470438587 learned_addr learned my addr 172.21.15.157:0/1470438587 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5ffff700 1 -- 172.21.15.157:0/1470438587 >> v2:172.21.15.175:3300/0 conn(0x7f2d600cdd20 msgr2=0x7f2d600ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5ffff700 1 --2- 172.21.15.157:0/1470438587 >> v2:172.21.15.175:3300/0 conn(0x7f2d600cdd20 0x7f2d600ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5ffff700 1 -- 172.21.15.157:0/1470438587 >> v1:172.21.15.175:6789/0 conn(0x7f2d6014a360 legacy=0x7f2d60161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5ffff700 1 -- 172.21.15.157:0/1470438587 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d600b1f00 con 0x7f2d6006e810 2024-04-18T03:37:39.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5effd700 1 --2- 172.21.15.157:0/1470438587 >> v2:172.21.15.175:3300/0 conn(0x7f2d600cdd20 0x7f2d600ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:39.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5ffff700 1 --2- 172.21.15.157:0/1470438587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d6006e810 0x7f2d6006ec80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009850 tx=0x7f2d58009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=767f189a4a55edf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5e7fc700 1 -- 172.21.15.157:0/1470438587 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58011830 con 0x7f2d6006e810 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5e7fc700 1 -- 172.21.15.157:0/1470438587 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d58011990 con 0x7f2d6006e810 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d5e7fc700 1 -- 172.21.15.157:0/1470438587 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58011d40 con 0x7f2d6006e810 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1470438587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d6006e810 msgr2=0x7f2d6006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1470438587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d6006e810 0x7f2d6006ec80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009850 tx=0x7f2d58009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1470438587 shutdown_connections 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1470438587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d6006e810 0x7f2d6006ec80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1470438587 >> v2:172.21.15.175:3300/0 conn(0x7f2d600cdd20 0x7f2d600ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1470438587 >> 172.21.15.157:0/1470438587 conn(0x7f2d600b1330 msgr2=0x7f2d6006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1470438587 shutdown_connections 2024-04-18T03:37:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.835+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1470438587 wait complete. 2024-04-18T03:37:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 Processor -- start 2024-04-18T03:37:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 -- start start 2024-04-18T03:37:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d6006e810 0x7f2d60147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d600cdd20 0x7f2d600b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d6014a360 0x7f2d600b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601434c0 con 0x7f2d6006e810 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60147e10 con 0x7f2d6014a360 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601480f0 con 0x7f2d600cdd20 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d6006e810 0x7f2d60147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d6006e810 0x7f2d60147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37608/0 (socket says 172.21.15.157:37608) 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 -- 172.21.15.157:0/1641778017 learned_addr learned my addr 172.21.15.157:0/1641778017 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5effd700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d600cdd20 0x7f2d600b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5ffff700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d6014a360 0x7f2d600b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 -- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d600cdd20 msgr2=0x7f2d600b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d600cdd20 0x7f2d600b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 -- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d6014a360 msgr2=0x7f2d600b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d6014a360 0x7f2d600b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 -- 172.21.15.157:0/1641778017 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50009a70 con 0x7f2d6006e810 2024-04-18T03:37:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d5f7fe700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d6006e810 0x7f2d60147320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800c700 tx=0x7f2d4800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d57fff700 1 -- 172.21.15.157:0/1641778017 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48005d90 con 0x7f2d6006e810 2024-04-18T03:37:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d57fff700 1 -- 172.21.15.157:0/1641778017 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480070d0 con 0x7f2d6006e810 2024-04-18T03:37:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d580094b0 con 0x7f2d6006e810 2024-04-18T03:37:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d57fff700 1 -- 172.21.15.157:0/1641778017 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48007460 con 0x7f2d6006e810 2024-04-18T03:37:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.839+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d601f6ca0 con 0x7f2d6006e810 2024-04-18T03:37:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.843+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d601f6e90 con 0x7f2d6006e810 2024-04-18T03:37:39.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.843+0000 7f2d57fff700 1 -- 172.21.15.157:0/1641778017 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d480075c0 con 0x7f2d6006e810 2024-04-18T03:37:39.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.843+0000 7f2d57fff700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2d40066730 0x7f2d40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.843+0000 7f2d57fff700 1 -- 172.21.15.157:0/1641778017 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d480837d0 con 0x7f2d6006e810 2024-04-18T03:37:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.843+0000 7f2d5effd700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2d40066730 0x7f2d40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.843+0000 7f2d5effd700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2d40066730 0x7f2d40068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d60070c00 tx=0x7f2d5000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:39.851+0000 7f2d57fff700 1 -- 172.21.15.157:0/1641778017 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2d48050850 con 0x7f2d6006e810 2024-04-18T03:37:39.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:37:39.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:37:40.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.063+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d6004e650 con 0x7f2d6006e810 2024-04-18T03:37:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.063+0000 7f2d57fff700 1 -- 172.21.15.157:0/1641778017 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4742 (secure 0 0 0) 0x7f2d48053e70 con 0x7f2d6006e810 2024-04-18T03:37:40.068 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:40.068 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T03:37:34.273529+0000","modified":"2024-04-18T03:37:38.689670+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-18T03:37:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2d40066730 msgr2=0x7f2d40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2d40066730 0x7f2d40068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d60070c00 tx=0x7f2d5000b040 comp rx=0 tx=0).stop 2024-04-18T03:37:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d6006e810 msgr2=0x7f2d60147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d6006e810 0x7f2d60147320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800c700 tx=0x7f2d4800ca10 comp rx=0 tx=0).stop 2024-04-18T03:37:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 shutdown_connections 2024-04-18T03:37:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2d40066730 0x7f2d40068bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d6014a360 0x7f2d600b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d600cdd20 0x7f2d600b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 --2- 172.21.15.157:0/1641778017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d6006e810 0x7f2d60147320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 >> 172.21.15.157:0/1641778017 conn(0x7f2d600b1330 msgr2=0x7f2d6006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 shutdown_connections 2024-04-18T03:37:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.067+0000 7f2d64c4f700 1 -- 172.21.15.157:0/1641778017 wait complete. 2024-04-18T03:37:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 7 2024-04-18T03:37:40.083 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:40.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.191+0000 7f8548d25700 1 Processor -- start 2024-04-18T03:37:40.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.191+0000 7f8548d25700 1 -- start start 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8544071080 0x7f85440714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85440d12d0 0x7f85440d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8544071a20 con 0x7f8544145d20 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8544146100 con 0x7f85440d12d0 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85440d1ca0 con 0x7f8544071080 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f85437fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8544145d20 0x7f854406b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46508/0 (socket says 172.21.15.157:46508) 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f85437fe700 1 -- 172.21.15.157:0/1925723006 learned_addr learned my addr 172.21.15.157:0/1925723006 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8542ffd700 1 --2- 172.21.15.157:0/1925723006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8544071080 0x7f85440714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8543fff700 1 --2- 172.21.15.157:0/1925723006 >> v2:172.21.15.175:3300/0 conn(0x7f85440d12d0 0x7f85440d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f85427fc700 1 -- 172.21.15.157:0/1925723006 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255121242 0 0) 0x7f8544071a20 con 0x7f8544145d20 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f85427fc700 1 -- 172.21.15.157:0/1925723006 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f852c0035d0 con 0x7f8544145d20 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8542ffd700 1 -- 172.21.15.157:0/1925723006 >> v2:172.21.15.175:3300/0 conn(0x7f85440d12d0 msgr2=0x7f85440d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8542ffd700 1 --2- 172.21.15.157:0/1925723006 >> v2:172.21.15.175:3300/0 conn(0x7f85440d12d0 0x7f85440d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8542ffd700 1 -- 172.21.15.157:0/1925723006 >> v1:172.21.15.157:6789/0 conn(0x7f8544145d20 legacy=0x7f854406b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8542ffd700 1 -- 172.21.15.157:0/1925723006 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85441617d0 con 0x7f8544071080 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8542ffd700 1 --2- 172.21.15.157:0/1925723006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8544071080 0x7f85440714e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8534009850 tx=0x7f8534009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca610a322847e888 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f85427fc700 1 -- 172.21.15.157:0/1925723006 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534011830 con 0x7f8544071080 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f85427fc700 1 -- 172.21.15.157:0/1925723006 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8534011990 con 0x7f8544071080 2024-04-18T03:37:40.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f85427fc700 1 -- 172.21.15.157:0/1925723006 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534011d40 con 0x7f8544071080 2024-04-18T03:37:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 -- 172.21.15.157:0/1925723006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8544071080 msgr2=0x7f85440714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 --2- 172.21.15.157:0/1925723006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8544071080 0x7f85440714e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8534009850 tx=0x7f8534009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 -- 172.21.15.157:0/1925723006 shutdown_connections 2024-04-18T03:37:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 --2- 172.21.15.157:0/1925723006 >> v2:172.21.15.175:3300/0 conn(0x7f85440d12d0 0x7f85440d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 --2- 172.21.15.157:0/1925723006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8544071080 0x7f85440714e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 -- 172.21.15.157:0/1925723006 >> 172.21.15.157:0/1925723006 conn(0x7f854406e320 msgr2=0x7f854406e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:40.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 -- 172.21.15.157:0/1925723006 shutdown_connections 2024-04-18T03:37:40.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.195+0000 7f8548d25700 1 -- 172.21.15.157:0/1925723006 wait complete. 2024-04-18T03:37:40.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8548d25700 1 Processor -- start 2024-04-18T03:37:40.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8548d25700 1 -- start start 2024-04-18T03:37:40.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8548d25700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8544071080 0x7f8544138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8548d25700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440d12d0 0x7f854415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8548d25700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8544145d20 0x7f8544139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8548d25700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854415ffa0 con 0x7f8544071080 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8548d25700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854414b750 con 0x7f8544145d20 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8548d25700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854414ba30 con 0x7f85440d12d0 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f85437fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8544071080 0x7f8544138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f85437fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8544071080 0x7f8544138820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37620/0 (socket says 172.21.15.157:37620) 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f85437fe700 1 -- 172.21.15.157:0/2352266329 learned_addr learned my addr 172.21.15.157:0/2352266329 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8543fff700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8544145d20 0x7f8544139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.199+0000 7f8542ffd700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440d12d0 0x7f854415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f85437fe700 1 -- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440d12d0 msgr2=0x7f854415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f85437fe700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440d12d0 0x7f854415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f85437fe700 1 -- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8544145d20 msgr2=0x7f8544139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f85437fe700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8544145d20 0x7f8544139290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f85437fe700 1 -- 172.21.15.157:0/2352266329 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85340094b0 con 0x7f8544071080 2024-04-18T03:37:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f85437fe700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8544071080 0x7f8544138820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f853800c4d0 tx=0x7f853800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f852bfff700 1 -- 172.21.15.157:0/2352266329 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538005d90 con 0x7f8544071080 2024-04-18T03:37:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f852bfff700 1 -- 172.21.15.157:0/2352266329 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85380070d0 con 0x7f8544071080 2024-04-18T03:37:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854414bd10 con 0x7f8544071080 2024-04-18T03:37:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f852bfff700 1 -- 172.21.15.157:0/2352266329 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538007480 con 0x7f8544071080 2024-04-18T03:37:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854415fc90 con 0x7f8544071080 2024-04-18T03:37:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854404e650 con 0x7f8544071080 2024-04-18T03:37:40.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.203+0000 7f852bfff700 1 -- 172.21.15.157:0/2352266329 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85380075e0 con 0x7f8544071080 2024-04-18T03:37:40.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.207+0000 7f852bfff700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8530066760 0x7f8530068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.207+0000 7f852bfff700 1 -- 172.21.15.157:0/2352266329 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f85380838a0 con 0x7f8544071080 2024-04-18T03:37:40.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.207+0000 7f8542ffd700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8530066760 0x7f8530068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.207+0000 7f8542ffd700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8530066760 0x7f8530068c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f85340090b0 tx=0x7f8534008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.211+0000 7f852bfff700 1 -- 172.21.15.157:0/2352266329 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f85380508a0 con 0x7f8544071080 2024-04-18T03:37:40.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.383+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f854415d070 con 0x7f8544071080 2024-04-18T03:37:40.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f852bfff700 1 -- 172.21.15.157:0/2352266329 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f8538053ec0 con 0x7f8544071080 2024-04-18T03:37:40.389 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:40.390 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8530066760 msgr2=0x7f8530068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8530066760 0x7f8530068c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f85340090b0 tx=0x7f8534008030 comp rx=0 tx=0).stop 2024-04-18T03:37:40.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8544071080 msgr2=0x7f8544138820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8544071080 0x7f8544138820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f853800c4d0 tx=0x7f853800c7e0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 shutdown_connections 2024-04-18T03:37:40.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8530066760 0x7f8530068c20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8544145d20 0x7f8544139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440d12d0 0x7f854415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 --2- 172.21.15.157:0/2352266329 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8544071080 0x7f8544138820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 >> 172.21.15.157:0/2352266329 conn(0x7f854406e320 msgr2=0x7f8544144450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:40.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 shutdown_connections 2024-04-18T03:37:40.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.387+0000 7f8548d25700 1 -- 172.21.15.157:0/2352266329 wait complete. 2024-04-18T03:37:40.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T03:37:34.273529+0000', 'modified': '2024-04-18T03:37:38.689670+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/1564130449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1564130449}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1564130449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-04-18T03:37:40.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-18T03:37:40.814 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-18T03:37:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab8a075700 1 Processor -- start 2024-04-18T03:37:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab8a075700 1 -- start start 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab8a075700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab84070a80 0x7fab840cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab8a075700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fab840cb9c0 0x7fab840b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab8a075700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab840cbdd0 con 0x7fab8415b030 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab8a075700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab84071c30 con 0x7fab840cb9c0 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab8a075700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8415b410 con 0x7fab84070a80 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab89073700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fab8415b030 0x7fab840d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46522/0 (socket says 172.21.15.157:46522) 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab89874700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fab840cb9c0 0x7fab840b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab89073700 1 -- 172.21.15.157:0/78008022 learned_addr learned my addr 172.21.15.157:0/78008022 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab88872700 1 --2- 172.21.15.157:0/78008022 >> v2:172.21.15.175:3300/0 conn(0x7fab84070a80 0x7fab840cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.935+0000 7fab89874700 1 -- 172.21.15.157:0/78008022 >> v2:172.21.15.175:3300/0 conn(0x7fab84070a80 msgr2=0x7fab840cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab89874700 1 --2- 172.21.15.157:0/78008022 >> v2:172.21.15.175:3300/0 conn(0x7fab84070a80 0x7fab840cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab89874700 1 -- 172.21.15.157:0/78008022 >> v1:172.21.15.157:6789/0 conn(0x7fab8415b030 legacy=0x7fab840d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab83fff700 1 -- 172.21.15.157:0/78008022 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257518286 0 0) 0x7fab840cbdd0 con 0x7fab8415b030 2024-04-18T03:37:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab89874700 1 -- 172.21.15.157:0/78008022 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84070fb0 con 0x7fab840cb9c0 2024-04-18T03:37:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab89874700 1 --2- 172.21.15.157:0/78008022 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab840cb9c0 0x7fab840b3f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab840b3ae0 tx=0x7fab7c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7777db295dcd5949 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab83fff700 1 -- 172.21.15.157:0/78008022 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c011830 con 0x7fab840cb9c0 2024-04-18T03:37:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab83fff700 1 -- 172.21.15.157:0/78008022 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c011990 con 0x7fab840cb9c0 2024-04-18T03:37:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab83fff700 1 -- 172.21.15.157:0/78008022 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c011d20 con 0x7fab840cb9c0 2024-04-18T03:37:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 -- 172.21.15.157:0/78008022 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab840cb9c0 msgr2=0x7fab840b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 --2- 172.21.15.157:0/78008022 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab840cb9c0 0x7fab840b3f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab840b3ae0 tx=0x7fab7c009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 -- 172.21.15.157:0/78008022 shutdown_connections 2024-04-18T03:37:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 --2- 172.21.15.157:0/78008022 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab840cb9c0 0x7fab840b3f30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 --2- 172.21.15.157:0/78008022 >> v2:172.21.15.175:3300/0 conn(0x7fab84070a80 0x7fab840cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 -- 172.21.15.157:0/78008022 >> 172.21.15.157:0/78008022 conn(0x7fab840d0c20 msgr2=0x7fab840d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 -- 172.21.15.157:0/78008022 shutdown_connections 2024-04-18T03:37:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 -- 172.21.15.157:0/78008022 wait complete. 2024-04-18T03:37:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 Processor -- start 2024-04-18T03:37:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.939+0000 7fab8a075700 1 -- start start 2024-04-18T03:37:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab8a075700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab84070a80 0x7fab840c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab8a075700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab840cb9c0 0x7fab840b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab8a075700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8415b030 0x7fab840b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab8a075700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab840a7a20 con 0x7fab84070a80 2024-04-18T03:37:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab8a075700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8414cd30 con 0x7fab8415b030 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab8a075700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8414d1c0 con 0x7fab840cb9c0 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab84070a80 0x7fab840c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab84070a80 0x7fab840c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37648/0 (socket says 172.21.15.157:37648) 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 -- 172.21.15.157:0/2816195562 learned_addr learned my addr 172.21.15.157:0/2816195562 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab88872700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab840cb9c0 0x7fab840b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89874700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8415b030 0x7fab840b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 -- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab840cb9c0 msgr2=0x7fab840b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab840cb9c0 0x7fab840b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 -- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8415b030 msgr2=0x7fab840b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8415b030 0x7fab840b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 -- 172.21.15.157:0/2816195562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c0094b0 con 0x7fab84070a80 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab88872700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab840cb9c0 0x7fab840b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab89073700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab84070a80 0x7fab840c7310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c4e0 tx=0x7fab7400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab81ffb700 1 -- 172.21.15.157:0/2816195562 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74004ca0 con 0x7fab84070a80 2024-04-18T03:37:40.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab81ffb700 1 -- 172.21.15.157:0/2816195562 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74004e20 con 0x7fab84070a80 2024-04-18T03:37:40.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab81ffb700 1 -- 172.21.15.157:0/2816195562 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74007310 con 0x7fab84070a80 2024-04-18T03:37:40.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab8a075700 1 -- 172.21.15.157:0/2816195562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8414a4c0 con 0x7fab84070a80 2024-04-18T03:37:40.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.943+0000 7fab8a075700 1 -- 172.21.15.157:0/2816195562 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab84149e70 con 0x7fab84070a80 2024-04-18T03:37:40.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.947+0000 7fab81ffb700 1 -- 172.21.15.157:0/2816195562 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab74007470 con 0x7fab84070a80 2024-04-18T03:37:40.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.947+0000 7fab81ffb700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab64066730 0x7fab64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.947+0000 7fab81ffb700 1 -- 172.21.15.157:0/2816195562 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab74083ff0 con 0x7fab84070a80 2024-04-18T03:37:40.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.947+0000 7fab88872700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab64066730 0x7fab64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.947+0000 7fab88872700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab64066730 0x7fab64068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab840c4030 tx=0x7fab6c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab8e584740 1 Processor -- start 2024-04-18T03:37:40.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab8e584740 1 -- start start 2024-04-18T03:37:40.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab8e584740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd3a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab8e584740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd192d0 0xceeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab8e584740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3ab80 0xceefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab8e584740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0xc612d0 con 0xd3a260 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab8e584740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0xc5ea60 con 0xd192d0 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab8e584740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0xc5a350 con 0xd3ab80 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd3a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd3a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37664/0 (socket says 172.21.15.157:37664) 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 -- 172.21.15.157:0/2217370760 learned_addr learned my addr 172.21.15.157:0/2217370760 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab88872700 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd192d0 0xceeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89874700 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3ab80 0xceefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 -- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3ab80 msgr2=0xceefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3ab80 0xceefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 -- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd192d0 msgr2=0xceeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd192d0 0xceeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 -- 172.21.15.157:0/2217370760 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xacd960 con 0xd3a260 2024-04-18T03:37:40.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab88872700 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd192d0 0xceeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89874700 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3ab80 0xceefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab89073700 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd3a640 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab74001120 tx=0x7fab74054710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb2b39d9b943507 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab7affd700 1 -- 172.21.15.157:0/2217370760 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74054d30 con 0xd3a260 2024-04-18T03:37:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab7affd700 1 -- 172.21.15.157:0/2217370760 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74058b60 con 0xd3a260 2024-04-18T03:37:40.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.951+0000 7fab7affd700 1 -- 172.21.15.157:0/2217370760 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7405d120 con 0xd3a260 2024-04-18T03:37:40.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- 172.21.15.157:0/2217370760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 msgr2=0xd3a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd3a640 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab74001120 tx=0x7fab74054710 comp rx=0 tx=0).stop 2024-04-18T03:37:40.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- 172.21.15.157:0/2217370760 shutdown_connections 2024-04-18T03:37:40.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd192d0 0xceeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3ab80 0xceefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 --2- 172.21.15.157:0/2217370760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd3a640 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- 172.21.15.157:0/2217370760 >> 172.21.15.157:0/2217370760 conn(0xa824d0 msgr2=0xd1b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:40.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- 172.21.15.157:0/2217370760 shutdown_connections 2024-04-18T03:37:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- 172.21.15.157:0/2217370760 wait complete. 2024-04-18T03:37:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- start start 2024-04-18T03:37:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 Processor -- start 2024-04-18T03:37:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 0xd18790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd18cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 0xd33250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0xc17c80 con 0xd3a260 2024-04-18T03:37:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0xc1db00 con 0xd3ab80 2024-04-18T03:37:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.955+0000 7fab8e584740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0xb06aa0 con 0xd192d0 2024-04-18T03:37:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd18cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 10 client.0 _ll_register_callbacks cb 0xc1f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd18cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37666/0 (socket says 172.21.15.157:37666) 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 -- 172.21.15.157:0/283926413 learned_addr learned my addr 172.21.15.157:0/283926413 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab89073700 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 0xd18790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab89874700 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 0xd33250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 -- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 msgr2=0xd18790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 0xd18790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 -- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 msgr2=0xd33250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 0xd33250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 -- 172.21.15.157:0/283926413 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab84149e70 con 0xd3a260 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab88872700 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd18cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab6c015410 tx=0x7fab6c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b710c99e8212260 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab63fff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab63fff700 1 -- 172.21.15.157:0/283926413 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c015e80 con 0xd3a260 2024-04-18T03:37:40.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab63fff700 1 -- 172.21.15.157:0/283926413 <== mon.0 v2:172.21.15.157:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab6c01c040 con 0xd3a260 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 1 -- 172.21.15.157:0/283926413 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xa8f1e0 con 0xd3a260 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab63fff700 1 -- 172.21.15.157:0/283926413 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab6c02b410 con 0xd3a260 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 10 client.4434 fetch_fsmap learned FSMap version 7 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 1 -- 172.21.15.157:0/283926413 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0xc20770 con 0xd3a260 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab63fff700 1 -- 172.21.15.157:0/283926413 <== mon.0 v2:172.21.15.157:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xa8f1e0 con 0xd3a260 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab63fff700 1 -- 172.21.15.157:0/283926413 <== mon.0 v2:172.21.15.157:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fab6c02b570 con 0xd3a260 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 10 client.4434 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 20 client.4434 populate_metadata read hostname 'smithi157' 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0xd32470 0xd4dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 4 client.4434 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab8e584740 1 -- 172.21.15.157:0/283926413 --> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xad9460 con 0xd32470 2024-04-18T03:37:40.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab89073700 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0xd32470 0xd4dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab63fff700 10 client.4434 ms_handle_connect on v2:172.21.15.175:6836/1564130449 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.959+0000 7fab89073700 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0xd32470 0xd4dcc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8803a94330e5afe server_cookie=ba519b4e1e12dc80 in_seq=0 out_seq=0 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab63fff700 1 -- 172.21.15.157:0/283926413 <== mds.0 v2:172.21.15.175:6836/1564130449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0xad9460 con 0xd32470 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab63fff700 10 client.4434 handle_command_reply: tid=0 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 client.4434 shutdown 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 -- 172.21.15.157:0/283926413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 msgr2=0xd18cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd18cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab6c015410 tx=0x7fab6c004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 -- 172.21.15.157:0/283926413 shutdown_connections 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0xd32470 0xd4dcc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 0xd33250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab63fff700 0 client.4434 ms_handle_reset on v2:172.21.15.175:6836/1564130449 2024-04-18T03:37:40.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3a260 0xd18cd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 --2- 172.21.15.157:0/283926413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 0xd18790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 -- 172.21.15.157:0/283926413 >> 172.21.15.157:0/283926413 conn(0xa824d0 msgr2=0xcee210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:40.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 -- 172.21.15.157:0/283926413 shutdown_connections 2024-04-18T03:37:40.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 1 -- 172.21.15.157:0/283926413 wait complete. 2024-04-18T03:37:40.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.963+0000 7fab8e584740 20 client.4434 trim_cache size 0 max 16384 2024-04-18T03:37:40.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab8e584740 1 Processor -- start 2024-04-18T03:37:40.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab8e584740 1 -- start start 2024-04-18T03:37:40.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab8e584740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 0xd3ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab8e584740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3a260 0xd3f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab8e584740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3ab80 0xd3fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab8e584740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0xd33650 con 0xd3ab80 2024-04-18T03:37:40.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab8e584740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0xcf3240 con 0xd3a260 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab8e584740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0xbf89c0 con 0xd192d0 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3ab80 0xd3fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3ab80 0xd3fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37682/0 (socket says 172.21.15.157:37682) 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 -- 172.21.15.157:0/2140007098 learned_addr learned my addr 172.21.15.157:0/2140007098 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89073700 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 0xd3ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab88872700 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3a260 0xd3f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 -- 172.21.15.157:0/2140007098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 msgr2=0xd3ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 0xd3ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 -- 172.21.15.157:0/2140007098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3a260 msgr2=0xd3f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3a260 0xd3f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 -- 172.21.15.157:0/2140007098 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc069a0 con 0xd3ab80 2024-04-18T03:37:40.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.987+0000 7fab89874700 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3ab80 0xd3fa00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab7c013000 tx=0x7fab7c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d883734fdd9831 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:40.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab7b7fe700 1 -- 172.21.15.157:0/2140007098 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c020040 con 0xd3ab80 2024-04-18T03:37:40.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab7b7fe700 1 -- 172.21.15.157:0/2140007098 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c011d00 con 0xd3ab80 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab7b7fe700 1 -- 172.21.15.157:0/2140007098 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0286a0 con 0xd3ab80 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 -- 172.21.15.157:0/2140007098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3ab80 msgr2=0xd3fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3ab80 0xd3fa00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab7c013000 tx=0x7fab7c010000 comp rx=0 tx=0).stop 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 -- 172.21.15.157:0/2140007098 shutdown_connections 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3a260 0xd3f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd3ab80 0xd3fa00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 --2- 172.21.15.157:0/2140007098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd192d0 0xd3ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 -- 172.21.15.157:0/2140007098 >> 172.21.15.157:0/2140007098 conn(0xa824d0 msgr2=0xd30c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 -- 172.21.15.157:0/2140007098 shutdown_connections 2024-04-18T03:37:40.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 -- 172.21.15.157:0/2140007098 wait complete. 2024-04-18T03:37:40.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 -- start start 2024-04-18T03:37:40.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.991+0000 7fab8e584740 1 Processor -- start 2024-04-18T03:37:40.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd192d0 0xd993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3a260 0xd57320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 0xd9a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0xd99930 con 0xd192d0 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0xd402f0 con 0xd3ab80 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0xd52570 con 0xd3a260 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 10 client.0 _ll_register_callbacks cb 0xc1e300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd192d0 0xd993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd192d0 0xd993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37686/0 (socket says 172.21.15.157:37686) 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 -- 172.21.15.157:0/2733182773 learned_addr learned my addr 172.21.15.157:0/2733182773 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab88872700 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3a260 0xd57320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89874700 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 0xd9a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 -- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3a260 msgr2=0xd57320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3a260 0xd57320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 -- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 msgr2=0xd9a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:40.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 0xd9a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 -- 172.21.15.157:0/2733182773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab84070fb0 con 0xd192d0 2024-04-18T03:37:41.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab89073700 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd192d0 0xd993f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab7400cb40 tx=0x7fab74004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8177f66bcff52cc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:41.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab63fff700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-04-18T03:37:41.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab63fff700 1 -- 172.21.15.157:0/2733182773 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7407d040 con 0xd192d0 2024-04-18T03:37:41.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab63fff700 1 -- 172.21.15.157:0/2733182773 <== mon.0 v2:172.21.15.157:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab7405d120 con 0xd192d0 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 -- 172.21.15.157:0/2733182773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xafe1e0 con 0xd192d0 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab63fff700 1 -- 172.21.15.157:0/2733182773 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab74054f90 con 0xd192d0 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 10 client.4440 fetch_fsmap learned FSMap version 7 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 -- 172.21.15.157:0/2733182773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0xbfac70 con 0xd192d0 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab63fff700 1 -- 172.21.15.157:0/2733182773 <== mon.0 v2:172.21.15.157:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xafe1e0 con 0xd192d0 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab63fff700 1 -- 172.21.15.157:0/2733182773 <== mon.0 v2:172.21.15.157:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fab74054220 con 0xd192d0 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 10 client.4440 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 20 client.4440 populate_metadata read hostname 'smithi157' 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0xd9ad80 0xd36db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 4 client.4440 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.995+0000 7fab8e584740 1 -- 172.21.15.157:0/2733182773 --> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] -- command(tid 0: {"prefix": "status"}) v1 -- 0xd18f30 con 0xd9ad80 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab88872700 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0xd9ad80 0xd36db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:41.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab63fff700 10 client.4440 ms_handle_connect on v2:172.21.15.175:6836/1564130449 2024-04-18T03:37:41.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab88872700 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0xd9ad80 0xd36db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a3eb1220afa86 server_cookie=b9633afb5de08a8d in_seq=0 out_seq=0 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab63fff700 1 -- 172.21.15.157:0/2733182773 <== mds.0 v2:172.21.15.175:6836/1564130449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0xd18f30 con 0xd9ad80 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab63fff700 10 client.4440 handle_command_reply: tid=0 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 client.4440 shutdown 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 -- 172.21.15.157:0/2733182773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd192d0 msgr2=0xd993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd192d0 0xd993f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab7400cb40 tx=0x7fab74004f90 comp rx=0 tx=0).stop 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 -- 172.21.15.157:0/2733182773 shutdown_connections 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0xd9ad80 0xd36db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0xd3ab80 0xd9a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0xd3a260 0xd57320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 --2- 172.21.15.157:0/2733182773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0xd192d0 0xd993f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab63fff700 0 client.4440 ms_handle_reset on v2:172.21.15.175:6836/1564130449 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 -- 172.21.15.157:0/2733182773 >> 172.21.15.157:0/2733182773 conn(0xa824d0 msgr2=0xd49ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:41.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 -- 172.21.15.157:0/2733182773 shutdown_connections 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 1 -- 172.21.15.157:0/2733182773 wait complete. 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8e584740 20 client.4440 trim_cache size 0 max 16384 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stdout: "cluster_fsid": "f4d3acd0-980f-44ff-9559-06e2da8e4de0", 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stdout: "whoami": 0, 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 4276, 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stdout: "want_state": "up:active", 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stdout: "state": "up:active", 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs", 2024-04-18T03:37:41.005 INFO:teuthology.orchestra.run.smithi157.stdout: "rank_uptime": 6.7254524330000001, 2024-04-18T03:37:41.006 INFO:teuthology.orchestra.run.smithi157.stdout: "mdsmap_epoch": 7, 2024-04-18T03:37:41.006 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_epoch": 25, 2024-04-18T03:37:41.006 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_epoch_barrier": 24, 2024-04-18T03:37:41.006 INFO:teuthology.orchestra.run.smithi157.stdout: "uptime": 12.955988799 2024-04-18T03:37:41.006 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 -- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab64066730 msgr2=0x7fab64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab64066730 0x7fab64068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab840c4030 tx=0x7fab6c00b040 comp rx=0 tx=0).stop 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 -- 172.21.15.157:0/2816195562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab84070a80 msgr2=0x7fab840c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab84070a80 0x7fab840c7310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c4e0 tx=0x7fab7400c7f0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 -- 172.21.15.157:0/2816195562 shutdown_connections 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab64066730 0x7fab64068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8415b030 0x7fab840b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab840cb9c0 0x7fab840b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 --2- 172.21.15.157:0/2816195562 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab84070a80 0x7fab840c7310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 -- 172.21.15.157:0/2816195562 >> 172.21.15.157:0/2816195562 conn(0x7fab840d0c20 msgr2=0x7fab840b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:41.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 -- 172.21.15.157:0/2816195562 shutdown_connections 2024-04-18T03:37:41.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:40.999+0000 7fab8a075700 1 -- 172.21.15.157:0/2816195562 wait complete. 2024-04-18T03:37:41.021 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T03:37:41.021 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-18T03:37:41.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T03:37:41.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.135+0000 7fed1537f700 1 Processor -- start 2024-04-18T03:37:41.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- start start 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fed100cb5d0 0x7fed100b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed100b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1006a7d0 con 0x7fed10071080 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100cb9b0 con 0x7fed100cb5d0 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed10161ff0 con 0x7fed10161a30 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed0f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fed10071080 0x7fed1006ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:46528/0 (socket says 172.21.15.157:46528) 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed0f7fe700 1 -- 172.21.15.157:0/3845934438 learned_addr learned my addr 172.21.15.157:0/3845934438 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed07fff700 1 --2- 172.21.15.157:0/3845934438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed100b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed0effd700 1 --2- 172.21.15.157:0/3845934438 >> v2:172.21.15.175:3300/0 conn(0x7fed100cb5d0 0x7fed100b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed0e7fc700 1 -- 172.21.15.157:0/3845934438 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265238937 0 0) 0x7fed1006a7d0 con 0x7fed10071080 2024-04-18T03:37:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed0e7fc700 1 -- 172.21.15.157:0/3845934438 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecfc0035d0 con 0x7fed10071080 2024-04-18T03:37:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed07fff700 1 -- 172.21.15.157:0/3845934438 >> v2:172.21.15.175:3300/0 conn(0x7fed100cb5d0 msgr2=0x7fed100b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed07fff700 1 --2- 172.21.15.157:0/3845934438 >> v2:172.21.15.175:3300/0 conn(0x7fed100cb5d0 0x7fed100b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed07fff700 1 -- 172.21.15.157:0/3845934438 >> v1:172.21.15.157:6789/0 conn(0x7fed10071080 legacy=0x7fed1006ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed07fff700 1 -- 172.21.15.157:0/3845934438 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed101622d0 con 0x7fed10161a30 2024-04-18T03:37:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed07fff700 1 --2- 172.21.15.157:0/3845934438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed100b1d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed00009850 tx=0x7fed00009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c7651d2c614056f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed0e7fc700 1 -- 172.21.15.157:0/3845934438 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00011830 con 0x7fed10161a30 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed0e7fc700 1 -- 172.21.15.157:0/3845934438 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed00011990 con 0x7fed10161a30 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed0e7fc700 1 -- 172.21.15.157:0/3845934438 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00011d40 con 0x7fed10161a30 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- 172.21.15.157:0/3845934438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 msgr2=0x7fed100b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 --2- 172.21.15.157:0/3845934438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed100b1d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed00009850 tx=0x7fed00009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- 172.21.15.157:0/3845934438 shutdown_connections 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 --2- 172.21.15.157:0/3845934438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed100b1d00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 --2- 172.21.15.157:0/3845934438 >> v2:172.21.15.175:3300/0 conn(0x7fed100cb5d0 0x7fed100b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- 172.21.15.157:0/3845934438 >> 172.21.15.157:0/3845934438 conn(0x7fed100b1170 msgr2=0x7fed1006e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- 172.21.15.157:0/3845934438 shutdown_connections 2024-04-18T03:37:41.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.139+0000 7fed1537f700 1 -- 172.21.15.157:0/3845934438 wait complete. 2024-04-18T03:37:41.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 Processor -- start 2024-04-18T03:37:41.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 -- start start 2024-04-18T03:37:41.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed10071080 0x7fed101f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:41.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed100cb5d0 0x7fed1015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:41.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed1015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:41.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1015a350 con 0x7fed100cb5d0 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed10159740 con 0x7fed10071080 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed10159a20 con 0x7fed10161a30 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed100cb5d0 0x7fed1015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed100cb5d0 0x7fed1015b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:37688/0 (socket says 172.21.15.157:37688) 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 -- 172.21.15.157:0/4030240094 learned_addr learned my addr 172.21.15.157:0/4030240094 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed0f7fe700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed1015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed0effd700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed10071080 0x7fed101f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 -- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 msgr2=0x7fed1015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed1015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 -- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed10071080 msgr2=0x7fed101f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed10071080 0x7fed101f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 -- 172.21.15.157:0/4030240094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed000094b0 con 0x7fed100cb5d0 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed07fff700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed100cb5d0 0x7fed1015b120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fed00014040 tx=0x7fed00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed077fe700 1 -- 172.21.15.157:0/4030240094 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000036c0 con 0x7fed100cb5d0 2024-04-18T03:37:41.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed077fe700 1 -- 172.21.15.157:0/4030240094 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0001e070 con 0x7fed100cb5d0 2024-04-18T03:37:41.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed10159d00 con 0x7fed100cb5d0 2024-04-18T03:37:41.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed077fe700 1 -- 172.21.15.157:0/4030240094 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00003a80 con 0x7fed100cb5d0 2024-04-18T03:37:41.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.143+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed101f68f0 con 0x7fed100cb5d0 2024-04-18T03:37:41.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.147+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1015a500 con 0x7fed100cb5d0 2024-04-18T03:37:41.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.147+0000 7fed077fe700 1 -- 172.21.15.157:0/4030240094 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fed00003be0 con 0x7fed100cb5d0 2024-04-18T03:37:41.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.147+0000 7fed077fe700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecf0066730 0x7fecf0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:41.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.147+0000 7fed077fe700 1 -- 172.21.15.157:0/4030240094 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed00020070 con 0x7fed100cb5d0 2024-04-18T03:37:41.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.147+0000 7fed0effd700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecf0066730 0x7fecf0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:41.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.151+0000 7fed0effd700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecf0066730 0x7fecf0068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009b80 tx=0x7fecf8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:41.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.155+0000 7fed077fe700 1 -- 172.21.15.157:0/4030240094 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fed00052be0 con 0x7fed100cb5d0 2024-04-18T03:37:41.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.359+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fed1015a500 con 0x7fed100cb5d0 2024-04-18T03:37:41.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.359+0000 7fed077fe700 1 -- 172.21.15.157:0/4030240094 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fed00015070 con 0x7fed100cb5d0 2024-04-18T03:37:41.364 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecf0066730 msgr2=0x7fecf0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecf0066730 0x7fecf0068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009b80 tx=0x7fecf8008040 comp rx=0 tx=0).stop 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed100cb5d0 msgr2=0x7fed1015b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed100cb5d0 0x7fed1015b120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fed00014040 tx=0x7fed00004770 comp rx=0 tx=0).stop 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 shutdown_connections 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecf0066730 0x7fecf0068bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed10161a30 0x7fed1015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fed100cb5d0 0x7fed1015b120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 --2- 172.21.15.157:0/4030240094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed10071080 0x7fed101f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 >> 172.21.15.157:0/4030240094 conn(0x7fed100b1170 msgr2=0x7fed100cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 shutdown_connections 2024-04-18T03:37:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:41.363+0000 7fed1537f700 1 -- 172.21.15.157:0/4030240094 wait complete. 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T03:37:41.379 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-18T03:37:41.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.380 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2024-04-18T03:37:41.386 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:37:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42609sec preferred_lft 42609sec 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 02:42:c1:95:ef:d6 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T03:37:41.388 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:37:41.389 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T03:37:41.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.389 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:37:41.389 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:37:41.389 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add name ceph-brx type bridge 2024-04-18T03:37:41.389 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr flush dev ceph-brx 2024-04-18T03:37:41.389 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set ceph-brx up 2024-04-18T03:37:41.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T03:37:41.390 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:37:41.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.480 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T03:37:41.491 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-04-18T03:37:41.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.493 DEBUG:teuthology.orchestra.run.smithi157:> route 2024-04-18T03:37:41.519 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2024-04-18T03:37:41.519 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T03:37:41.519 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T03:37:41.520 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T03:37:41.520 INFO:teuthology.orchestra.run.smithi157.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T03:37:41.520 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-04-18T03:37:41.520 INFO:teuthology.orchestra.run.smithi157.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T03:37:41.520 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T03:37:41.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.520 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:37:41.520 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:37:41.520 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T03:37:41.521 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T03:37:41.521 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T03:37:41.521 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:37:41.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.602 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-04-18T03:37:41.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.610 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2024-04-18T03:37:41.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.615 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:37:41.615 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:37:41.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-18T03:37:41.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-18T03:37:41.615 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:37:41.640 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-18T03:37:41.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.640 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:37:41.641 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:37:41.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-18T03:37:41.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T03:37:41.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-18T03:37:41.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-18T03:37:41.641 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-18T03:37:41.641 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:37:41.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.779 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:37:41.779 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:37:41.779 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2024-04-18T03:37:41.779 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T03:37:41.779 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:37:41.806 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-18T03:37:41.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:37:41.806 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-18T03:37:41.812 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-18T03:37:41.812 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:37:41.812 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-18T03:37:41.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:37:41.877 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:37:41.877 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:37:41.890 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:37:41.891 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:37:41.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.891 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:37:41.896 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T03:37:41.896 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-18T03:37:41.899 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:37:41.913 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:37:41.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:37:41.970 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:37:41.971 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:37:41.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:41.971 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:37:41.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi157.stderr:2024-04-18T03:37:41.987+0000 7fb4a2e29640 -1 init, newargv = 0x55a1d85d39d0 newargc=15 2024-04-18T03:37:41.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi157.stderr:ceph-fuse[30778]: starting ceph client 2024-04-18T03:37:41.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi157.stderr:ceph-fuse[30778]: starting fuse 2024-04-18T03:37:43.078 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:37:43.095 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:37:43.095 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:37:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:37:43.155 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:37:43.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:43.155 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:37:43.162 INFO:teuthology.orchestra.run.smithi157.stdout:52 2024-04-18T03:37:43.163 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> import glob 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> import re 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> import os 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> import subprocess 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> def _find_admin_socket(client_name): 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> files = glob.glob(asok_path) 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:37:43.163 DEBUG:teuthology.orchestra.run.smithi157:> # Given a non-glob path, it better be there 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> if "*" not in asok_path: 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> assert(len(files) == 1) 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> return files[0] 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> for f in files: 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> contents = proc_f.read() 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> if mountpoint in contents: 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> return f 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> print(_find_admin_socket("client.admin")) 2024-04-18T03:37:43.164 DEBUG:teuthology.orchestra.run.smithi157:> ' 2024-04-18T03:37:43.246 INFO:teuthology.orchestra.run.smithi157.stdout:/var/run/ceph/ceph-client.admin.30778.asok 2024-04-18T03:37:43.432 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.30778.asok 2024-04-18T03:37:43.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:43.432 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.30778.asok status 2024-04-18T03:37:43.534 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "metadata": { 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_sha1": "56a91dd158be807f143cc918a11685fc9ee164ae", 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 18.2.2-1229-g56a91dd1 (56a91dd158be807f143cc918a11685fc9ee164ae) reef (stable)", 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "entity_id": "admin", 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "hostname": "smithi157", 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "pid": "30778", 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "root": "/" 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_count": 0, 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_pinned_count": 0, 2024-04-18T03:37:43.535 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 4455, 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "inst": { 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "name": { 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "client", 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "num": 4455 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 1665952930 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2024-04-18T03:37:43.536 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 1665952930 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: "inst_str": "client.4455 192.168.0.1:0/1665952930", 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: "addr_str": "192.168.0.1:0/1665952930", 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: "inode_count": 1, 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_epoch": 7, 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch": 25, 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch_barrier": 0, 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: "blocklisted": false, 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs" 2024-04-18T03:37:43.537 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:37:43.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:43.544 DEBUG:teuthology.orchestra.run.smithi157:> stat --file-system '--printf=%T 2024-04-18T03:37:43.544 DEBUG:teuthology.orchestra.run.smithi157:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-18T03:37:43.550 INFO:teuthology.orchestra.run.smithi157.stdout:fuseblk 2024-04-18T03:37:43.550 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-18T03:37:43.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:43.551 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-18T03:37:43.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:43.562 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-18T03:37:43.615 INFO:teuthology.orchestra.run.smithi157.stdout:# file: . 2024-04-18T03:37:43.615 INFO:teuthology.orchestra.run.smithi157.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-18T03:37:43.615 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:43.616 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:43.616 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:37:43.624 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b2a66700 1 Processor -- start 2024-04-18T03:37:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b2a66700 1 -- start start 2024-04-18T03:37:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b2a66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac0c4090 0x7f83ac165770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b2a66700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f83ac0ce7f0 0x7f83ac070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b2a66700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ac0cf310 con 0x7f83ac1614e0 2024-04-18T03:37:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b2a66700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac165e70 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b2a66700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0ccfc0 con 0x7f83ac0c4090 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b1a64700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f83ac1614e0 0x7f83ac165060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42064/0 (socket says 172.21.15.157:42064) 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b1a64700 1 -- 172.21.15.157:0/2386857428 learned_addr learned my addr 172.21.15.157:0/2386857428 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b2265700 1 --2- 172.21.15.157:0/2386857428 >> v2:172.21.15.157:3300/0 conn(0x7f83ac0ce7f0 0x7f83ac070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.739+0000 7f83b1263700 1 --2- 172.21.15.157:0/2386857428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac0c4090 0x7f83ac165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b0a62700 1 -- 172.21.15.157:0/2386857428 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379065336 0 0) 0x7f83ac0cf310 con 0x7f83ac1614e0 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b0a62700 1 -- 172.21.15.157:0/2386857428 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83940035d0 con 0x7f83ac1614e0 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2265700 1 -- 172.21.15.157:0/2386857428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac0c4090 msgr2=0x7f83ac165770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2265700 1 --2- 172.21.15.157:0/2386857428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac0c4090 0x7f83ac165770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2265700 1 -- 172.21.15.157:0/2386857428 >> v1:172.21.15.157:6789/0 conn(0x7f83ac1614e0 legacy=0x7f83ac165060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2265700 1 -- 172.21.15.157:0/2386857428 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0cd2a0 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2265700 1 --2- 172.21.15.157:0/2386857428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac070a80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009d90 tx=0x7f83a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa7708114fca24f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b0a62700 1 -- 172.21.15.157:0/2386857428 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a400e070 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b0a62700 1 -- 172.21.15.157:0/2386857428 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a400bb20 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b0a62700 1 -- 172.21.15.157:0/2386857428 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4012430 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2a66700 1 -- 172.21.15.157:0/2386857428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 msgr2=0x7f83ac070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:43.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2a66700 1 --2- 172.21.15.157:0/2386857428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac070a80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009d90 tx=0x7f83a400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:43.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2a66700 1 -- 172.21.15.157:0/2386857428 shutdown_connections 2024-04-18T03:37:43.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2a66700 1 --2- 172.21.15.157:0/2386857428 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac070a80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2a66700 1 --2- 172.21.15.157:0/2386857428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac0c4090 0x7f83ac165770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2a66700 1 -- 172.21.15.157:0/2386857428 >> 172.21.15.157:0/2386857428 conn(0x7f83ac0d0c20 msgr2=0x7f83ac0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:43.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2a66700 1 -- 172.21.15.157:0/2386857428 shutdown_connections 2024-04-18T03:37:43.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.743+0000 7f83b2a66700 1 -- 172.21.15.157:0/2386857428 wait complete. 2024-04-18T03:37:43.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 Processor -- start 2024-04-18T03:37:43.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 -- start start 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83ac0c4090 0x7f83ac164330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac1614e0 0x7f83ac161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac164870 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0b29f0 con 0x7f83ac0c4090 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0c4720 con 0x7f83ac1614e0 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac15bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49302/0 (socket says 172.21.15.157:49302) 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 -- 172.21.15.157:0/872603535 learned_addr learned my addr 172.21.15.157:0/872603535 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1a64700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83ac0c4090 0x7f83ac164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2265700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac1614e0 0x7f83ac161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 -- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac1614e0 msgr2=0x7f83ac161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac1614e0 0x7f83ac161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 -- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83ac0c4090 msgr2=0x7f83ac164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83ac0c4090 0x7f83ac164330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 -- 172.21.15.157:0/872603535 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4009a70 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b1263700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac15bd90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f839c00e9d0 tx=0x7f839c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83aa7fc700 1 -- 172.21.15.157:0/872603535 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c009720 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ac0c4a00 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83aa7fc700 1 -- 172.21.15.157:0/872603535 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c00ee70 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83aa7fc700 1 -- 172.21.15.157:0/872603535 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00ca50 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.747+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ac0c4fc0 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.751+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ac04e650 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.751+0000 7f83aa7fc700 1 -- 172.21.15.157:0/872603535 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f839c00cbb0 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.751+0000 7f83aa7fc700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8398066730 0x7f8398068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.751+0000 7f83aa7fc700 1 -- 172.21.15.157:0/872603535 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f839c0844d0 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.751+0000 7f83b1a64700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8398066730 0x7f8398068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.751+0000 7f83b1a64700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8398066730 0x7f8398068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83a0007fd0 tx=0x7f83a0007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:43.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.759+0000 7f83aa7fc700 1 -- 172.21.15.157:0/872603535 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f839c0514d0 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.931+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83ac0cc760 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.931+0000 7f83aa7fc700 1 -- 172.21.15.157:0/872603535 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f839c00ce60 con 0x7f83ac0ce7f0 2024-04-18T03:37:43.936 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:43.936 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8398066730 msgr2=0x7f8398068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8398066730 0x7f8398068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83a0007fd0 tx=0x7f83a0007de0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 msgr2=0x7f83ac15bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac15bd90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f839c00e9d0 tx=0x7f839c00ece0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 shutdown_connections 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8398066730 0x7f8398068bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83ac1614e0 0x7f83ac161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83ac0ce7f0 0x7f83ac15bd90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 --2- 172.21.15.157:0/872603535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83ac0c4090 0x7f83ac164330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 >> 172.21.15.157:0/872603535 conn(0x7f83ac0d0c20 msgr2=0x7f83ac06b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 shutdown_connections 2024-04-18T03:37:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:43.935+0000 7f83b2a66700 1 -- 172.21.15.157:0/872603535 wait complete. 2024-04-18T03:37:43.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:37:43.951 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:37:44.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5759e700 1 Processor -- start 2024-04-18T03:37:44.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5759e700 1 -- start start 2024-04-18T03:37:44.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 0x7fcd58071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5759e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcd580d12b0 0x7fcd580d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5759e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd580719a0 con 0x7fcd58161660 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5759e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5806a770 con 0x7fcd580d12b0 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5806aa50 con 0x7fcd58071080 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd56d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcd580d12b0 0x7fcd580d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5659c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 0x7fcd58071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd56d9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcd580d12b0 0x7fcd580d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49314/0 (socket says 172.21.15.157:49314) 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd56d9d700 1 -- 172.21.15.157:0/1241313712 learned_addr learned my addr 172.21.15.157:0/1241313712 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd56d9d700 1 -- 172.21.15.157:0/1241313712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 msgr2=0x7fcd58071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd56d9d700 1 --2- 172.21.15.157:0/1241313712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 0x7fcd58071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd56d9d700 1 -- 172.21.15.157:0/1241313712 >> v1:172.21.15.175:6789/0 conn(0x7fcd58161660 legacy=0x7fcd5806c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd56d9d700 1 -- 172.21.15.157:0/1241313712 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5806ad30 con 0x7fcd580d12b0 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd56d9d700 1 --2- 172.21.15.157:0/1241313712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd580d1740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009e50 tx=0x7fcd5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffdba6115b82727 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5559a700 1 -- 172.21.15.157:0/1241313712 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000e070 con 0x7fcd580d12b0 2024-04-18T03:37:44.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5559a700 1 -- 172.21.15.157:0/1241313712 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5000b910 con 0x7fcd580d12b0 2024-04-18T03:37:44.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.059+0000 7fcd5559a700 1 -- 172.21.15.157:0/1241313712 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000bcc0 con 0x7fcd580d12b0 2024-04-18T03:37:44.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 -- 172.21.15.157:0/1241313712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 msgr2=0x7fcd580d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 --2- 172.21.15.157:0/1241313712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd580d1740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009e50 tx=0x7fcd5000b330 comp rx=0 tx=0).stop 2024-04-18T03:37:44.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 -- 172.21.15.157:0/1241313712 shutdown_connections 2024-04-18T03:37:44.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 --2- 172.21.15.157:0/1241313712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd580d1740 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 --2- 172.21.15.157:0/1241313712 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 0x7fcd58071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 -- 172.21.15.157:0/1241313712 >> 172.21.15.157:0/1241313712 conn(0x7fcd5806e020 msgr2=0x7fcd5806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:44.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 -- 172.21.15.157:0/1241313712 shutdown_connections 2024-04-18T03:37:44.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 -- 172.21.15.157:0/1241313712 wait complete. 2024-04-18T03:37:44.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 Processor -- start 2024-04-18T03:37:44.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 -- start start 2024-04-18T03:37:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.063+0000 7fcd5759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 0x7fcd5815f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5759e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd5814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd58161660 0x7fcd580c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5759e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580c8910 con 0x7fcd580d12b0 2024-04-18T03:37:44.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5759e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580c8b60 con 0x7fcd58161660 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580c8e40 con 0x7fcd58071080 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd5814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd5814b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49324/0 (socket says 172.21.15.157:49324) 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 -- 172.21.15.157:0/2172470540 learned_addr learned my addr 172.21.15.157:0/2172470540 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5659c700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 0x7fcd5815f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd56d9d700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd58161660 0x7fcd580c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 -- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 msgr2=0x7fcd5815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 0x7fcd5815f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 -- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd58161660 msgr2=0x7fcd580c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd58161660 0x7fcd580c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 -- 172.21.15.157:0/2172470540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009b30 con 0x7fcd580d12b0 2024-04-18T03:37:44.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd56d9d700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd58161660 0x7fcd580c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:44.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd55d9b700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd5814b690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c500 tx=0x7fcd4800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd4effd700 1 -- 172.21.15.157:0/2172470540 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd480052d0 con 0x7fcd580d12b0 2024-04-18T03:37:44.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd4effd700 1 -- 172.21.15.157:0/2172470540 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48005430 con 0x7fcd580d12b0 2024-04-18T03:37:44.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd580c9120 con 0x7fcd580d12b0 2024-04-18T03:37:44.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd4effd700 1 -- 172.21.15.157:0/2172470540 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd480055a0 con 0x7fcd580d12b0 2024-04-18T03:37:44.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5815f8e0 con 0x7fcd580d12b0 2024-04-18T03:37:44.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.067+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd580c9640 con 0x7fcd580d12b0 2024-04-18T03:37:44.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.071+0000 7fcd4effd700 1 -- 172.21.15.157:0/2172470540 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd480038e0 con 0x7fcd580d12b0 2024-04-18T03:37:44.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.071+0000 7fcd4effd700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd38066730 0x7fcd38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.071+0000 7fcd4effd700 1 -- 172.21.15.157:0/2172470540 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd48083820 con 0x7fcd580d12b0 2024-04-18T03:37:44.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.071+0000 7fcd5659c700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd38066730 0x7fcd38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.071+0000 7fcd5659c700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd38066730 0x7fcd38068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcd580b3110 tx=0x7fcd40009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.079+0000 7fcd4effd700 1 -- 172.21.15.157:0/2172470540 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcd580c9640 con 0x7fcd580d12b0 2024-04-18T03:37:44.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.247+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd580c9640 con 0x7fcd580d12b0 2024-04-18T03:37:44.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd4effd700 1 -- 172.21.15.157:0/2172470540 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd48017020 con 0x7fcd580d12b0 2024-04-18T03:37:44.253 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd38066730 msgr2=0x7fcd38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd38066730 0x7fcd38068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcd580b3110 tx=0x7fcd40009240 comp rx=0 tx=0).stop 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 msgr2=0x7fcd5814b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd5814b690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c500 tx=0x7fcd4800c810 comp rx=0 tx=0).stop 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 shutdown_connections 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd38066730 0x7fcd38068bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd58161660 0x7fcd580c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd580d12b0 0x7fcd5814b690 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 --2- 172.21.15.157:0/2172470540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd58071080 0x7fcd5815f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 >> 172.21.15.157:0/2172470540 conn(0x7fcd5806e020 msgr2=0x7fcd580b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:44.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 shutdown_connections 2024-04-18T03:37:44.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.251+0000 7fcd5759e700 1 -- 172.21.15.157:0/2172470540 wait complete. 2024-04-18T03:37:44.268 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:37:44.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f466c9e9700 1 Processor -- start 2024-04-18T03:37:44.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f466c9e9700 1 -- start start 2024-04-18T03:37:44.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f466c9e9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f4668168190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f466c9e9700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466806a770 con 0x7f4668161660 2024-04-18T03:37:44.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f466c9e9700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466806aa50 con 0x7f4668071080 2024-04-18T03:37:44.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f466c9e9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466806ad30 con 0x7f4668165da0 2024-04-18T03:37:44.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f4666ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4668161660 0x7f466806c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42072/0 (socket says 172.21.15.157:42072) 2024-04-18T03:37:44.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f4666ffd700 1 -- 172.21.15.157:0/2254233677 learned_addr learned my addr 172.21.15.157:0/2254233677 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:44.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f4667fff700 1 --2- 172.21.15.157:0/2254233677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f4668168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f46667fc700 1 -- 172.21.15.157:0/2254233677 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130376044 0 0) 0x7f466806a770 con 0x7f4668161660 2024-04-18T03:37:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f46667fc700 1 -- 172.21.15.157:0/2254233677 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46500035d0 con 0x7f4668161660 2024-04-18T03:37:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f46667fc700 1 -- 172.21.15.157:0/2254233677 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121050661 0 0) 0x7f466806aa50 con 0x7f4668071080 2024-04-18T03:37:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f46667fc700 1 -- 172.21.15.157:0/2254233677 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466806a770 con 0x7f4668071080 2024-04-18T03:37:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f4667fff700 1 -- 172.21.15.157:0/2254233677 >> v1:172.21.15.175:6789/0 conn(0x7f4668071080 legacy=0x7f4668071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f4667fff700 1 -- 172.21.15.157:0/2254233677 >> v1:172.21.15.157:6789/0 conn(0x7f4668161660 legacy=0x7f466806c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f4667fff700 1 -- 172.21.15.157:0/2254233677 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466806b010 con 0x7f4668165da0 2024-04-18T03:37:44.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.383+0000 7f4667fff700 1 --2- 172.21.15.157:0/2254233677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f4668168190 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4660009dc0 tx=0x7f466000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f752b87dd2559e40 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f46667fc700 1 -- 172.21.15.157:0/2254233677 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000e070 con 0x7f4668165da0 2024-04-18T03:37:44.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f46667fc700 1 -- 172.21.15.157:0/2254233677 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000bb20 con 0x7f4668165da0 2024-04-18T03:37:44.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f46667fc700 1 -- 172.21.15.157:0/2254233677 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660012430 con 0x7f4668165da0 2024-04-18T03:37:44.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f466c9e9700 1 -- 172.21.15.157:0/2254233677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 msgr2=0x7f4668168190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f466c9e9700 1 --2- 172.21.15.157:0/2254233677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f4668168190 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4660009dc0 tx=0x7f466000b330 comp rx=0 tx=0).stop 2024-04-18T03:37:44.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f466c9e9700 1 -- 172.21.15.157:0/2254233677 shutdown_connections 2024-04-18T03:37:44.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f466c9e9700 1 --2- 172.21.15.157:0/2254233677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f4668168190 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f466c9e9700 1 -- 172.21.15.157:0/2254233677 >> 172.21.15.157:0/2254233677 conn(0x7f466806e020 msgr2=0x7f466806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:44.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f466c9e9700 1 -- 172.21.15.157:0/2254233677 shutdown_connections 2024-04-18T03:37:44.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f466c9e9700 1 -- 172.21.15.157:0/2254233677 wait complete. 2024-04-18T03:37:44.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.387+0000 7f466c9e9700 1 Processor -- start 2024-04-18T03:37:44.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 -- start start 2024-04-18T03:37:44.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4668071080 0x7f4668162560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4668161660 0x7f466815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f46681502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46681f36c0 con 0x7f4668071080 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466815fdd0 con 0x7f4668161660 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466815f810 con 0x7f4668165da0 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f46677fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4668071080 0x7f4668162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f4667fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f46681502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f46677fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4668071080 0x7f4668162560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49338/0 (socket says 172.21.15.157:49338) 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f46677fe700 1 -- 172.21.15.157:0/534924891 learned_addr learned my addr 172.21.15.157:0/534924891 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f4666ffd700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4668161660 0x7f466815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f4667fff700 1 -- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4668161660 msgr2=0x7f466815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f4667fff700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4668161660 0x7f466815c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f4667fff700 1 -- 172.21.15.157:0/534924891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4668071080 msgr2=0x7f4668162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f4667fff700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4668071080 0x7f4668162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f4667fff700 1 -- 172.21.15.157:0/534924891 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009a70 con 0x7f4668165da0 2024-04-18T03:37:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f46677fe700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4668071080 0x7f4668162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f4667fff700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f46681502c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4660016000 tx=0x7f4660004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f464ffff700 1 -- 172.21.15.157:0/534924891 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660012430 con 0x7f4668165da0 2024-04-18T03:37:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f464ffff700 1 -- 172.21.15.157:0/534924891 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4660020070 con 0x7f4668165da0 2024-04-18T03:37:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f464ffff700 1 -- 172.21.15.157:0/534924891 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466001ba90 con 0x7f4668165da0 2024-04-18T03:37:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466815faf0 con 0x7f4668165da0 2024-04-18T03:37:44.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.391+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466815d820 con 0x7f4668165da0 2024-04-18T03:37:44.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.395+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466815eec0 con 0x7f4668165da0 2024-04-18T03:37:44.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.395+0000 7f464ffff700 1 -- 172.21.15.157:0/534924891 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f466001bbf0 con 0x7f4668165da0 2024-04-18T03:37:44.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.395+0000 7f464ffff700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4654066730 0x7f4654068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.395+0000 7f464ffff700 1 -- 172.21.15.157:0/534924891 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4660022070 con 0x7f4668165da0 2024-04-18T03:37:44.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.395+0000 7f46677fe700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4654066730 0x7f4654068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.399+0000 7f46677fe700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4654066730 0x7f4654068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46580011e0 tx=0x7f4658009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.407+0000 7f464ffff700 1 -- 172.21.15.157:0/534924891 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f46600538c0 con 0x7f4668165da0 2024-04-18T03:37:44.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f466804e650 con 0x7f4668165da0 2024-04-18T03:37:44.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f464ffff700 1 -- 172.21.15.157:0/534924891 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f466002c0a0 con 0x7f4668165da0 2024-04-18T03:37:44.578 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4654066730 msgr2=0x7f4654068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4654066730 0x7f4654068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46580011e0 tx=0x7f4658009040 comp rx=0 tx=0).stop 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 msgr2=0x7f46681502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f46681502c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4660016000 tx=0x7f4660004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 shutdown_connections 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4654066730 0x7f4654068bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4668161660 0x7f466815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4668165da0 0x7f46681502c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 --2- 172.21.15.157:0/534924891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4668071080 0x7f4668162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.575+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 >> 172.21.15.157:0/534924891 conn(0x7f466806e020 msgr2=0x7f466806e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:44.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.579+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 shutdown_connections 2024-04-18T03:37:44.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.579+0000 7f466c9e9700 1 -- 172.21.15.157:0/534924891 wait complete. 2024-04-18T03:37:44.593 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:37:44.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcee9c700 1 Processor -- start 2024-04-18T03:37:44.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcee9c700 1 -- start start 2024-04-18T03:37:44.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcee9c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc00507d0 0x7f0bc00dfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcee9c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bc004ff30 0x7f0bc00335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcee9c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00e0600 con 0x7f0bc00e0160 2024-04-18T03:37:44.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcee9c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc00d6b70 con 0x7f0bc004ff30 2024-04-18T03:37:44.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcee9c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00e0bc0 con 0x7f0bc00507d0 2024-04-18T03:37:44.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcd699700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0bc00e0160 0x7f0bc00067d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42078/0 (socket says 172.21.15.157:42078) 2024-04-18T03:37:44.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcd699700 1 -- 172.21.15.157:0/722274086 learned_addr learned my addr 172.21.15.157:0/722274086 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:44.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bce69b700 1 --2- 172.21.15.157:0/722274086 >> v2:172.21.15.157:3300/0 conn(0x7f0bc004ff30 0x7f0bc00335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.703+0000 7f0bcde9a700 1 --2- 172.21.15.157:0/722274086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc00507d0 0x7f0bc00dfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bce69b700 1 -- 172.21.15.157:0/722274086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc00507d0 msgr2=0x7f0bc00dfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:44.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bce69b700 1 --2- 172.21.15.157:0/722274086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc00507d0 0x7f0bc00dfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bce69b700 1 -- 172.21.15.157:0/722274086 >> v1:172.21.15.157:6789/0 conn(0x7f0bc00e0160 legacy=0x7f0bc00067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bce69b700 1 -- 172.21.15.157:0/722274086 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00e08e0 con 0x7f0bc004ff30 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bce69b700 1 --2- 172.21.15.157:0/722274086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc004ff30 0x7f0bc00335c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009850 tx=0x7f0bc4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adaae440a647f09 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcce98700 1 -- 172.21.15.157:0/722274086 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4011830 con 0x7f0bc004ff30 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcce98700 1 -- 172.21.15.157:0/722274086 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4011990 con 0x7f0bc004ff30 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcce98700 1 -- 172.21.15.157:0/722274086 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4011d40 con 0x7f0bc004ff30 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 -- 172.21.15.157:0/722274086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc004ff30 msgr2=0x7f0bc00335c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/722274086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc004ff30 0x7f0bc00335c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009850 tx=0x7f0bc4009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 -- 172.21.15.157:0/722274086 shutdown_connections 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/722274086 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc004ff30 0x7f0bc00335c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/722274086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc00507d0 0x7f0bc00dfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 -- 172.21.15.157:0/722274086 >> 172.21.15.157:0/722274086 conn(0x7f0bc0054b70 msgr2=0x7f0bc0054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 -- 172.21.15.157:0/722274086 shutdown_connections 2024-04-18T03:37:44.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 -- 172.21.15.157:0/722274086 wait complete. 2024-04-18T03:37:44.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 Processor -- start 2024-04-18T03:37:44.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 -- start start 2024-04-18T03:37:44.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc004ff30 0x7f0bc00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc00507d0 0x7f0bc00d2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.707+0000 7f0bcee9c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc00e0160 0x7f0bc0053870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bcee9c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc017cf90 con 0x7f0bc00e0160 2024-04-18T03:37:44.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bcee9c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00d10c0 con 0x7f0bc00507d0 2024-04-18T03:37:44.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bcee9c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc017c380 con 0x7f0bc004ff30 2024-04-18T03:37:44.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc00e0160 0x7f0bc0053870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc00e0160 0x7f0bc0053870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49354/0 (socket says 172.21.15.157:49354) 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 -- 172.21.15.157:0/2048575908 learned_addr learned my addr 172.21.15.157:0/2048575908 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bcd699700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc00507d0 0x7f0bc00d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bcde9a700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc004ff30 0x7f0bc00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 -- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc004ff30 msgr2=0x7f0bc00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc004ff30 0x7f0bc00d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 -- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc00507d0 msgr2=0x7f0bc00d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc00507d0 0x7f0bc00d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 -- 172.21.15.157:0/2048575908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40094b0 con 0x7f0bc00e0160 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bce69b700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc00e0160 0x7f0bc0053870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000bb00 tx=0x7f0bc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bba7fc700 1 -- 172.21.15.157:0/2048575908 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4004400 con 0x7f0bc00e0160 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bba7fc700 1 -- 172.21.15.157:0/2048575908 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc401f070 con 0x7f0bc00e0160 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc017c660 con 0x7f0bc00e0160 2024-04-18T03:37:44.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bba7fc700 1 -- 172.21.15.157:0/2048575908 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4003900 con 0x7f0bc00e0160 2024-04-18T03:37:44.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc017cc20 con 0x7f0bc00e0160 2024-04-18T03:37:44.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.711+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc017d140 con 0x7f0bc00e0160 2024-04-18T03:37:44.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.715+0000 7f0bba7fc700 1 -- 172.21.15.157:0/2048575908 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0bc4021030 con 0x7f0bc00e0160 2024-04-18T03:37:44.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.715+0000 7f0bba7fc700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0bac066730 0x7f0bac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:44.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.715+0000 7f0bba7fc700 1 -- 172.21.15.157:0/2048575908 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0bc4085770 con 0x7f0bc00e0160 2024-04-18T03:37:44.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.715+0000 7f0bcde9a700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0bac066730 0x7f0bac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:44.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.715+0000 7f0bcde9a700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0bac066730 0x7f0bac068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8067f10 tx=0x7f0bc8061d00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:44.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.723+0000 7f0bba7fc700 1 -- 172.21.15.157:0/2048575908 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0bc017d140 con 0x7f0bc00e0160 2024-04-18T03:37:44.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.887+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0bc017d140 con 0x7f0bc00e0160 2024-04-18T03:37:44.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.891+0000 7f0bba7fc700 1 -- 172.21.15.157:0/2048575908 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0bc4052880 con 0x7f0bc00e0160 2024-04-18T03:37:44.893 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0bac066730 msgr2=0x7f0bac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0bac066730 0x7f0bac068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8067f10 tx=0x7f0bc8061d00 comp rx=0 tx=0).stop 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc00e0160 msgr2=0x7f0bc0053870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc00e0160 0x7f0bc0053870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000bb00 tx=0x7f0bc4004770 comp rx=0 tx=0).stop 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 shutdown_connections 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0bac066730 0x7f0bac068bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc00507d0 0x7f0bc00d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc00e0160 0x7f0bc0053870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 --2- 172.21.15.157:0/2048575908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0bc004ff30 0x7f0bc00d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 >> 172.21.15.157:0/2048575908 conn(0x7f0bc0054b70 msgr2=0x7f0bc004ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:44.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 shutdown_connections 2024-04-18T03:37:44.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:44.895+0000 7f0bcee9c700 1 -- 172.21.15.157:0/2048575908 wait complete. 2024-04-18T03:37:44.912 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:37:45.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.027+0000 7f363ec9f700 1 Processor -- start 2024-04-18T03:37:45.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.027+0000 7f363ec9f700 1 -- start start 2024-04-18T03:37:45.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.027+0000 7f363ec9f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f36380cc180 0x7f36380cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.027+0000 7f363ec9f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36380cde30 0x7f36380ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363815c1e0 con 0x7f3638155200 2024-04-18T03:37:45.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363815b660 con 0x7f36380cc180 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363815b940 con 0x7f36380cde30 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363d49c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f36380cc180 0x7f36380cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363d49c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f36380cc180 0x7f36380cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49362/0 (socket says 172.21.15.157:49362) 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363d49c700 1 -- 172.21.15.157:0/2037685424 learned_addr learned my addr 172.21.15.157:0/2037685424 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363dc9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3638155200 0x7f3638070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42082/0 (socket says 172.21.15.157:42082) 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363e49e700 1 --2- 172.21.15.157:0/2037685424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36380cde30 0x7f36380ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363d49c700 1 -- 172.21.15.157:0/2037685424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36380cde30 msgr2=0x7f36380ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363d49c700 1 --2- 172.21.15.157:0/2037685424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36380cde30 0x7f36380ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363d49c700 1 -- 172.21.15.157:0/2037685424 >> v1:172.21.15.157:6789/0 conn(0x7f3638155200 legacy=0x7f3638070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363d49c700 1 -- 172.21.15.157:0/2037685424 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363815bc20 con 0x7f36380cc180 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363d49c700 1 --2- 172.21.15.157:0/2037685424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f36380cc630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3628009e50 tx=0x7f362800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafc5a448f25e1e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363cc9b700 1 -- 172.21.15.157:0/2037685424 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800e070 con 0x7f36380cc180 2024-04-18T03:37:45.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363cc9b700 1 -- 172.21.15.157:0/2037685424 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362800b9c0 con 0x7f36380cc180 2024-04-18T03:37:45.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363cc9b700 1 -- 172.21.15.157:0/2037685424 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800bd70 con 0x7f36380cc180 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- 172.21.15.157:0/2037685424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 msgr2=0x7f36380cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 --2- 172.21.15.157:0/2037685424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f36380cc630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3628009e50 tx=0x7f362800b330 comp rx=0 tx=0).stop 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- 172.21.15.157:0/2037685424 shutdown_connections 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 --2- 172.21.15.157:0/2037685424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36380cde30 0x7f36380ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 --2- 172.21.15.157:0/2037685424 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f36380cc630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- 172.21.15.157:0/2037685424 >> 172.21.15.157:0/2037685424 conn(0x7f36380cef60 msgr2=0x7f36380cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- 172.21.15.157:0/2037685424 shutdown_connections 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- 172.21.15.157:0/2037685424 wait complete. 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 Processor -- start 2024-04-18T03:37:45.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.031+0000 7f363ec9f700 1 -- start start 2024-04-18T03:37:45.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f3638140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36380cde30 0x7f3638156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3638155200 0x7f3638141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3638157960 con 0x7f36380cc180 2024-04-18T03:37:45.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3638157c40 con 0x7f36380cde30 2024-04-18T03:37:45.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3638157f20 con 0x7f3638155200 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f3638140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f3638140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49374/0 (socket says 172.21.15.157:49374) 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 -- 172.21.15.157:0/3817344752 learned_addr learned my addr 172.21.15.157:0/3817344752 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363d49c700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36380cde30 0x7f3638156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363e49e700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3638155200 0x7f3638141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 -- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3638155200 msgr2=0x7f3638141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3638155200 0x7f3638141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 -- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36380cde30 msgr2=0x7f3638156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36380cde30 0x7f3638156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 -- 172.21.15.157:0/3817344752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3628009b30 con 0x7f36380cc180 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363d49c700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36380cde30 0x7f3638156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363e49e700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3638155200 0x7f3638141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363dc9d700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f3638140e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f363400c460 tx=0x7f363400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f362e7fc700 1 -- 172.21.15.157:0/3817344752 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634005cd0 con 0x7f36380cc180 2024-04-18T03:37:45.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f362e7fc700 1 -- 172.21.15.157:0/3817344752 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3634005e30 con 0x7f36380cc180 2024-04-18T03:37:45.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3638158200 con 0x7f36380cc180 2024-04-18T03:37:45.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f362e7fc700 1 -- 172.21.15.157:0/3817344752 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340072d0 con 0x7f36380cc180 2024-04-18T03:37:45.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3638141350 con 0x7f36380cc180 2024-04-18T03:37:45.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3638158720 con 0x7f36380cc180 2024-04-18T03:37:45.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.035+0000 7f362e7fc700 1 -- 172.21.15.157:0/3817344752 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3634007430 con 0x7f36380cc180 2024-04-18T03:37:45.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.039+0000 7f362e7fc700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3624066730 0x7f3624068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.039+0000 7f362e7fc700 1 -- 172.21.15.157:0/3817344752 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3634083780 con 0x7f36380cc180 2024-04-18T03:37:45.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.039+0000 7f363d49c700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3624066730 0x7f3624068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.039+0000 7f363d49c700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3624066730 0x7f3624068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f36381544a0 tx=0x7f3628009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.043+0000 7f362e7fc700 1 -- 172.21.15.157:0/3817344752 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3638158720 con 0x7f36380cc180 2024-04-18T03:37:45.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.207+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3638158720 con 0x7f36380cc180 2024-04-18T03:37:45.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f362e7fc700 1 -- 172.21.15.157:0/3817344752 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3634017020 con 0x7f36380cc180 2024-04-18T03:37:45.213 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:37:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3624066730 msgr2=0x7f3624068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3624066730 0x7f3624068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f36381544a0 tx=0x7f3628009000 comp rx=0 tx=0).stop 2024-04-18T03:37:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 msgr2=0x7f3638140e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f3638140e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f363400c460 tx=0x7f363400c820 comp rx=0 tx=0).stop 2024-04-18T03:37:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 shutdown_connections 2024-04-18T03:37:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3624066730 0x7f3624068bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36380cde30 0x7f3638156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3638155200 0x7f3638141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 --2- 172.21.15.157:0/3817344752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36380cc180 0x7f3638140e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 >> 172.21.15.157:0/3817344752 conn(0x7f36380cef60 msgr2=0x7f363815c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:45.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 shutdown_connections 2024-04-18T03:37:45.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.211+0000 7f363ec9f700 1 -- 172.21.15.157:0/3817344752 wait complete. 2024-04-18T03:37:45.233 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:37:45.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b9eeb700 1 Processor -- start 2024-04-18T03:37:45.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b9eeb700 1 -- start start 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b9eeb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b4071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b9eeb700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f34b4161660 0x7f34b406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b9eeb700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40719a0 con 0x7f34b40b5f90 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b9eeb700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b406a770 con 0x7f34b4161660 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b9eeb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b406aa50 con 0x7f34b4071080 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b96ea700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f34b40b5f90 0x7f34b40b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42092/0 (socket says 172.21.15.157:42092) 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b96ea700 1 -- 172.21.15.157:0/942393310 learned_addr learned my addr 172.21.15.157:0/942393310 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b8ee9700 1 --2- 172.21.15.157:0/942393310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b4071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b3fff700 1 --2- 172.21.15.157:0/942393310 >> v2:172.21.15.175:3300/0 conn(0x7f34b4161660 0x7f34b406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b37fe700 1 -- 172.21.15.157:0/942393310 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488812343 0 0) 0x7f34b40719a0 con 0x7f34b40b5f90 2024-04-18T03:37:45.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b37fe700 1 -- 172.21.15.157:0/942393310 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a00035d0 con 0x7f34b40b5f90 2024-04-18T03:37:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b3fff700 1 -- 172.21.15.157:0/942393310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 msgr2=0x7f34b4071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b3fff700 1 --2- 172.21.15.157:0/942393310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b4071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b3fff700 1 -- 172.21.15.157:0/942393310 >> v1:172.21.15.157:6789/0 conn(0x7f34b40b5f90 legacy=0x7f34b40b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b3fff700 1 -- 172.21.15.157:0/942393310 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b406ad30 con 0x7f34b4161660 2024-04-18T03:37:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b3fff700 1 --2- 172.21.15.157:0/942393310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 0x7f34b406c3a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f349c009850 tx=0x7f349c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d859ea490ce48283 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b37fe700 1 -- 172.21.15.157:0/942393310 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011830 con 0x7f34b4161660 2024-04-18T03:37:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b37fe700 1 -- 172.21.15.157:0/942393310 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c011990 con 0x7f34b4161660 2024-04-18T03:37:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.347+0000 7f34b37fe700 1 -- 172.21.15.157:0/942393310 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c011d40 con 0x7f34b4161660 2024-04-18T03:37:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- 172.21.15.157:0/942393310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 msgr2=0x7f34b406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/942393310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 0x7f34b406c3a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f349c009850 tx=0x7f349c009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- 172.21.15.157:0/942393310 shutdown_connections 2024-04-18T03:37:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/942393310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 0x7f34b406c3a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/942393310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b4071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- 172.21.15.157:0/942393310 >> 172.21.15.157:0/942393310 conn(0x7f34b406e020 msgr2=0x7f34b406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- 172.21.15.157:0/942393310 shutdown_connections 2024-04-18T03:37:45.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- 172.21.15.157:0/942393310 wait complete. 2024-04-18T03:37:45.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 Processor -- start 2024-04-18T03:37:45.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- start start 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b41570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34b40b5f90 0x7f34b41578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 0x7f34b415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b41e9530 con 0x7f34b40b5f90 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b4157e10 con 0x7f34b4161660 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b9eeb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b4156c50 con 0x7f34b4071080 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34b40b5f90 0x7f34b41578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34b40b5f90 0x7f34b41578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49378/0 (socket says 172.21.15.157:49378) 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.351+0000 7f34b3fff700 1 -- 172.21.15.157:0/794950907 learned_addr learned my addr 172.21.15.157:0/794950907 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b8ee9700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b41570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b96ea700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 0x7f34b415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b3fff700 1 -- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 msgr2=0x7f34b41570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b3fff700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b41570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b3fff700 1 -- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 msgr2=0x7f34b415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b3fff700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 0x7f34b415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b3fff700 1 -- 172.21.15.157:0/794950907 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0094b0 con 0x7f34b40b5f90 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b8ee9700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b41570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b3fff700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34b40b5f90 0x7f34b41578d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f349c014040 tx=0x7f349c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b17fa700 1 -- 172.21.15.157:0/794950907 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0036c0 con 0x7f34b40b5f90 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b17fa700 1 -- 172.21.15.157:0/794950907 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c01e070 con 0x7f34b40b5f90 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b4156360 con 0x7f34b40b5f90 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b17fa700 1 -- 172.21.15.157:0/794950907 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c003a80 con 0x7f34b40b5f90 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b41568e0 con 0x7f34b40b5f90 2024-04-18T03:37:45.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b404e650 con 0x7f34b40b5f90 2024-04-18T03:37:45.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.355+0000 7f34b17fa700 1 -- 172.21.15.157:0/794950907 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f349c003be0 con 0x7f34b40b5f90 2024-04-18T03:37:45.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.359+0000 7f34b17fa700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3494066730 0x7f3494068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.359+0000 7f34b17fa700 1 -- 172.21.15.157:0/794950907 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f349c020070 con 0x7f34b40b5f90 2024-04-18T03:37:45.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.359+0000 7f34b8ee9700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3494066730 0x7f3494068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.359+0000 7f34b8ee9700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3494066730 0x7f3494068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009fd0 tx=0x7f34a400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.367+0000 7f34b17fa700 1 -- 172.21.15.157:0/794950907 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f349c0529a0 con 0x7f34b40b5f90 2024-04-18T03:37:45.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.543+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f34b4156a70 con 0x7f34b40b5f90 2024-04-18T03:37:45.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.543+0000 7f34b17fa700 1 -- 172.21.15.157:0/794950907 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f349c006ce0 con 0x7f34b40b5f90 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3494066730 msgr2=0x7f3494068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3494066730 0x7f3494068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009fd0 tx=0x7f34a400b040 comp rx=0 tx=0).stop 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34b40b5f90 msgr2=0x7f34b41578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34b40b5f90 0x7f34b41578d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f349c014040 tx=0x7f349c004770 comp rx=0 tx=0).stop 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 shutdown_connections 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3494066730 0x7f3494068bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b4161660 0x7f34b415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34b40b5f90 0x7f34b41578d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 --2- 172.21.15.157:0/794950907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b4071080 0x7f34b41570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 >> 172.21.15.157:0/794950907 conn(0x7f34b406e020 msgr2=0x7f34b40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:45.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 shutdown_connections 2024-04-18T03:37:45.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.547+0000 7f34b9eeb700 1 -- 172.21.15.157:0/794950907 wait complete. 2024-04-18T03:37:45.551 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:37:45.562 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:37:45.562 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:37:45.570 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:45.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e87c700 1 Processor -- start 2024-04-18T03:37:45.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e87c700 1 -- start start 2024-04-18T03:37:45.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e87c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa96815d3b0 0x7fa96815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e87c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96815bf10 con 0x7fa9680adf00 2024-04-18T03:37:45.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e87c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680ae2e0 con 0x7fa968071890 2024-04-18T03:37:45.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e87c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96815b5c0 con 0x7fa96815d3b0 2024-04-18T03:37:45.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96d87a700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa9680adf00 0x7fa968071180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42094/0 (socket says 172.21.15.157:42094) 2024-04-18T03:37:45.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96d87a700 1 -- 172.21.15.157:0/2809201240 learned_addr learned my addr 172.21.15.157:0/2809201240 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e07b700 1 --2- 172.21.15.157:0/2809201240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa96815d3b0 0x7fa96815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96c878700 1 -- 172.21.15.157:0/2809201240 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160105545 0 0) 0x7fa96815bf10 con 0x7fa9680adf00 2024-04-18T03:37:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96c878700 1 -- 172.21.15.157:0/2809201240 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9540035d0 con 0x7fa9680adf00 2024-04-18T03:37:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96c878700 1 -- 172.21.15.157:0/2809201240 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703193082 0 0) 0x7fa9680ae2e0 con 0x7fa968071890 2024-04-18T03:37:45.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96c878700 1 -- 172.21.15.157:0/2809201240 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa96815bf10 con 0x7fa968071890 2024-04-18T03:37:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96c878700 1 -- 172.21.15.157:0/2809201240 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1534967000 0 0) 0x7fa9540035d0 con 0x7fa9680adf00 2024-04-18T03:37:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e07b700 1 -- 172.21.15.157:0/2809201240 >> v1:172.21.15.175:6789/0 conn(0x7fa968071890 legacy=0x7fa96815a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e07b700 1 -- 172.21.15.157:0/2809201240 >> v1:172.21.15.157:6789/0 conn(0x7fa9680adf00 legacy=0x7fa968071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.679+0000 7fa96e07b700 1 -- 172.21.15.157:0/2809201240 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96815b2e0 con 0x7fa96815d3b0 2024-04-18T03:37:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96e07b700 1 --2- 172.21.15.157:0/2809201240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa96815d3b0 0x7fa96815ac90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa960009dc0 tx=0x7fa96000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8449dc100bed7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96c878700 1 -- 172.21.15.157:0/2809201240 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000e070 con 0x7fa96815d3b0 2024-04-18T03:37:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96c878700 1 -- 172.21.15.157:0/2809201240 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960003a40 con 0x7fa96815d3b0 2024-04-18T03:37:45.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96c878700 1 -- 172.21.15.157:0/2809201240 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9640015f0 con 0x7fa96815d3b0 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96e87c700 1 -- 172.21.15.157:0/2809201240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa96815d3b0 msgr2=0x7fa96815ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96e87c700 1 --2- 172.21.15.157:0/2809201240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa96815d3b0 0x7fa96815ac90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa960009dc0 tx=0x7fa96000b330 comp rx=0 tx=0).stop 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96e87c700 1 -- 172.21.15.157:0/2809201240 shutdown_connections 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96e87c700 1 --2- 172.21.15.157:0/2809201240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa96815d3b0 0x7fa96815ac90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96e87c700 1 -- 172.21.15.157:0/2809201240 >> 172.21.15.157:0/2809201240 conn(0x7fa9680b1330 msgr2=0x7fa96806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96e87c700 1 -- 172.21.15.157:0/2809201240 shutdown_connections 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.683+0000 7fa96e87c700 1 -- 172.21.15.157:0/2809201240 wait complete. 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e87c700 1 Processor -- start 2024-04-18T03:37:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e87c700 1 -- start start 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e87c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa968071890 0x7fa96813f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e87c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680adf00 0x7fa96813c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e87c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815d3b0 0x7fa968143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e87c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96813fcd0 con 0x7fa968071890 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e87c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96813e120 con 0x7fa96815d3b0 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e87c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96813e400 con 0x7fa9680adf00 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d87a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa968071890 0x7fa96813f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d87a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa968071890 0x7fa96813f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49382/0 (socket says 172.21.15.157:49382) 2024-04-18T03:37:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d87a700 1 -- 172.21.15.157:0/137277224 learned_addr learned my addr 172.21.15.157:0/137277224 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d079700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680adf00 0x7fa96813c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e07b700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815d3b0 0x7fa968143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d87a700 1 -- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680adf00 msgr2=0x7fa96813c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d87a700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680adf00 0x7fa96813c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d87a700 1 -- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815d3b0 msgr2=0x7fa968143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d87a700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815d3b0 0x7fa968143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d87a700 1 -- 172.21.15.157:0/137277224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960009a70 con 0x7fa968071890 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96e07b700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815d3b0 0x7fa968143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.687+0000 7fa96d079700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680adf00 0x7fa96813c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa96d87a700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa968071890 0x7fa96813f640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa96400c700 tx=0x7fa96400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa95e7fc700 1 -- 172.21.15.157:0/137277224 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964004ca0 con 0x7fa968071890 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa95e7fc700 1 -- 172.21.15.157:0/137277224 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa964004e20 con 0x7fa968071890 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96813e6e0 con 0x7fa968071890 2024-04-18T03:37:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa95e7fc700 1 -- 172.21.15.157:0/137277224 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964007310 con 0x7fa968071890 2024-04-18T03:37:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96813d9e0 con 0x7fa968071890 2024-04-18T03:37:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96813ec00 con 0x7fa968071890 2024-04-18T03:37:45.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa95e7fc700 1 -- 172.21.15.157:0/137277224 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa964007470 con 0x7fa968071890 2024-04-18T03:37:45.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa95e7fc700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa94c066760 0x7fa94c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:45.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.691+0000 7fa95e7fc700 1 -- 172.21.15.157:0/137277224 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa964084250 con 0x7fa968071890 2024-04-18T03:37:45.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.695+0000 7fa96d079700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa94c066760 0x7fa94c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:45.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.695+0000 7fa96d079700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa94c066760 0x7fa94c068c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa96815cf80 tx=0x7fa958009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:45.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.703+0000 7fa95e7fc700 1 -- 172.21.15.157:0/137277224 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa96813ec00 con 0x7fa968071890 2024-04-18T03:37:45.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.871+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa96813ec00 con 0x7fa968071890 2024-04-18T03:37:45.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa95e7fc700 1 -- 172.21.15.157:0/137277224 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fa96813ec00 con 0x7fa968071890 2024-04-18T03:37:45.878 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:45.879 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:45.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa94c066760 msgr2=0x7fa94c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa94c066760 0x7fa94c068c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa96815cf80 tx=0x7fa958009040 comp rx=0 tx=0).stop 2024-04-18T03:37:45.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa968071890 msgr2=0x7fa96813f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:45.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa968071890 0x7fa96813f640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa96400c700 tx=0x7fa96400cac0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 shutdown_connections 2024-04-18T03:37:45.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa94c066760 0x7fa94c068c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815d3b0 0x7fa968143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680adf00 0x7fa96813c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 --2- 172.21.15.157:0/137277224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa968071890 0x7fa96813f640 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:45.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 >> 172.21.15.157:0/137277224 conn(0x7fa9680b1330 msgr2=0x7fa968071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:45.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 shutdown_connections 2024-04-18T03:37:45.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:45.875+0000 7fa96e87c700 1 -- 172.21.15.157:0/137277224 wait complete. 2024-04-18T03:37:45.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:37:45.894 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:37:46.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.015+0000 7feebee2c700 1 Processor -- start 2024-04-18T03:37:46.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.015+0000 7feebee2c700 1 -- start start 2024-04-18T03:37:46.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feeb806cf60 0x7feeb80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80ce580 con 0x7feeb806cb00 2024-04-18T03:37:46.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80ce860 con 0x7feeb8143970 2024-04-18T03:37:46.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb80ceb40 con 0x7feeb806cf60 2024-04-18T03:37:46.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebd629700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7feeb806cb00 0x7feeb80b2c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42106/0 (socket says 172.21.15.157:42106) 2024-04-18T03:37:46.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebd629700 1 -- 172.21.15.157:0/10553234 learned_addr learned my addr 172.21.15.157:0/10553234 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebe62b700 1 --2- 172.21.15.157:0/10553234 >> v2:172.21.15.175:3300/0 conn(0x7feeb806cf60 0x7feeb80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebce28700 1 -- 172.21.15.157:0/10553234 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686697593 0 0) 0x7feeb80ce580 con 0x7feeb806cb00 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebce28700 1 -- 172.21.15.157:0/10553234 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea40035d0 con 0x7feeb806cb00 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebce28700 1 -- 172.21.15.157:0/10553234 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946190655 0 0) 0x7feeb80ce860 con 0x7feeb8143970 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebce28700 1 -- 172.21.15.157:0/10553234 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb80ce580 con 0x7feeb8143970 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebe62b700 1 -- 172.21.15.157:0/10553234 >> v1:172.21.15.175:6789/0 conn(0x7feeb8143970 legacy=0x7feeb806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebce28700 1 -- 172.21.15.157:0/10553234 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276354878 0 0) 0x7feea40035d0 con 0x7feeb806cb00 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebe62b700 1 -- 172.21.15.157:0/10553234 >> v1:172.21.15.157:6789/0 conn(0x7feeb806cb00 legacy=0x7feeb80b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebe62b700 1 -- 172.21.15.157:0/10553234 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80cee20 con 0x7feeb806cf60 2024-04-18T03:37:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebe62b700 1 --2- 172.21.15.157:0/10553234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb806cf60 0x7feeb80b3330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009d90 tx=0x7feeb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b2ea47ff9c4fbc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebce28700 1 -- 172.21.15.157:0/10553234 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000e070 con 0x7feeb806cf60 2024-04-18T03:37:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebce28700 1 -- 172.21.15.157:0/10553234 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0003a40 con 0x7feeb806cf60 2024-04-18T03:37:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebce28700 1 -- 172.21.15.157:0/10553234 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8001670 con 0x7feeb806cf60 2024-04-18T03:37:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 -- 172.21.15.157:0/10553234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb806cf60 msgr2=0x7feeb80b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 --2- 172.21.15.157:0/10553234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb806cf60 0x7feeb80b3330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009d90 tx=0x7feeb000b330 comp rx=0 tx=0).stop 2024-04-18T03:37:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 -- 172.21.15.157:0/10553234 shutdown_connections 2024-04-18T03:37:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 --2- 172.21.15.157:0/10553234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb806cf60 0x7feeb80b3330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 -- 172.21.15.157:0/10553234 >> 172.21.15.157:0/10553234 conn(0x7feeb80b1920 msgr2=0x7feeb80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 -- 172.21.15.157:0/10553234 shutdown_connections 2024-04-18T03:37:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.019+0000 7feebee2c700 1 -- 172.21.15.157:0/10553234 wait complete. 2024-04-18T03:37:46.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.023+0000 7feebee2c700 1 Processor -- start 2024-04-18T03:37:46.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.023+0000 7feebee2c700 1 -- start start 2024-04-18T03:37:46.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebee2c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb806cb00 0x7feeb81f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebee2c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feeb806cf60 0x7feeb81f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebee2c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb8143970 0x7feeb815cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebee2c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80713b0 con 0x7feeb806cb00 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebee2c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8070a80 con 0x7feeb8143970 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebee2c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8070d60 con 0x7feeb806cf60 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb806cb00 0x7feeb81f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb806cb00 0x7feeb81f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49394/0 (socket says 172.21.15.157:49394) 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 -- 172.21.15.157:0/2645209498 learned_addr learned my addr 172.21.15.157:0/2645209498 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebe62b700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb8143970 0x7feeb815cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebd629700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feeb806cf60 0x7feeb81f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 -- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feeb806cf60 msgr2=0x7feeb81f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feeb806cf60 0x7feeb81f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 -- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb8143970 msgr2=0x7feeb815cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb8143970 0x7feeb815cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 -- 172.21.15.157:0/2645209498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0009a70 con 0x7feeb806cb00 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebde2a700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb806cb00 0x7feeb81f1660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feeb400c490 tx=0x7feeb400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feeae7fc700 1 -- 172.21.15.157:0/2645209498 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400cea0 con 0x7feeb806cb00 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb8071040 con 0x7feeb806cb00 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feeae7fc700 1 -- 172.21.15.157:0/2645209498 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb40052f0 con 0x7feeb806cb00 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb815d310 con 0x7feeb806cb00 2024-04-18T03:37:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.027+0000 7feeae7fc700 1 -- 172.21.15.157:0/2645209498 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40036a0 con 0x7feeb806cb00 2024-04-18T03:37:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.031+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea0005310 con 0x7feeb806cb00 2024-04-18T03:37:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.031+0000 7feeae7fc700 1 -- 172.21.15.157:0/2645209498 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feeb4003800 con 0x7feeb806cb00 2024-04-18T03:37:46.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.031+0000 7feeae7fc700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fee9c066760 0x7fee9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.031+0000 7feeae7fc700 1 -- 172.21.15.157:0/2645209498 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feeb40837e0 con 0x7feeb806cb00 2024-04-18T03:37:46.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.031+0000 7feebd629700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fee9c066760 0x7fee9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.031+0000 7feebd629700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fee9c066760 0x7fee9c068c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feeb815b720 tx=0x7feea8001710 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.039+0000 7feeae7fc700 1 -- 172.21.15.157:0/2645209498 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7feeb40507d0 con 0x7feeb806cb00 2024-04-18T03:37:46.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.203+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feea0005b40 con 0x7feeb806cb00 2024-04-18T03:37:46.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feeae7fc700 1 -- 172.21.15.157:0/2645209498 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7feeb4053df0 con 0x7feeb806cb00 2024-04-18T03:37:46.209 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fee9c066760 msgr2=0x7fee9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fee9c066760 0x7fee9c068c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feeb815b720 tx=0x7feea8001710 comp rx=0 tx=0).stop 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb806cb00 msgr2=0x7feeb81f1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb806cb00 0x7feeb81f1660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feeb400c490 tx=0x7feeb400c7a0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 shutdown_connections 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fee9c066760 0x7fee9c068c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feeb8143970 0x7feeb815cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feeb806cf60 0x7feeb81f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 --2- 172.21.15.157:0/2645209498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feeb806cb00 0x7feeb81f1660 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 >> 172.21.15.157:0/2645209498 conn(0x7feeb80b1920 msgr2=0x7feeb81590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:46.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 shutdown_connections 2024-04-18T03:37:46.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.207+0000 7feebee2c700 1 -- 172.21.15.157:0/2645209498 wait complete. 2024-04-18T03:37:46.224 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:37:46.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.343+0000 7fe74e3f6700 1 Processor -- start 2024-04-18T03:37:46.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- start start 2024-04-18T03:37:46.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe748071080 0x7fe748071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7480d12b0 0x7fe7480d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7480719a0 con 0x7fe748161660 2024-04-18T03:37:46.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74806a770 con 0x7fe748071080 2024-04-18T03:37:46.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74806aa50 con 0x7fe7480d12b0 2024-04-18T03:37:46.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74d3f4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe748071080 0x7fe748071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74d3f4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe748071080 0x7fe748071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49402/0 (socket says 172.21.15.157:49402) 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74d3f4700 1 -- 172.21.15.157:0/1227674117 learned_addr learned my addr 172.21.15.157:0/1227674117 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74dbf5700 1 --2- 172.21.15.157:0/1227674117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7480d12b0 0x7fe7480d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74d3f4700 1 -- 172.21.15.157:0/1227674117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7480d12b0 msgr2=0x7fe7480d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74d3f4700 1 --2- 172.21.15.157:0/1227674117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7480d12b0 0x7fe7480d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74d3f4700 1 -- 172.21.15.157:0/1227674117 >> v1:172.21.15.175:6789/0 conn(0x7fe748161660 legacy=0x7fe74806c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74d3f4700 1 -- 172.21.15.157:0/1227674117 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74806ad30 con 0x7fe748071080 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74d3f4700 1 --2- 172.21.15.157:0/1227674117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe748071080 0x7fe748071460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe744009910 tx=0x7fe744009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90e727e42c64d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe73ffff700 1 -- 172.21.15.157:0/1227674117 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74400ba60 con 0x7fe748071080 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe73ffff700 1 -- 172.21.15.157:0/1227674117 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74400bbc0 con 0x7fe748071080 2024-04-18T03:37:46.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe73ffff700 1 -- 172.21.15.157:0/1227674117 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744009e60 con 0x7fe748071080 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- 172.21.15.157:0/1227674117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe748071080 msgr2=0x7fe748071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/1227674117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe748071080 0x7fe748071460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe744009910 tx=0x7fe744009c20 comp rx=0 tx=0).stop 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- 172.21.15.157:0/1227674117 shutdown_connections 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/1227674117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7480d12b0 0x7fe7480d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/1227674117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe748071080 0x7fe748071460 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- 172.21.15.157:0/1227674117 >> 172.21.15.157:0/1227674117 conn(0x7fe74806e020 msgr2=0x7fe74806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- 172.21.15.157:0/1227674117 shutdown_connections 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.347+0000 7fe74e3f6700 1 -- 172.21.15.157:0/1227674117 wait complete. 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 Processor -- start 2024-04-18T03:37:46.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 -- start start 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe748071080 0x7fe748156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7480d12b0 0x7fe7481f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe748161660 0x7fe7481f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481f49e0 con 0x7fe7480d12b0 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480b4780 con 0x7fe748071080 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7481f3c00 con 0x7fe748161660 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7480d12b0 0x7fe7481f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7480d12b0 0x7fe7481f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49412/0 (socket says 172.21.15.157:49412) 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74d3f4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe748071080 0x7fe748156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 -- 172.21.15.157:0/365576238 learned_addr learned my addr 172.21.15.157:0/365576238 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:46.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74dbf5700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe748161660 0x7fe7481f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 -- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe748161660 msgr2=0x7fe7481f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe748161660 0x7fe7481f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 -- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe748071080 msgr2=0x7fe748156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe748071080 0x7fe748156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 -- 172.21.15.157:0/365576238 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744009570 con 0x7fe7480d12b0 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74cbf3700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7480d12b0 0x7fe7481f2e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe73800c500 tx=0x7fe73800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe73dffb700 1 -- 172.21.15.157:0/365576238 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380052d0 con 0x7fe7480d12b0 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe73dffb700 1 -- 172.21.15.157:0/365576238 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe738005430 con 0x7fe7480d12b0 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7481f4320 con 0x7fe7480d12b0 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe73dffb700 1 -- 172.21.15.157:0/365576238 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380055a0 con 0x7fe7480d12b0 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7481f3ee0 con 0x7fe7480d12b0 2024-04-18T03:37:46.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.351+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7481f4b20 con 0x7fe7480d12b0 2024-04-18T03:37:46.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.355+0000 7fe73dffb700 1 -- 172.21.15.157:0/365576238 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7380038e0 con 0x7fe7480d12b0 2024-04-18T03:37:46.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.355+0000 7fe73dffb700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe72c066730 0x7fe72c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.355+0000 7fe73dffb700 1 -- 172.21.15.157:0/365576238 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7380837f0 con 0x7fe7480d12b0 2024-04-18T03:37:46.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.355+0000 7fe74d3f4700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe72c066730 0x7fe72c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.355+0000 7fe74d3f4700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe72c066730 0x7fe72c068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe744000c00 tx=0x7fe744008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.363+0000 7fe73dffb700 1 -- 172.21.15.157:0/365576238 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe7380507d0 con 0x7fe7480d12b0 2024-04-18T03:37:46.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.527+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe74804e650 con 0x7fe7480d12b0 2024-04-18T03:37:46.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.527+0000 7fe73dffb700 1 -- 172.21.15.157:0/365576238 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe738053df0 con 0x7fe7480d12b0 2024-04-18T03:37:46.531 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:37:46.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe72c066730 msgr2=0x7fe72c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe72c066730 0x7fe72c068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe744000c00 tx=0x7fe744008030 comp rx=0 tx=0).stop 2024-04-18T03:37:46.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7480d12b0 msgr2=0x7fe7481f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7480d12b0 0x7fe7481f2e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe73800c500 tx=0x7fe73800c810 comp rx=0 tx=0).stop 2024-04-18T03:37:46.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 shutdown_connections 2024-04-18T03:37:46.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe72c066730 0x7fe72c068bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe748161660 0x7fe7481f3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7480d12b0 0x7fe7481f2e20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 --2- 172.21.15.157:0/365576238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe748071080 0x7fe748156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 >> 172.21.15.157:0/365576238 conn(0x7fe74806e020 msgr2=0x7fe74815d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:46.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 shutdown_connections 2024-04-18T03:37:46.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.531+0000 7fe74e3f6700 1 -- 172.21.15.157:0/365576238 wait complete. 2024-04-18T03:37:46.546 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:37:46.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.651+0000 7f808e9e3700 1 Processor -- start 2024-04-18T03:37:46.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.651+0000 7f808e9e3700 1 -- start start 2024-04-18T03:37:46.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80880d2a20 0x7f808815dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80880702a0 con 0x7f80881611a0 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80880b7c30 con 0x7f80880b74b0 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808815e4f0 con 0x7f80880d2a20 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808d9e1700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80880d2a20 0x7f808815dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e1e2700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f80881611a0 0x7f8088070730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42108/0 (socket says 172.21.15.157:42108) 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e1e2700 1 -- 172.21.15.157:0/2803550145 learned_addr learned my addr 172.21.15.157:0/2803550145 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808d9e1700 1 -- 172.21.15.157:0/2803550145 >> v1:172.21.15.175:6789/0 conn(0x7f80880b74b0 legacy=0x7f8088160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808c9df700 1 -- 172.21.15.157:0/2803550145 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965326793 0 0) 0x7f80880702a0 con 0x7f80881611a0 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808d9e1700 1 -- 172.21.15.157:0/2803550145 >> v1:172.21.15.157:6789/0 conn(0x7f80881611a0 legacy=0x7f8088070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808d9e1700 1 -- 172.21.15.157:0/2803550145 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80880b7f10 con 0x7f80880d2a20 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808d9e1700 1 --2- 172.21.15.157:0/2803550145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f808815dfb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80780097d0 tx=0x7f8078009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc37c5ac325fa7e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808c9df700 1 -- 172.21.15.157:0/2803550145 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8078004230 con 0x7f80880d2a20 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808c9df700 1 -- 172.21.15.157:0/2803550145 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8078004390 con 0x7f80880d2a20 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808c9df700 1 -- 172.21.15.157:0/2803550145 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80780036c0 con 0x7f80880d2a20 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 -- 172.21.15.157:0/2803550145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 msgr2=0x7f808815dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 --2- 172.21.15.157:0/2803550145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f808815dfb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80780097d0 tx=0x7f8078009ae0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 -- 172.21.15.157:0/2803550145 shutdown_connections 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 --2- 172.21.15.157:0/2803550145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f808815dfb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 -- 172.21.15.157:0/2803550145 >> 172.21.15.157:0/2803550145 conn(0x7f80880d2e70 msgr2=0x7f80880d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:46.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 -- 172.21.15.157:0/2803550145 shutdown_connections 2024-04-18T03:37:46.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.655+0000 7f808e9e3700 1 -- 172.21.15.157:0/2803550145 wait complete. 2024-04-18T03:37:46.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 Processor -- start 2024-04-18T03:37:46.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 -- start start 2024-04-18T03:37:46.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80880b74b0 0x7f8088146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f8088146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80881611a0 0x7f808815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8088158360 con 0x7f80880d2a20 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8088156590 con 0x7f80880b74b0 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8088156870 con 0x7f80881611a0 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f8088146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f8088146860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49424/0 (socket says 172.21.15.157:49424) 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 -- 172.21.15.157:0/2724248991 learned_addr learned my addr 172.21.15.157:0/2724248991 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d9e1700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80880b74b0 0x7f8088146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e1e2700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80881611a0 0x7f808815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 -- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80881611a0 msgr2=0x7f808815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80881611a0 0x7f808815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 -- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80880b74b0 msgr2=0x7f8088146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80880b74b0 0x7f8088146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 -- 172.21.15.157:0/2724248991 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780094b0 con 0x7f80880d2a20 2024-04-18T03:37:46.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d9e1700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80880b74b0 0x7f8088146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:46.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808d1e0700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f8088146860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f808400c780 tx=0x7f808400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f807e7fc700 1 -- 172.21.15.157:0/2724248991 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084005480 con 0x7f80880d2a20 2024-04-18T03:37:46.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f807e7fc700 1 -- 172.21.15.157:0/2724248991 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80840036a0 con 0x7f80880d2a20 2024-04-18T03:37:46.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8088156b50 con 0x7f80880d2a20 2024-04-18T03:37:46.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f807e7fc700 1 -- 172.21.15.157:0/2724248991 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084003a50 con 0x7f80880d2a20 2024-04-18T03:37:46.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.659+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8088146da0 con 0x7f80880d2a20 2024-04-18T03:37:46.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.663+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808804e650 con 0x7f80880d2a20 2024-04-18T03:37:46.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.663+0000 7f807e7fc700 1 -- 172.21.15.157:0/2724248991 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8084003bb0 con 0x7f80880d2a20 2024-04-18T03:37:46.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.663+0000 7f807e7fc700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f806c066730 0x7f806c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.663+0000 7f807e7fc700 1 -- 172.21.15.157:0/2724248991 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8084083a90 con 0x7f80880d2a20 2024-04-18T03:37:46.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.663+0000 7f808d9e1700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f806c066730 0x7f806c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.667+0000 7f808d9e1700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f806c066730 0x7f806c068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80780097d0 tx=0x7f8078010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.675+0000 7f807e7fc700 1 -- 172.21.15.157:0/2724248991 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8084050b00 con 0x7f80880d2a20 2024-04-18T03:37:46.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.843+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8088154420 con 0x7f80880d2a20 2024-04-18T03:37:46.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.843+0000 7f807e7fc700 1 -- 172.21.15.157:0/2724248991 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8088154420 con 0x7f80880d2a20 2024-04-18T03:37:46.847 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:37:46.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f806c066730 msgr2=0x7f806c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f806c066730 0x7f806c068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80780097d0 tx=0x7f8078010000 comp rx=0 tx=0).stop 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 msgr2=0x7f8088146860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f8088146860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f808400c780 tx=0x7f808400cb40 comp rx=0 tx=0).stop 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 shutdown_connections 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f806c066730 0x7f806c068bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80881611a0 0x7f808815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80880d2a20 0x7f8088146860 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 --2- 172.21.15.157:0/2724248991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80880b74b0 0x7f8088146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 >> 172.21.15.157:0/2724248991 conn(0x7f80880d2e70 msgr2=0x7f80880d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 shutdown_connections 2024-04-18T03:37:46.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.847+0000 7f808e9e3700 1 -- 172.21.15.157:0/2724248991 wait complete. 2024-04-18T03:37:46.861 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:37:46.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.975+0000 7f1e3a447700 1 Processor -- start 2024-04-18T03:37:46.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.975+0000 7f1e3a447700 1 -- start start 2024-04-18T03:37:46.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1e34071080 0x7f1e34071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e340719a0 con 0x7f1e340d12b0 2024-04-18T03:37:46.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3406a770 con 0x7f1e34161660 2024-04-18T03:37:46.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3406aa50 con 0x7f1e34071080 2024-04-18T03:37:46.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e39445700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1e34071080 0x7f1e34071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e39c46700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1e340d12b0 0x7f1e340d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42120/0 (socket says 172.21.15.157:42120) 2024-04-18T03:37:46.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e39c46700 1 -- 172.21.15.157:0/1061224176 learned_addr learned my addr 172.21.15.157:0/1061224176 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:46.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e39445700 1 -- 172.21.15.157:0/1061224176 >> v1:172.21.15.175:6789/0 conn(0x7f1e34161660 legacy=0x7f1e3406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e39445700 1 -- 172.21.15.157:0/1061224176 >> v1:172.21.15.157:6789/0 conn(0x7f1e340d12b0 legacy=0x7f1e340d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e33fff700 1 -- 172.21.15.157:0/1061224176 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265083128 0 0) 0x7f1e340719a0 con 0x7f1e340d12b0 2024-04-18T03:37:46.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e39445700 1 -- 172.21.15.157:0/1061224176 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3406ad30 con 0x7f1e34071080 2024-04-18T03:37:46.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e39445700 1 --2- 172.21.15.157:0/1061224176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34071460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009850 tx=0x7f1e24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fdb37e18310e4f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e33fff700 1 -- 172.21.15.157:0/1061224176 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24011830 con 0x7f1e34071080 2024-04-18T03:37:46.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e33fff700 1 -- 172.21.15.157:0/1061224176 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e24011990 con 0x7f1e34071080 2024-04-18T03:37:46.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e33fff700 1 -- 172.21.15.157:0/1061224176 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24011d20 con 0x7f1e34071080 2024-04-18T03:37:46.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 -- 172.21.15.157:0/1061224176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 msgr2=0x7f1e34071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 --2- 172.21.15.157:0/1061224176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34071460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009850 tx=0x7f1e24009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 -- 172.21.15.157:0/1061224176 shutdown_connections 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 --2- 172.21.15.157:0/1061224176 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34071460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 -- 172.21.15.157:0/1061224176 >> 172.21.15.157:0/1061224176 conn(0x7f1e3406e020 msgr2=0x7f1e3406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 -- 172.21.15.157:0/1061224176 shutdown_connections 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.979+0000 7f1e3a447700 1 -- 172.21.15.157:0/1061224176 wait complete. 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 Processor -- start 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 -- start start 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e340d12b0 0x7f1e3415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e34161660 0x7f1e3415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3415afb0 con 0x7f1e34071080 2024-04-18T03:37:46.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3415a3c0 con 0x7f1e340d12b0 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3415a610 con 0x7f1e34161660 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49444/0 (socket says 172.21.15.157:49444) 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 -- 172.21.15.157:0/1968014166 learned_addr learned my addr 172.21.15.157:0/1968014166 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e38c44700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e340d12b0 0x7f1e3415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39c46700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e34161660 0x7f1e3415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 -- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e34161660 msgr2=0x7f1e3415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e34161660 0x7f1e3415eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 -- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e340d12b0 msgr2=0x7f1e3415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e340d12b0 0x7f1e3415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 -- 172.21.15.157:0/1968014166 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240094b0 con 0x7f1e34071080 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39c46700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e34161660 0x7f1e3415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e39445700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34154490 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1e24000c00 tx=0x7f1e24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e31ffb700 1 -- 172.21.15.157:0/1968014166 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e240036c0 con 0x7f1e34071080 2024-04-18T03:37:46.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e31ffb700 1 -- 172.21.15.157:0/1968014166 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2401f070 con 0x7f1e34071080 2024-04-18T03:37:46.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3415a8f0 con 0x7f1e34071080 2024-04-18T03:37:46.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e31ffb700 1 -- 172.21.15.157:0/1968014166 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24003a40 con 0x7f1e34071080 2024-04-18T03:37:46.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.983+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e34155110 con 0x7f1e34071080 2024-04-18T03:37:46.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.987+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e341552a0 con 0x7f1e34071080 2024-04-18T03:37:46.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.987+0000 7f1e31ffb700 1 -- 172.21.15.157:0/1968014166 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e24021030 con 0x7f1e34071080 2024-04-18T03:37:46.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.987+0000 7f1e31ffb700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1e20066730 0x7f1e20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:46.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.987+0000 7f1e31ffb700 1 -- 172.21.15.157:0/1968014166 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e24085ad0 con 0x7f1e34071080 2024-04-18T03:37:46.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.987+0000 7f1e38c44700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1e20066730 0x7f1e20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:46.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.991+0000 7f1e38c44700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1e20066730 0x7f1e20068bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e3415f260 tx=0x7f1e28009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:46.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:46.995+0000 7f1e31ffb700 1 -- 172.21.15.157:0/1968014166 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1e24052b60 con 0x7f1e34071080 2024-04-18T03:37:47.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.163+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1e340d1e20 con 0x7f1e34071080 2024-04-18T03:37:47.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.163+0000 7f1e31ffb700 1 -- 172.21.15.157:0/1968014166 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1e24056180 con 0x7f1e34071080 2024-04-18T03:37:47.168 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:37:47.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1e20066730 msgr2=0x7f1e20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1e20066730 0x7f1e20068bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e3415f260 tx=0x7f1e28009040 comp rx=0 tx=0).stop 2024-04-18T03:37:47.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 msgr2=0x7f1e34154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34154490 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1e24000c00 tx=0x7f1e24004770 comp rx=0 tx=0).stop 2024-04-18T03:37:47.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 shutdown_connections 2024-04-18T03:37:47.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1e20066730 0x7f1e20068bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e340d12b0 0x7f1e3415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e34161660 0x7f1e3415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 --2- 172.21.15.157:0/1968014166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e34071080 0x7f1e34154490 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 >> 172.21.15.157:0/1968014166 conn(0x7f1e3406e020 msgr2=0x7f1e340b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:47.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 shutdown_connections 2024-04-18T03:37:47.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.167+0000 7f1e3a447700 1 -- 172.21.15.157:0/1968014166 wait complete. 2024-04-18T03:37:47.182 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:37:47.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.291+0000 7fd901643700 1 Processor -- start 2024-04-18T03:37:47.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.291+0000 7fd901643700 1 -- start start 2024-04-18T03:37:47.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.291+0000 7fd901643700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc071080 0x7fd8fc071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8fc161660 0x7fd8fc06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc0719a0 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc06a770 con 0x7fd8fc161660 2024-04-18T03:37:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc06aa50 con 0x7fd8fc071080 2024-04-18T03:37:47.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8fb7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8fc161660 0x7fd8fc06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8fbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc071080 0x7fd8fc071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd900e42700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd8fc0b5f90 0x7fd8fc0b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:54468/0 (socket says 172.21.15.157:54468) 2024-04-18T03:37:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd900e42700 1 -- 172.21.15.157:0/4174251617 learned_addr learned my addr 172.21.15.157:0/4174251617 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8fb7fe700 1 -- 172.21.15.157:0/4174251617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc071080 msgr2=0x7fd8fc071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8fb7fe700 1 --2- 172.21.15.157:0/4174251617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc071080 0x7fd8fc071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8fb7fe700 1 -- 172.21.15.157:0/4174251617 >> v1:172.21.15.175:6789/0 conn(0x7fd8fc0b5f90 legacy=0x7fd8fc0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8fb7fe700 1 -- 172.21.15.157:0/4174251617 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc06ad30 con 0x7fd8fc161660 2024-04-18T03:37:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8fb7fe700 1 --2- 172.21.15.157:0/4174251617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc161660 0x7fd8fc06c3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009850 tx=0x7fd8e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f53a13cd9c70dc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8faffd700 1 -- 172.21.15.157:0/4174251617 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4011830 con 0x7fd8fc161660 2024-04-18T03:37:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8faffd700 1 -- 172.21.15.157:0/4174251617 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4011990 con 0x7fd8fc161660 2024-04-18T03:37:47.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd8faffd700 1 -- 172.21.15.157:0/4174251617 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4011d40 con 0x7fd8fc161660 2024-04-18T03:37:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 -- 172.21.15.157:0/4174251617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc161660 msgr2=0x7fd8fc06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 --2- 172.21.15.157:0/4174251617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc161660 0x7fd8fc06c3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009850 tx=0x7fd8e4009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 -- 172.21.15.157:0/4174251617 shutdown_connections 2024-04-18T03:37:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 --2- 172.21.15.157:0/4174251617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc161660 0x7fd8fc06c3a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 --2- 172.21.15.157:0/4174251617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc071080 0x7fd8fc071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 -- 172.21.15.157:0/4174251617 >> 172.21.15.157:0/4174251617 conn(0x7fd8fc06e020 msgr2=0x7fd8fc06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 -- 172.21.15.157:0/4174251617 shutdown_connections 2024-04-18T03:37:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.295+0000 7fd901643700 1 -- 172.21.15.157:0/4174251617 wait complete. 2024-04-18T03:37:47.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 Processor -- start 2024-04-18T03:37:47.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 -- start start 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc071080 0x7fd8fc1f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8fc0b5f90 0x7fd8fc0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc161660 0x7fd8fc153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0b2150 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc15e1a0 con 0x7fd8fc071080 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0b23f0 con 0x7fd8fc161660 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8fc0b5f90 0x7fd8fc0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8fc0b5f90 0x7fd8fc0b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49454/0 (socket says 172.21.15.157:49454) 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc071080 0x7fd8fc1f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 -- 172.21.15.157:0/2498230619 learned_addr learned my addr 172.21.15.157:0/2498230619 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd900e42700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc161660 0x7fd8fc153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 -- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc161660 msgr2=0x7fd8fc153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc161660 0x7fd8fc153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 -- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc071080 msgr2=0x7fd8fc1f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc071080 0x7fd8fc1f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 -- 172.21.15.157:0/2498230619 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40094b0 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8fb7fe700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8fc0b5f90 0x7fd8fc0b1c10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4014040 tx=0x7fd8e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8f8ff9700 1 -- 172.21.15.157:0/2498230619 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40036c0 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8f8ff9700 1 -- 172.21.15.157:0/2498230619 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e401e070 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd8f8ff9700 1 -- 172.21.15.157:0/2498230619 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4003a80 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.299+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc0b26d0 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.303+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc1f3520 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.303+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc1f3760 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.303+0000 7fd8f8ff9700 1 -- 172.21.15.157:0/2498230619 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd8e4003be0 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.303+0000 7fd8f8ff9700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd8e0066730 0x7fd8e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.303+0000 7fd8f8ff9700 1 -- 172.21.15.157:0/2498230619 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd8e4020070 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.303+0000 7fd8fbfff700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd8e0066730 0x7fd8e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.303+0000 7fd8fbfff700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd8e0066730 0x7fd8e0068bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009b50 tx=0x7fd8f4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:47.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.311+0000 7fd8f8ff9700 1 -- 172.21.15.157:0/2498230619 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd8e4052890 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.491+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd8fc1f3760 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.491+0000 7fd8f8ff9700 1 -- 172.21.15.157:0/2498230619 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd8fc1f3760 con 0x7fd8fc0b5f90 2024-04-18T03:37:47.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd8e0066730 msgr2=0x7fd8e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd8e0066730 0x7fd8e0068bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009b50 tx=0x7fd8f4009240 comp rx=0 tx=0).stop 2024-04-18T03:37:47.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8fc0b5f90 msgr2=0x7fd8fc0b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8fc0b5f90 0x7fd8fc0b1c10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4014040 tx=0x7fd8e4004770 comp rx=0 tx=0).stop 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 shutdown_connections 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd8e0066730 0x7fd8e0068bf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8fc161660 0x7fd8fc153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8fc0b5f90 0x7fd8fc0b1c10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 --2- 172.21.15.157:0/2498230619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8fc071080 0x7fd8fc1f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 >> 172.21.15.157:0/2498230619 conn(0x7fd8fc06e020 msgr2=0x7fd8fc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 shutdown_connections 2024-04-18T03:37:47.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.495+0000 7fd901643700 1 -- 172.21.15.157:0/2498230619 wait complete. 2024-04-18T03:37:47.500 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:37:47.512 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi157.front.sepia.ceph.com... 2024-04-18T03:37:47.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:47.513 DEBUG:teuthology.orchestra.run.smithi157:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-18T03:37:47.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi157.stderr:ceph-fuse[30778]: fuse finished with error 0 and tester_r 0 2024-04-18T03:37:47.544 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:37:47.581 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:37:47.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:37:47.581 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-18T03:37:47.599 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:47.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b27500700 1 Processor -- start 2024-04-18T03:37:47.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b27500700 1 -- start start 2024-04-18T03:37:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b27500700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4b200ce480 0x7f4b200b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b27500700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b20161d40 con 0x7f4b2006ef20 2024-04-18T03:37:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b27500700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2015d860 con 0x7f4b200ab8c0 2024-04-18T03:37:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b27500700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2015db20 con 0x7f4b200ce480 2024-04-18T03:37:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b26cff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4b2006ef20 0x7f4b200ad8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42130/0 (socket says 172.21.15.157:42130) 2024-04-18T03:37:47.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b26cff700 1 -- 172.21.15.157:0/2693853047 learned_addr learned my addr 172.21.15.157:0/2693853047 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:47.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b264fe700 1 --2- 172.21.15.157:0/2693853047 >> v2:172.21.15.175:3300/0 conn(0x7f4b200ce480 0x7f4b200b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278866354 0 0) 0x7f4b20161d40 con 0x7f4b2006ef20 2024-04-18T03:37:47.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c0035d0 con 0x7f4b2006ef20 2024-04-18T03:37:47.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710159793 0 0) 0x7f4b2015d860 con 0x7f4b200ab8c0 2024-04-18T03:37:47.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b20161d40 con 0x7f4b200ab8c0 2024-04-18T03:37:47.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311884539 0 0) 0x7f4b0c0035d0 con 0x7f4b2006ef20 2024-04-18T03:37:47.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 >> v2:172.21.15.175:3300/0 conn(0x7f4b200ce480 msgr2=0x7f4b200b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 --2- 172.21.15.157:0/2693853047 >> v2:172.21.15.175:3300/0 conn(0x7f4b200ce480 0x7f4b200b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 >> v1:172.21.15.175:6789/0 conn(0x7f4b200ab8c0 legacy=0x7f4b2006e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2015de00 con 0x7f4b2006ef20 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7f4b180019f0 con 0x7f4b2006ef20 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 >> v1:172.21.15.157:6789/0 conn(0x7f4b2006ef20 legacy=0x7f4b200ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c003bb0 0x7f4b0c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c004870 0x7f4b0c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b0c005230 0x7f4b0c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2015db20 con 0x7f4b0c005230 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c00c0b0 con 0x7f4b0c003bb0 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c00c270 con 0x7f4b0c004870 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.715+0000 7f4b26cff700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b0c005230 0x7f4b0c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b264fe700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c003bb0 0x7f4b0c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b25cfd700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c004870 0x7f4b0c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b26cff700 1 -- 172.21.15.157:0/2693853047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c004870 msgr2=0x7f4b0c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b26cff700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b0c004870 0x7f4b0c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b26cff700 1 -- 172.21.15.157:0/2693853047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c003bb0 msgr2=0x7f4b0c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b26cff700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c003bb0 0x7f4b0c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b26cff700 1 -- 172.21.15.157:0/2693853047 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0035d0 con 0x7f4b0c005230 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b26cff700 1 -- 172.21.15.157:0/2693853047 reap_dead start 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b26cff700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b0c005230 0x7f4b0c00ba30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b20157e60 tx=0x7f4b0c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b092820e02ec983 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180072d0 con 0x7f4b0c005230 2024-04-18T03:37:47.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18007470 con 0x7f4b0c005230 2024-04-18T03:37:47.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b254fc700 1 -- 172.21.15.157:0/2693853047 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18007820 con 0x7f4b0c005230 2024-04-18T03:37:47.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 -- 172.21.15.157:0/2693853047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b0c005230 msgr2=0x7f4b0c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b0c005230 0x7f4b0c00ba30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b20157e60 tx=0x7f4b0c0058a0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 -- 172.21.15.157:0/2693853047 shutdown_connections 2024-04-18T03:37:47.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 --2- 172.21.15.157:0/2693853047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b0c005230 0x7f4b0c00ba30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 -- 172.21.15.157:0/2693853047 >> 172.21.15.157:0/2693853047 conn(0x7f4b200b1330 msgr2=0x7f4b2006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:47.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 -- 172.21.15.157:0/2693853047 shutdown_connections 2024-04-18T03:37:47.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 -- 172.21.15.157:0/2693853047 wait complete. 2024-04-18T03:37:47.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 Processor -- start 2024-04-18T03:37:47.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.719+0000 7f4b27500700 1 -- start start 2024-04-18T03:37:47.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b27500700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c005230 0x7f4b20158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b27500700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b20138c20 0x7f4b201f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b27500700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b201f6ec0 0x7f4b2006e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b27500700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b201f6560 con 0x7f4b201f6ec0 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b27500700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b20158980 con 0x7f4b0c005230 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b27500700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2013b810 con 0x7f4b20138c20 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b26cff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b201f6ec0 0x7f4b2006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b264fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c005230 0x7f4b20158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b26cff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b201f6ec0 0x7f4b2006e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49464/0 (socket says 172.21.15.157:49464) 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b26cff700 1 -- 172.21.15.157:0/3522409680 learned_addr learned my addr 172.21.15.157:0/3522409680 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b25cfd700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b20138c20 0x7f4b201f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b25cfd700 1 -- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c005230 msgr2=0x7f4b20158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b25cfd700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c005230 0x7f4b20158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b25cfd700 1 -- 172.21.15.157:0/3522409680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b201f6ec0 msgr2=0x7f4b2006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b25cfd700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b201f6ec0 0x7f4b2006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b25cfd700 1 -- 172.21.15.157:0/3522409680 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2013baf0 con 0x7f4b20138c20 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b26cff700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b201f6ec0 0x7f4b2006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b264fe700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c005230 0x7f4b20158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:47.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b25cfd700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b20138c20 0x7f4b201f6980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c007fd0 tx=0x7f4b1c00fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:47.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b16ffd700 1 -- 172.21.15.157:0/3522409680 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0053e0 con 0x7f4b20138c20 2024-04-18T03:37:47.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b16ffd700 1 -- 172.21.15.157:0/3522409680 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c006880 con 0x7f4b20138c20 2024-04-18T03:37:47.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2013bdd0 con 0x7f4b20138c20 2024-04-18T03:37:47.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b16ffd700 1 -- 172.21.15.157:0/3522409680 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c005560 con 0x7f4b20138c20 2024-04-18T03:37:47.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.723+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2013b3a0 con 0x7f4b20138c20 2024-04-18T03:37:47.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.727+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2013b5c0 con 0x7f4b20138c20 2024-04-18T03:37:47.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.727+0000 7f4b16ffd700 1 -- 172.21.15.157:0/3522409680 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b1c006c30 con 0x7f4b20138c20 2024-04-18T03:37:47.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.727+0000 7f4b16ffd700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4b04066730 0x7f4b04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:47.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.727+0000 7f4b16ffd700 1 -- 172.21.15.157:0/3522409680 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b1c083d60 con 0x7f4b20138c20 2024-04-18T03:37:47.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.727+0000 7f4b264fe700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4b04066730 0x7f4b04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:47.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.727+0000 7f4b264fe700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4b04066730 0x7f4b04068bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b100143b0 tx=0x7f4b10009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:47.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.735+0000 7f4b16ffd700 1 -- 172.21.15.157:0/3522409680 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4b1c050f50 con 0x7f4b20138c20 2024-04-18T03:37:47.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.911+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b2004e650 con 0x7f4b20138c20 2024-04-18T03:37:47.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.915+0000 7f4b16ffd700 1 -- 172.21.15.157:0/3522409680 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f4b1c01a090 con 0x7f4b20138c20 2024-04-18T03:37:47.917 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:47.917 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.915+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4b04066730 msgr2=0x7f4b04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.915+0000 7f4b27500700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4b04066730 0x7f4b04068bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b100143b0 tx=0x7f4b10009240 comp rx=0 tx=0).stop 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.915+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b20138c20 msgr2=0x7f4b201f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.915+0000 7f4b27500700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b20138c20 0x7f4b201f6980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c007fd0 tx=0x7f4b1c00fa50 comp rx=0 tx=0).stop 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.919+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 shutdown_connections 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.919+0000 7f4b27500700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4b04066730 0x7f4b04068bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.919+0000 7f4b27500700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b201f6ec0 0x7f4b2006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.919+0000 7f4b27500700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b20138c20 0x7f4b201f6980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.919+0000 7f4b27500700 1 --2- 172.21.15.157:0/3522409680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b0c005230 0x7f4b20158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.919+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 >> 172.21.15.157:0/3522409680 conn(0x7f4b200b1330 msgr2=0x7f4b201424c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:47.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.919+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 shutdown_connections 2024-04-18T03:37:47.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:47.919+0000 7f4b27500700 1 -- 172.21.15.157:0/3522409680 wait complete. 2024-04-18T03:37:47.937 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:48.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.039+0000 7f76fb899700 1 Processor -- start 2024-04-18T03:37:48.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76fb899700 1 -- start start 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76fb899700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f76f4071790 0x7f76f406a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76fb899700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f406aec0 0x7f76f415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76fb899700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f415b5d0 con 0x7f76f4143bd0 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76fb899700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f406b700 con 0x7f76f4071790 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76fb899700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f415b3c0 con 0x7f76f406aec0 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f9635700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f76f4143bd0 0x7f76f4071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42140/0 (socket says 172.21.15.157:42140) 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f8e34700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f76f4071790 0x7f76f406a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f9635700 1 -- 172.21.15.157:0/1795631519 learned_addr learned my addr 172.21.15.157:0/1795631519 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f9e36700 1 --2- 172.21.15.157:0/1795631519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f406aec0 0x7f76f415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76e7fff700 1 -- 172.21.15.157:0/1795631519 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797721313 0 0) 0x7f76f415b5d0 con 0x7f76f4143bd0 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76e7fff700 1 -- 172.21.15.157:0/1795631519 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e00035d0 con 0x7f76f4143bd0 2024-04-18T03:37:48.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f8e34700 1 -- 172.21.15.157:0/1795631519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f406aec0 msgr2=0x7f76f415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:48.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76e7fff700 1 -- 172.21.15.157:0/1795631519 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 715033270 0 0) 0x7f76e00035d0 con 0x7f76f4143bd0 2024-04-18T03:37:48.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f8e34700 1 --2- 172.21.15.157:0/1795631519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f406aec0 0x7f76f415c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f8e34700 1 -- 172.21.15.157:0/1795631519 >> v1:172.21.15.157:6789/0 conn(0x7f76f4143bd0 legacy=0x7f76f4071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f8e34700 1 -- 172.21.15.157:0/1795631519 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f415b8b0 con 0x7f76f4071790 2024-04-18T03:37:48.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76f8e34700 1 --2- 172.21.15.157:0/1795631519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4071790 0x7f76f406a980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009850 tx=0x7f76e8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95af45bbf58d3fa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:48.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76e7fff700 1 -- 172.21.15.157:0/1795631519 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0001670 con 0x7f76f4071790 2024-04-18T03:37:48.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76e7fff700 1 -- 172.21.15.157:0/1795631519 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e8004030 con 0x7f76f4071790 2024-04-18T03:37:48.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.043+0000 7f76e7fff700 1 -- 172.21.15.157:0/1795631519 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80043a0 con 0x7f76f4071790 2024-04-18T03:37:48.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 -- 172.21.15.157:0/1795631519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4071790 msgr2=0x7f76f406a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 --2- 172.21.15.157:0/1795631519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4071790 0x7f76f406a980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009850 tx=0x7f76e8009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:48.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 -- 172.21.15.157:0/1795631519 shutdown_connections 2024-04-18T03:37:48.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 --2- 172.21.15.157:0/1795631519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f406aec0 0x7f76f415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 --2- 172.21.15.157:0/1795631519 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f4071790 0x7f76f406a980 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 -- 172.21.15.157:0/1795631519 >> 172.21.15.157:0/1795631519 conn(0x7f76f40b1170 msgr2=0x7f76f406e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:48.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 -- 172.21.15.157:0/1795631519 shutdown_connections 2024-04-18T03:37:48.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 -- 172.21.15.157:0/1795631519 wait complete. 2024-04-18T03:37:48.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 Processor -- start 2024-04-18T03:37:48.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.047+0000 7f76fb899700 1 -- start start 2024-04-18T03:37:48.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76fb899700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f406aec0 0x7f76f41e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76fb899700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4071790 0x7f76f41e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76fb899700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f4143bd0 0x7f76f41e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76fb899700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41e1f10 con 0x7f76f406aec0 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76fb899700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41e21f0 con 0x7f76f4071790 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76fb899700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41e24d0 con 0x7f76f4143bd0 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f406aec0 0x7f76f41e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f406aec0 0x7f76f41e3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49476/0 (socket says 172.21.15.157:49476) 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 -- 172.21.15.157:0/409602364 learned_addr learned my addr 172.21.15.157:0/409602364 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f8e34700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4071790 0x7f76f41e11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9e36700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f4143bd0 0x7f76f41e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 -- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f4143bd0 msgr2=0x7f76f41e16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f4143bd0 0x7f76f41e16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 -- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4071790 msgr2=0x7f76f41e11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4071790 0x7f76f41e11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 -- 172.21.15.157:0/409602364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80094b0 con 0x7f76f406aec0 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76f9635700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f406aec0 0x7f76f41e3ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76f00011e0 tx=0x7f76f000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76e5ffb700 1 -- 172.21.15.157:0/409602364 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0004ca0 con 0x7f76f406aec0 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76e5ffb700 1 -- 172.21.15.157:0/409602364 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f0004e00 con 0x7f76f406aec0 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f41e27b0 con 0x7f76f406aec0 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76e5ffb700 1 -- 172.21.15.157:0/409602364 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00072f0 con 0x7f76f406aec0 2024-04-18T03:37:48.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.051+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f41e1c20 con 0x7f76f406aec0 2024-04-18T03:37:48.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.055+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f41e2cd0 con 0x7f76f406aec0 2024-04-18T03:37:48.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.055+0000 7f76e5ffb700 1 -- 172.21.15.157:0/409602364 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76f0007450 con 0x7f76f406aec0 2024-04-18T03:37:48.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.055+0000 7f76e5ffb700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f76d8066730 0x7f76d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.055+0000 7f76e5ffb700 1 -- 172.21.15.157:0/409602364 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76f0084190 con 0x7f76f406aec0 2024-04-18T03:37:48.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.055+0000 7f76f8e34700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f76d8066730 0x7f76d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.055+0000 7f76f8e34700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f76d8066730 0x7f76d8068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f76e80090b0 tx=0x7f76e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:48.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.063+0000 7f76e5ffb700 1 -- 172.21.15.157:0/409602364 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f76f0051210 con 0x7f76f406aec0 2024-04-18T03:37:48.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.231+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76f404e6c0 con 0x7f76f406aec0 2024-04-18T03:37:48.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76e5ffb700 1 -- 172.21.15.157:0/409602364 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f76f0054830 con 0x7f76f406aec0 2024-04-18T03:37:48.237 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:48.238 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:48.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f76d8066730 msgr2=0x7f76d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f76d8066730 0x7f76d8068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f76e80090b0 tx=0x7f76e8008030 comp rx=0 tx=0).stop 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f406aec0 msgr2=0x7f76f41e3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f406aec0 0x7f76f41e3ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76f00011e0 tx=0x7f76f000ca50 comp rx=0 tx=0).stop 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 shutdown_connections 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f76d8066730 0x7f76d8068bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4071790 0x7f76f41e11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76f4143bd0 0x7f76f41e16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 --2- 172.21.15.157:0/409602364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76f406aec0 0x7f76f41e3ac0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 >> 172.21.15.157:0/409602364 conn(0x7f76f40b1170 msgr2=0x7f76f41421d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 shutdown_connections 2024-04-18T03:37:48.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.235+0000 7f76fb899700 1 -- 172.21.15.157:0/409602364 wait complete. 2024-04-18T03:37:48.252 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-18T03:37:48.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.363+0000 7efc5256a700 1 Processor -- start 2024-04-18T03:37:48.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.363+0000 7efc5256a700 1 -- start start 2024-04-18T03:37:48.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc4404f840 0x7efc4404fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc4403a570 0x7efc44006920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efc440e6cf0 0x7efc440e7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc44053380 con 0x7efc440e6cf0 2024-04-18T03:37:48.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc44050160 con 0x7efc4403a570 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc44007250 con 0x7efc4404f840 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efc440e6cf0 0x7efc440e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efc440e6cf0 0x7efc440e7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49492/0 (socket says 172.21.15.157:49492) 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 -- 172.21.15.157:0/1380450938 learned_addr learned my addr 172.21.15.157:0/1380450938 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51568700 1 --2- 172.21.15.157:0/1380450938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc4404f840 0x7efc4404fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc50d67700 1 --2- 172.21.15.157:0/1380450938 >> v2:172.21.15.175:3300/0 conn(0x7efc4403a570 0x7efc44006920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 -- 172.21.15.157:0/1380450938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc4404f840 msgr2=0x7efc4404fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 --2- 172.21.15.157:0/1380450938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc4404f840 0x7efc4404fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 -- 172.21.15.157:0/1380450938 >> v2:172.21.15.175:3300/0 conn(0x7efc4403a570 msgr2=0x7efc44006920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 --2- 172.21.15.157:0/1380450938 >> v2:172.21.15.175:3300/0 conn(0x7efc4403a570 0x7efc44006920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 -- 172.21.15.157:0/1380450938 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc44007530 con 0x7efc440e6cf0 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51568700 1 --2- 172.21.15.157:0/1380450938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc4404f840 0x7efc4404fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:48.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc50d67700 1 --2- 172.21.15.157:0/1380450938 >> v2:172.21.15.175:3300/0 conn(0x7efc4403a570 0x7efc44006920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc51d69700 1 --2- 172.21.15.157:0/1380450938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc440e6cf0 0x7efc440e7150 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc4400d900 tx=0x7efc48009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc856d8d45eb2d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc43fff700 1 -- 172.21.15.157:0/1380450938 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48011830 con 0x7efc440e6cf0 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc43fff700 1 -- 172.21.15.157:0/1380450938 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48011990 con 0x7efc440e6cf0 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc43fff700 1 -- 172.21.15.157:0/1380450938 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48011d20 con 0x7efc440e6cf0 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- 172.21.15.157:0/1380450938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc440e6cf0 msgr2=0x7efc440e7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 --2- 172.21.15.157:0/1380450938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc440e6cf0 0x7efc440e7150 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc4400d900 tx=0x7efc48009bf0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- 172.21.15.157:0/1380450938 shutdown_connections 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 --2- 172.21.15.157:0/1380450938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc440e6cf0 0x7efc440e7150 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 --2- 172.21.15.157:0/1380450938 >> v2:172.21.15.175:3300/0 conn(0x7efc4403a570 0x7efc44006920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 --2- 172.21.15.157:0/1380450938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc4404f840 0x7efc4404fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- 172.21.15.157:0/1380450938 >> 172.21.15.157:0/1380450938 conn(0x7efc44054b70 msgr2=0x7efc44054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- 172.21.15.157:0/1380450938 shutdown_connections 2024-04-18T03:37:48.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- 172.21.15.157:0/1380450938 wait complete. 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 Processor -- start 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.367+0000 7efc5256a700 1 -- start start 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4403a570 0x7efc44176060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc4404f840 0x7efc44178c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc440e6cf0 0x7efc44179cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc441765a0 con 0x7efc4403a570 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440e1990 con 0x7efc4404f840 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc44179700 con 0x7efc440e6cf0 2024-04-18T03:37:48.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4403a570 0x7efc44176060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4403a570 0x7efc44176060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49498/0 (socket says 172.21.15.157:49498) 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 -- 172.21.15.157:0/1352461864 learned_addr learned my addr 172.21.15.157:0/1352461864 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc50d67700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc4404f840 0x7efc44178c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51d69700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc440e6cf0 0x7efc44179cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 -- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc440e6cf0 msgr2=0x7efc44179cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc440e6cf0 0x7efc44179cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 -- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc4404f840 msgr2=0x7efc44178c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc4404f840 0x7efc44178c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 -- 172.21.15.157:0/1352461864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c073ba0 con 0x7efc4403a570 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc51568700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4403a570 0x7efc44176060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0688a0 tx=0x7efc4c067bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc41ffb700 1 -- 172.21.15.157:0/1352461864 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c066250 con 0x7efc4403a570 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc41ffb700 1 -- 172.21.15.157:0/1352461864 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c0663b0 con 0x7efc4403a570 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc48009570 con 0x7efc4403a570 2024-04-18T03:37:48.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc41ffb700 1 -- 172.21.15.157:0/1352461864 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c066740 con 0x7efc4403a570 2024-04-18T03:37:48.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc440e1620 con 0x7efc4403a570 2024-04-18T03:37:48.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.371+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc44005440 con 0x7efc4403a570 2024-04-18T03:37:48.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.375+0000 7efc41ffb700 1 -- 172.21.15.157:0/1352461864 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc4c072200 con 0x7efc4403a570 2024-04-18T03:37:48.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.375+0000 7efc41ffb700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efc30066730 0x7efc30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:48.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.375+0000 7efc41ffb700 1 -- 172.21.15.157:0/1352461864 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc4c0fedf0 con 0x7efc4403a570 2024-04-18T03:37:48.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.375+0000 7efc50d67700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efc30066730 0x7efc30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:48.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.375+0000 7efc50d67700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efc30066730 0x7efc30068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc4404f0e0 tx=0x7efc3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:48.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.379+0000 7efc41ffb700 1 -- 172.21.15.157:0/1352461864 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7efc4c0cbf00 con 0x7efc4403a570 2024-04-18T03:37:48.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:48.583+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc44052840 con 0x7efc4403a570 2024-04-18T03:37:49.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.359+0000 7efc41ffb700 1 -- 172.21.15.157:0/1352461864 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7efc4c0cf520 con 0x7efc4403a570 2024-04-18T03:37:49.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efc30066730 msgr2=0x7efc30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efc30066730 0x7efc30068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efc4404f0e0 tx=0x7efc3c008040 comp rx=0 tx=0).stop 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4403a570 msgr2=0x7efc44176060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4403a570 0x7efc44176060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0688a0 tx=0x7efc4c067bc0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 shutdown_connections 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efc30066730 0x7efc30068bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc4404f840 0x7efc44178c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc440e6cf0 0x7efc44179cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 --2- 172.21.15.157:0/1352461864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc4403a570 0x7efc44176060 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 >> 172.21.15.157:0/1352461864 conn(0x7efc44054b70 msgr2=0x7efc440ddd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 shutdown_connections 2024-04-18T03:37:49.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.363+0000 7efc5256a700 1 -- 172.21.15.157:0/1352461864 wait complete. 2024-04-18T03:37:49.382 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-18T03:37:49.383 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-18T03:37:49.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.499+0000 7f762a577700 1 Processor -- start 2024-04-18T03:37:49.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.499+0000 7f762a577700 1 -- start start 2024-04-18T03:37:49.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.499+0000 7f762a577700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7624071080 0x7f7624071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:49.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.499+0000 7f762a577700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624161660 0x7f762406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:49.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.499+0000 7f762a577700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76240719a0 con 0x7f76240b5f90 2024-04-18T03:37:49.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.499+0000 7f762a577700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762406a770 con 0x7f7624071080 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.499+0000 7f762a577700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762406aa50 con 0x7f7624161660 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7629575700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7624071080 0x7f7624071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7628d74700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624161660 0x7f762406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7629575700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7624071080 0x7f7624071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49500/0 (socket says 172.21.15.157:49500) 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7629575700 1 -- 172.21.15.157:0/2369052300 learned_addr learned my addr 172.21.15.157:0/2369052300 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7629575700 1 -- 172.21.15.157:0/2369052300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624161660 msgr2=0x7f762406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7629575700 1 --2- 172.21.15.157:0/2369052300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624161660 0x7f762406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7629575700 1 -- 172.21.15.157:0/2369052300 >> v1:172.21.15.175:6789/0 conn(0x7f76240b5f90 legacy=0x7f76240b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7617fff700 1 -- 172.21.15.157:0/2369052300 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516431735 0 0) 0x7f76240719a0 con 0x7f76240b5f90 2024-04-18T03:37:49.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7629575700 1 -- 172.21.15.157:0/2369052300 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762406ad30 con 0x7f7624071080 2024-04-18T03:37:49.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7629575700 1 --2- 172.21.15.157:0/2369052300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624071080 0x7f7624071460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7618009910 tx=0x7f7618009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90b50c5879dd8b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:49.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7617fff700 1 -- 172.21.15.157:0/2369052300 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618011830 con 0x7f7624071080 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7617fff700 1 -- 172.21.15.157:0/2369052300 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618011990 con 0x7f7624071080 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f7617fff700 1 -- 172.21.15.157:0/2369052300 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618011d40 con 0x7f7624071080 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f762a577700 1 -- 172.21.15.157:0/2369052300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624071080 msgr2=0x7f7624071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f762a577700 1 --2- 172.21.15.157:0/2369052300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624071080 0x7f7624071460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7618009910 tx=0x7f7618009c20 comp rx=0 tx=0).stop 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f762a577700 1 -- 172.21.15.157:0/2369052300 shutdown_connections 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f762a577700 1 --2- 172.21.15.157:0/2369052300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624161660 0x7f762406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f762a577700 1 --2- 172.21.15.157:0/2369052300 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624071080 0x7f7624071460 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f762a577700 1 -- 172.21.15.157:0/2369052300 >> 172.21.15.157:0/2369052300 conn(0x7f762406e020 msgr2=0x7f762406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f762a577700 1 -- 172.21.15.157:0/2369052300 shutdown_connections 2024-04-18T03:37:49.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.503+0000 7f762a577700 1 -- 172.21.15.157:0/2369052300 wait complete. 2024-04-18T03:37:49.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.507+0000 7f762a577700 1 Processor -- start 2024-04-18T03:37:49.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.507+0000 7f762a577700 1 -- start start 2024-04-18T03:37:49.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.507+0000 7f762a577700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624071080 0x7f76240ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:49.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f762a577700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240b5f90 0x7f76241569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f762a577700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624161660 0x7f76241f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f762a577700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76241f4920 con 0x7f7624161660 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f762a577700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76241f4c00 con 0x7f76240b5f90 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f762a577700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76241f4ee0 con 0x7f7624071080 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629d76700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624161660 0x7f76241f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629575700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624071080 0x7f76240ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629575700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624071080 0x7f76240ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:47424/0 (socket says 172.21.15.157:47424) 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629d76700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624161660 0x7f76241f59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49514/0 (socket says 172.21.15.157:49514) 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629575700 1 -- 172.21.15.157:0/916062580 learned_addr learned my addr 172.21.15.157:0/916062580 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7628d74700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240b5f90 0x7f76241569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629d76700 1 -- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624071080 msgr2=0x7f76240ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629d76700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624071080 0x7f76240ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629d76700 1 -- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240b5f90 msgr2=0x7f76241569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:49.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629d76700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240b5f90 0x7f76241569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:49.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629d76700 1 -- 172.21.15.157:0/916062580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618009570 con 0x7f7624161660 2024-04-18T03:37:49.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629575700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624071080 0x7f76240ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:49.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7629d76700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624161660 0x7f76241f59c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f761c00cac0 tx=0x7f761c00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:49.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7615ffb700 1 -- 172.21.15.157:0/916062580 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c003e50 con 0x7f7624161660 2024-04-18T03:37:49.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7615ffb700 1 -- 172.21.15.157:0/916062580 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c005070 con 0x7f7624161660 2024-04-18T03:37:49.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76241f51c0 con 0x7f7624161660 2024-04-18T03:37:49.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f7615ffb700 1 -- 172.21.15.157:0/916062580 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c005420 con 0x7f7624161660 2024-04-18T03:37:49.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76240ac810 con 0x7f7624161660 2024-04-18T03:37:49.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.511+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76241f56e0 con 0x7f7624161660 2024-04-18T03:37:49.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.515+0000 7f7615ffb700 1 -- 172.21.15.157:0/916062580 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f761c005580 con 0x7f7624161660 2024-04-18T03:37:49.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.515+0000 7f7615ffb700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7608066730 0x7f7608068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:49.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.515+0000 7f7615ffb700 1 -- 172.21.15.157:0/916062580 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f761c084230 con 0x7f7624161660 2024-04-18T03:37:49.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.515+0000 7f7629575700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7608066730 0x7f7608068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:49.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.515+0000 7f7629575700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7608066730 0x7f7608068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7618009c60 tx=0x7f761801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:49.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.519+0000 7f7615ffb700 1 -- 172.21.15.157:0/916062580 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f76241f56e0 con 0x7f7624161660 2024-04-18T03:37:49.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:49.727+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f76241f56e0 con 0x7f7624161660 2024-04-18T03:37:50.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.371+0000 7f7615ffb700 1 -- 172.21.15.157:0/916062580 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f76241f56e0 con 0x7f7624161660 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7608066730 msgr2=0x7f7608068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7608066730 0x7f7608068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7618009c60 tx=0x7f761801c040 comp rx=0 tx=0).stop 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624161660 msgr2=0x7f76241f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624161660 0x7f76241f59c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f761c00cac0 tx=0x7f761c00cdd0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 shutdown_connections 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7608066730 0x7f7608068bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240b5f90 0x7f76241569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7624161660 0x7f76241f59c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 --2- 172.21.15.157:0/916062580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7624071080 0x7f76240ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 >> 172.21.15.157:0/916062580 conn(0x7f762406e020 msgr2=0x7f76240b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 shutdown_connections 2024-04-18T03:37:50.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.375+0000 7f762a577700 1 -- 172.21.15.157:0/916062580 wait complete. 2024-04-18T03:37:50.398 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-18T03:37:50.398 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:37:50.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 Processor -- start 2024-04-18T03:37:50.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 -- start start 2024-04-18T03:37:50.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb7a815b0c0 0x7fb7a80cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a8070b80 0x7fb7a806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a80cfa00 con 0x7fb7a806caf0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a815b4a0 con 0x7fb7a815b0c0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a806cf60 con 0x7fb7a8070b80 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ae26d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb7a815b0c0 0x7fb7a80cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7aea6e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb7a806caf0 0x7fb7a815eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42142/0 (socket says 172.21.15.157:42142) 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ae26d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb7a815b0c0 0x7fb7a80cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49518/0 (socket says 172.21.15.157:49518) 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7aea6e700 1 -- 172.21.15.157:0/2631951702 learned_addr learned my addr 172.21.15.157:0/2631951702 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ada6c700 1 --2- 172.21.15.157:0/2631951702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a8070b80 0x7fb7a806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ae26d700 1 -- 172.21.15.157:0/2631951702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a8070b80 msgr2=0x7fb7a806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ae26d700 1 --2- 172.21.15.157:0/2631951702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a8070b80 0x7fb7a806c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ae26d700 1 -- 172.21.15.157:0/2631951702 >> v1:172.21.15.157:6789/0 conn(0x7fb7a806caf0 legacy=0x7fb7a815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ae26d700 1 -- 172.21.15.157:0/2631951702 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80d04a0 con 0x7fb7a815b0c0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ad26b700 1 -- 172.21.15.157:0/2631951702 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48914627 0 0) 0x7fb7a80cfa00 con 0x7fb7a806caf0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ae26d700 1 --2- 172.21.15.157:0/2631951702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a815b0c0 0x7fb7a80cbe10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb798009dc0 tx=0x7fb79800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381eeb518b5b76ec server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ad26b700 1 -- 172.21.15.157:0/2631951702 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79800e070 con 0x7fb7a815b0c0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ad26b700 1 -- 172.21.15.157:0/2631951702 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79800bb90 con 0x7fb7a815b0c0 2024-04-18T03:37:50.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7ad26b700 1 -- 172.21.15.157:0/2631951702 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb798012430 con 0x7fb7a815b0c0 2024-04-18T03:37:50.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 -- 172.21.15.157:0/2631951702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a815b0c0 msgr2=0x7fb7a80cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.511+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/2631951702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a815b0c0 0x7fb7a80cbe10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb798009dc0 tx=0x7fb79800b330 comp rx=0 tx=0).stop 2024-04-18T03:37:50.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 -- 172.21.15.157:0/2631951702 shutdown_connections 2024-04-18T03:37:50.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/2631951702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a8070b80 0x7fb7a806c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/2631951702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a815b0c0 0x7fb7a80cbe10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 -- 172.21.15.157:0/2631951702 >> 172.21.15.157:0/2631951702 conn(0x7fb7a80d1000 msgr2=0x7fb7a80d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:50.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 -- 172.21.15.157:0/2631951702 shutdown_connections 2024-04-18T03:37:50.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 -- 172.21.15.157:0/2631951702 wait complete. 2024-04-18T03:37:50.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 Processor -- start 2024-04-18T03:37:50.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 -- start start 2024-04-18T03:37:50.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a806caf0 0x7fb7a80af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a8070b80 0x7fb7a80b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a815b0c0 0x7fb7a80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80c90e0 con 0x7fb7a8070b80 2024-04-18T03:37:50.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80c93c0 con 0x7fb7a806caf0 2024-04-18T03:37:50.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7b04d1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80c96a0 con 0x7fb7a815b0c0 2024-04-18T03:37:50.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7ada6c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a8070b80 0x7fb7a80b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7ada6c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a8070b80 0x7fb7a80b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49526/0 (socket says 172.21.15.157:49526) 2024-04-18T03:37:50.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7ada6c700 1 -- 172.21.15.157:0/3226033309 learned_addr learned my addr 172.21.15.157:0/3226033309 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:50.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7ae26d700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a806caf0 0x7fb7a80af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.515+0000 7fb7aea6e700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a815b0c0 0x7fb7a80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7ada6c700 1 -- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a815b0c0 msgr2=0x7fb7a80b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7ada6c700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a815b0c0 0x7fb7a80b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7ada6c700 1 -- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a806caf0 msgr2=0x7fb7a80af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7ada6c700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a806caf0 0x7fb7a80af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7ada6c700 1 -- 172.21.15.157:0/3226033309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798009a70 con 0x7fb7a8070b80 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7ada6c700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a8070b80 0x7fb7a80b47c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00e760 tx=0x7fb79c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7a6ffd700 1 -- 172.21.15.157:0/3226033309 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c00c070 con 0x7fb7a8070b80 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7a6ffd700 1 -- 172.21.15.157:0/3226033309 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c013610 con 0x7fb7a8070b80 2024-04-18T03:37:50.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a80c9980 con 0x7fb7a8070b80 2024-04-18T03:37:50.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7a6ffd700 1 -- 172.21.15.157:0/3226033309 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c013980 con 0x7fb7a8070b80 2024-04-18T03:37:50.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a80ca2f0 con 0x7fb7a8070b80 2024-04-18T03:37:50.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a80676b0 con 0x7fb7a8070b80 2024-04-18T03:37:50.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7a6ffd700 1 -- 172.21.15.157:0/3226033309 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb79c013ae0 con 0x7fb7a8070b80 2024-04-18T03:37:50.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.519+0000 7fb7a6ffd700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb794066760 0x7fb794068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.523+0000 7fb7a6ffd700 1 -- 172.21.15.157:0/3226033309 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb79c084160 con 0x7fb7a8070b80 2024-04-18T03:37:50.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.523+0000 7fb7ae26d700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb794066760 0x7fb794068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.523+0000 7fb7ae26d700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb794066760 0x7fb794068c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb798014040 tx=0x7fb798011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:50.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.527+0000 7fb7a6ffd700 1 -- 172.21.15.157:0/3226033309 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb79c0511e0 con 0x7fb7a8070b80 2024-04-18T03:37:50.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.735+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7a80c47c0 con 0x7fb7a8070b80 2024-04-18T03:37:50.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.735+0000 7fb7a6ffd700 1 -- 172.21.15.157:0/3226033309 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4742 (secure 0 0 0) 0x7fb79c054800 con 0x7fb7a8070b80 2024-04-18T03:37:50.739 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:50.739 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T03:37:34.273529+0000","modified":"2024-04-18T03:37:50.365620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb794066760 msgr2=0x7fb794068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb794066760 0x7fb794068c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb798014040 tx=0x7fb798011000 comp rx=0 tx=0).stop 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a8070b80 msgr2=0x7fb7a80b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a8070b80 0x7fb7a80b47c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00e760 tx=0x7fb79c00ea70 comp rx=0 tx=0).stop 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 shutdown_connections 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb794066760 0x7fb794068c20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7a815b0c0 0x7fb7a80b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7a8070b80 0x7fb7a80b47c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 --2- 172.21.15.157:0/3226033309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7a806caf0 0x7fb7a80af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 >> 172.21.15.157:0/3226033309 conn(0x7fb7a80d1000 msgr2=0x7fb7a815a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 shutdown_connections 2024-04-18T03:37:50.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.739+0000 7fb7b04d1700 1 -- 172.21.15.157:0/3226033309 wait complete. 2024-04-18T03:37:50.743 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 9 2024-04-18T03:37:50.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:50.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.867+0000 7fcf63385700 1 Processor -- start 2024-04-18T03:37:50.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.867+0000 7fcf63385700 1 -- start start 2024-04-18T03:37:50.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcf5c0cf2e0 0x7fcf5c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0ce520 con 0x7fcf5c142b40 2024-04-18T03:37:50.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0ce800 con 0x7fcf5c06b5e0 2024-04-18T03:37:50.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cce20 con 0x7fcf5c0cf2e0 2024-04-18T03:37:50.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61b82700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcf5c0cf2e0 0x7fcf5c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf62383700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fcf5c142b40 0x7fcf5c0cc640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42146/0 (socket says 172.21.15.157:42146) 2024-04-18T03:37:50.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf62383700 1 -- 172.21.15.157:0/3279093977 learned_addr learned my addr 172.21.15.157:0/3279093977 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61b82700 1 -- 172.21.15.157:0/3279093977 >> v1:172.21.15.175:6789/0 conn(0x7fcf5c06b5e0 legacy=0x7fcf5c0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61b82700 1 -- 172.21.15.157:0/3279093977 >> v1:172.21.15.157:6789/0 conn(0x7fcf5c142b40 legacy=0x7fcf5c0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61381700 1 -- 172.21.15.157:0/3279093977 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538960767 0 0) 0x7fcf5c0ce520 con 0x7fcf5c142b40 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61b82700 1 -- 172.21.15.157:0/3279093977 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0ceae0 con 0x7fcf5c0cf2e0 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61b82700 1 --2- 172.21.15.157:0/3279093977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c0b4db0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009850 tx=0x7fcf4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da23c50d5c3a4ef server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61381700 1 -- 172.21.15.157:0/3279093977 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011830 con 0x7fcf5c0cf2e0 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61381700 1 -- 172.21.15.157:0/3279093977 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c011990 con 0x7fcf5c0cf2e0 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf61381700 1 -- 172.21.15.157:0/3279093977 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011d20 con 0x7fcf5c0cf2e0 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 -- 172.21.15.157:0/3279093977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 msgr2=0x7fcf5c0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 --2- 172.21.15.157:0/3279093977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c0b4db0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009850 tx=0x7fcf4c009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 -- 172.21.15.157:0/3279093977 shutdown_connections 2024-04-18T03:37:50.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 --2- 172.21.15.157:0/3279093977 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c0b4db0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 -- 172.21.15.157:0/3279093977 >> 172.21.15.157:0/3279093977 conn(0x7fcf5c0b1920 msgr2=0x7fcf5c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:50.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 -- 172.21.15.157:0/3279093977 shutdown_connections 2024-04-18T03:37:50.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.871+0000 7fcf63385700 1 -- 172.21.15.157:0/3279093977 wait complete. 2024-04-18T03:37:50.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 Processor -- start 2024-04-18T03:37:50.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 -- start start 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf5c06b5e0 0x7fcf5c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c1f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf5c142b40 0x7fcf5c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c159f80 con 0x7fcf5c0cf2e0 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c79c0 con 0x7fcf5c142b40 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c7c10 con 0x7fcf5c06b5e0 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf61b82700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c1f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf61b82700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c1f15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49548/0 (socket says 172.21.15.157:49548) 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf61b82700 1 -- 172.21.15.157:0/950958705 learned_addr learned my addr 172.21.15.157:0/950958705 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf62b84700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf5c142b40 0x7fcf5c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf62383700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf5c06b5e0 0x7fcf5c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf62b84700 1 -- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf5c06b5e0 msgr2=0x7fcf5c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf62b84700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf5c06b5e0 0x7fcf5c159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf62b84700 1 -- 172.21.15.157:0/950958705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 msgr2=0x7fcf5c1f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf62b84700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c1f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf62b84700 1 -- 172.21.15.157:0/950958705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0094b0 con 0x7fcf5c142b40 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf61b82700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c1f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf62b84700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf5c142b40 0x7fcf5c0b2aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400cb90 tx=0x7fcf5400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf52ffd700 1 -- 172.21.15.157:0/950958705 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54003c20 con 0x7fcf5c142b40 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf52ffd700 1 -- 172.21.15.157:0/950958705 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54003d80 con 0x7fcf5c142b40 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c1430a0 con 0x7fcf5c142b40 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf52ffd700 1 -- 172.21.15.157:0/950958705 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400aa80 con 0x7fcf5c142b40 2024-04-18T03:37:50.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.875+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c0c81d0 con 0x7fcf5c142b40 2024-04-18T03:37:50.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.879+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c04e650 con 0x7fcf5c142b40 2024-04-18T03:37:50.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.879+0000 7fcf52ffd700 1 -- 172.21.15.157:0/950958705 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf5400abe0 con 0x7fcf5c142b40 2024-04-18T03:37:50.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.879+0000 7fcf52ffd700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcf40066730 0x7fcf40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:50.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.879+0000 7fcf52ffd700 1 -- 172.21.15.157:0/950958705 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf54084b40 con 0x7fcf5c142b40 2024-04-18T03:37:50.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.879+0000 7fcf62383700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcf40066730 0x7fcf40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:50.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.879+0000 7fcf62383700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcf40066730 0x7fcf40068bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f60 tx=0x7fcf58004a70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:50.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:50.891+0000 7fcf52ffd700 1 -- 172.21.15.157:0/950958705 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcf54051ba0 con 0x7fcf5c142b40 2024-04-18T03:37:51.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.059+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf5c0d07c0 con 0x7fcf5c142b40 2024-04-18T03:37:51.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.063+0000 7fcf52ffd700 1 -- 172.21.15.157:0/950958705 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fcf540551c0 con 0x7fcf5c142b40 2024-04-18T03:37:51.068 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:51.068 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:51.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcf40066730 msgr2=0x7fcf40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcf40066730 0x7fcf40068bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f60 tx=0x7fcf58004a70 comp rx=0 tx=0).stop 2024-04-18T03:37:51.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf5c142b40 msgr2=0x7fcf5c0b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf5c142b40 0x7fcf5c0b2aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400cb90 tx=0x7fcf5400cea0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 shutdown_connections 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcf40066730 0x7fcf40068bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf5c142b40 0x7fcf5c0b2aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf5c0cf2e0 0x7fcf5c1f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 --2- 172.21.15.157:0/950958705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf5c06b5e0 0x7fcf5c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 >> 172.21.15.157:0/950958705 conn(0x7fcf5c0b1920 msgr2=0x7fcf5c13e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 shutdown_connections 2024-04-18T03:37:51.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.067+0000 7fcf63385700 1 -- 172.21.15.157:0/950958705 wait complete. 2024-04-18T03:37:51.084 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-18T03:37:51.084 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:37:51.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 Processor -- start 2024-04-18T03:37:51.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 -- start start 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f927c143bd0 0x7f927c071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 0x7f927c06a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f927c06aec0 0x7f927c0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c06b700 con 0x7f927c06aec0 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c15b3c0 con 0x7f927c143bd0 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c143fb0 con 0x7f927c0715c0 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f92817e5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f927c06aec0 0x7f927c0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f92817e5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f927c06aec0 0x7f927c0cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49560/0 (socket says 172.21.15.157:49560) 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f92817e5700 1 -- 172.21.15.157:0/1887666267 learned_addr learned my addr 172.21.15.157:0/1887666267 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:51.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9280fe4700 1 --2- 172.21.15.157:0/1887666267 >> v2:172.21.15.175:3300/0 conn(0x7f927c143bd0 0x7f927c071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f927bfff700 1 --2- 172.21.15.157:0/1887666267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 0x7f927c06a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9280fe4700 1 -- 172.21.15.157:0/1887666267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 msgr2=0x7f927c06a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9280fe4700 1 --2- 172.21.15.157:0/1887666267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 0x7f927c06a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9280fe4700 1 -- 172.21.15.157:0/1887666267 >> v2:172.21.15.157:3300/0 conn(0x7f927c06aec0 msgr2=0x7f927c0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9280fe4700 1 --2- 172.21.15.157:0/1887666267 >> v2:172.21.15.157:3300/0 conn(0x7f927c06aec0 0x7f927c0cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9280fe4700 1 -- 172.21.15.157:0/1887666267 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c071a20 con 0x7f927c143bd0 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f92817e5700 1 --2- 172.21.15.157:0/1887666267 >> v2:172.21.15.157:3300/0 conn(0x7f927c06aec0 0x7f927c0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9280fe4700 1 --2- 172.21.15.157:0/1887666267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 0x7f927c071080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f927c0b42b0 tx=0x7f9264009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=510815c78f7cbbe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f927b7fe700 1 -- 172.21.15.157:0/1887666267 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011830 con 0x7f927c143bd0 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f927b7fe700 1 -- 172.21.15.157:0/1887666267 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9264011990 con 0x7f927c143bd0 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f927b7fe700 1 -- 172.21.15.157:0/1887666267 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011d20 con 0x7f927c143bd0 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 -- 172.21.15.157:0/1887666267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 msgr2=0x7f927c071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.195+0000 7f9283248700 1 --2- 172.21.15.157:0/1887666267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 0x7f927c071080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f927c0b42b0 tx=0x7f9264009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:51.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 -- 172.21.15.157:0/1887666267 shutdown_connections 2024-04-18T03:37:51.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 --2- 172.21.15.157:0/1887666267 >> v2:172.21.15.157:3300/0 conn(0x7f927c06aec0 0x7f927c0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 --2- 172.21.15.157:0/1887666267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 0x7f927c06a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 --2- 172.21.15.157:0/1887666267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 0x7f927c071080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 -- 172.21.15.157:0/1887666267 >> 172.21.15.157:0/1887666267 conn(0x7f927c0b1170 msgr2=0x7f927c06e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:51.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 -- 172.21.15.157:0/1887666267 shutdown_connections 2024-04-18T03:37:51.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 -- 172.21.15.157:0/1887666267 wait complete. 2024-04-18T03:37:51.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 Processor -- start 2024-04-18T03:37:51.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 -- start start 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c06aec0 0x7f927c138660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 0x7f927c0a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 0x7f927c142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c13cfd0 con 0x7f927c06aec0 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c13d2b0 con 0x7f927c143bd0 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.199+0000 7f9283248700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c13d590 con 0x7f927c0715c0 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c06aec0 0x7f927c138660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c06aec0 0x7f927c138660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49570/0 (socket says 172.21.15.157:49570) 2024-04-18T03:37:51.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 -- 172.21.15.157:0/777431975 learned_addr learned my addr 172.21.15.157:0/777431975 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f92817e5700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 0x7f927c142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f927bfff700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 0x7f927c0a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 -- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 msgr2=0x7f927c0a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 0x7f927c0a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 -- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 msgr2=0x7f927c142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 0x7f927c142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 -- 172.21.15.157:0/777431975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9274009570 con 0x7f927c06aec0 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f92817e5700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 0x7f927c142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9280fe4700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c06aec0 0x7f927c138660 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9264009ba0 tx=0x7f9264004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f92797fa700 1 -- 172.21.15.157:0/777431975 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640044d0 con 0x7f927c06aec0 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f92797fa700 1 -- 172.21.15.157:0/777431975 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926401e070 con 0x7f927c06aec0 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92640094b0 con 0x7f927c06aec0 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f92797fa700 1 -- 172.21.15.157:0/777431975 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640038e0 con 0x7f927c06aec0 2024-04-18T03:37:51.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c13db50 con 0x7f927c06aec0 2024-04-18T03:37:51.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c04e6c0 con 0x7f927c06aec0 2024-04-18T03:37:51.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.203+0000 7f92797fa700 1 -- 172.21.15.157:0/777431975 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9264003a40 con 0x7f927c06aec0 2024-04-18T03:37:51.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.207+0000 7f92797fa700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.207+0000 7f92797fa700 1 -- 172.21.15.157:0/777431975 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9264085160 con 0x7f927c06aec0 2024-04-18T03:37:51.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.207+0000 7f927bfff700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.207+0000 7f927bfff700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f925c066730 0x7f925c068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f927c15ae50 tx=0x7f926c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.211+0000 7f92797fa700 1 -- 172.21.15.157:0/777431975 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f92640521f0 con 0x7f927c06aec0 2024-04-18T03:37:51.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.375+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f927c15bb90 con 0x7f925c066730 2024-04-18T03:37:51.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.391+0000 7f92797fa700 1 -- 172.21.15.157:0/777431975 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345246 (secure 0 0 0) 0x7f926c00f040 con 0x7f925c066730 2024-04-18T03:37:51.401 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:51.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f925c066730 msgr2=0x7f925c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f925c066730 0x7f925c068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f927c15ae50 tx=0x7f926c00b040 comp rx=0 tx=0).stop 2024-04-18T03:37:51.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c06aec0 msgr2=0x7f927c138660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c06aec0 0x7f927c138660 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9264009ba0 tx=0x7f9264004770 comp rx=0 tx=0).stop 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 shutdown_connections 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f927c143bd0 0x7f927c142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f927c0715c0 0x7f927c0a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 --2- 172.21.15.157:0/777431975 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f927c06aec0 0x7f927c138660 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 >> 172.21.15.157:0/777431975 conn(0x7f927c0b1170 msgr2=0x7f927c0ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 shutdown_connections 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.399+0000 7f9283248700 1 -- 172.21.15.157:0/777431975 wait complete. 2024-04-18T03:37:51.405 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:37:51.417 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-18T03:37:49.768605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235812,"kb_used_data":3232,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738908,"statfs":{"total":773094113280,"available":772852641792,"internally_reserved":0,"allocated":3309568,"data_stored":2005987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3818,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.077318"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321795+0000","last_change":"2024-04-18T03:37:33.922528+0000","last_active":"2024-04-18T03:37:38.321795+0000","last_peered":"2024-04-18T03:37:38.321795+0000","last_clean":"2024-04-18T03:37:38.321795+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:37:38.321795+0000","last_undegraded":"2024-04-18T03:37:38.321795+0000","last_fullsized":"2024-04-18T03:37:38.321795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:05:10.328715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314103+0000","last_change":"2024-04-18T03:37:34.316836+0000","last_active":"2024-04-18T03:37:38.314103+0000","last_peered":"2024-04-18T03:37:38.314103+0000","last_clean":"2024-04-18T03:37:38.314103+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:37:38.314103+0000","last_undegraded":"2024-04-18T03:37:38.314103+0000","last_fullsized":"2024-04-18T03:37:38.314103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.561206+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:37:38.561206+0000","last_peered":"2024-04-18T03:37:38.561206+0000","last_clean":"2024-04-18T03:37:38.561206+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:37:38.561206+0000","last_undegraded":"2024-04-18T03:37:38.561206+0000","last_fullsized":"2024-04-18T03:37:38.561206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:51:07.334398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314521+0000","last_change":"2024-04-18T03:37:33.925462+0000","last_active":"2024-04-18T03:37:38.314521+0000","last_peered":"2024-04-18T03:37:38.314521+0000","last_clean":"2024-04-18T03:37:38.314521+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:37:38.314521+0000","last_undegraded":"2024-04-18T03:37:38.314521+0000","last_fullsized":"2024-04-18T03:37:38.314521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:23.795590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321515+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:37:38.321515+0000","last_peered":"2024-04-18T03:37:38.321515+0000","last_clean":"2024-04-18T03:37:38.321515+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:37:38.321515+0000","last_undegraded":"2024-04-18T03:37:38.321515+0000","last_fullsized":"2024-04-18T03:37:38.321515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694983+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:37:38.694983+0000","last_peered":"2024-04-18T03:37:38.694983+0000","last_clean":"2024-04-18T03:37:38.694983+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:37:38.694983+0000","last_undegraded":"2024-04-18T03:37:38.694983+0000","last_fullsized":"2024-04-18T03:37:38.694983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548268+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:37:38.548268+0000","last_peered":"2024-04-18T03:37:38.548268+0000","last_clean":"2024-04-18T03:37:38.548268+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:37:38.548268+0000","last_undegraded":"2024-04-18T03:37:38.548268+0000","last_fullsized":"2024-04-18T03:37:38.548268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317644+0000","last_change":"2024-04-18T03:37:34.306151+0000","last_active":"2024-04-18T03:37:38.317644+0000","last_peered":"2024-04-18T03:37:38.317644+0000","last_clean":"2024-04-18T03:37:38.317644+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:37:38.317644+0000","last_undegraded":"2024-04-18T03:37:38.317644+0000","last_fullsized":"2024-04-18T03:37:38.317644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695123+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:37:38.695123+0000","last_peered":"2024-04-18T03:37:38.695123+0000","last_clean":"2024-04-18T03:37:38.695123+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:37:38.695123+0000","last_undegraded":"2024-04-18T03:37:38.695123+0000","last_fullsized":"2024-04-18T03:37:38.695123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550252+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:37:38.550252+0000","last_peered":"2024-04-18T03:37:38.550252+0000","last_clean":"2024-04-18T03:37:38.550252+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:37:38.550252+0000","last_undegraded":"2024-04-18T03:37:38.550252+0000","last_fullsized":"2024-04-18T03:37:38.550252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:12.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317258+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:37:38.317258+0000","last_peered":"2024-04-18T03:37:38.317258+0000","last_clean":"2024-04-18T03:37:38.317258+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:37:38.317258+0000","last_undegraded":"2024-04-18T03:37:38.317258+0000","last_fullsized":"2024-04-18T03:37:38.317258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695246+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:37:38.695246+0000","last_peered":"2024-04-18T03:37:38.695246+0000","last_clean":"2024-04-18T03:37:38.695246+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:37:38.695246+0000","last_undegraded":"2024-04-18T03:37:38.695246+0000","last_fullsized":"2024-04-18T03:37:38.695246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:29:44.713922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785151+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:37:38.785151+0000","last_peered":"2024-04-18T03:37:38.785151+0000","last_clean":"2024-04-18T03:37:38.785151+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:37:38.785151+0000","last_undegraded":"2024-04-18T03:37:38.785151+0000","last_fullsized":"2024-04-18T03:37:38.785151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547248+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:37:38.547248+0000","last_peered":"2024-04-18T03:37:38.547248+0000","last_clean":"2024-04-18T03:37:38.547248+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:37:38.547248+0000","last_undegraded":"2024-04-18T03:37:38.547248+0000","last_fullsized":"2024-04-18T03:37:38.547248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:08.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696507+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:37:38.696507+0000","last_peered":"2024-04-18T03:37:38.696507+0000","last_clean":"2024-04-18T03:37:38.696507+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:37:38.696507+0000","last_undegraded":"2024-04-18T03:37:38.696507+0000","last_fullsized":"2024-04-18T03:37:38.696507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:09:17.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311083+0000","last_change":"2024-04-18T03:37:34.308785+0000","last_active":"2024-04-18T03:37:38.311083+0000","last_peered":"2024-04-18T03:37:38.311083+0000","last_clean":"2024-04-18T03:37:38.311083+0000","last_became_active":"2024-04-18T03:37:34.308536+0000","last_became_peered":"2024-04-18T03:37:34.308536+0000","last_unstale":"2024-04-18T03:37:38.311083+0000","last_undegraded":"2024-04-18T03:37:38.311083+0000","last_fullsized":"2024-04-18T03:37:38.311083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331345+0000","last_change":"2024-04-18T03:37:33.928257+0000","last_active":"2024-04-18T03:37:38.331345+0000","last_peered":"2024-04-18T03:37:38.331345+0000","last_clean":"2024-04-18T03:37:38.331345+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:37:38.331345+0000","last_undegraded":"2024-04-18T03:37:38.331345+0000","last_fullsized":"2024-04-18T03:37:38.331345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696116+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:37:38.696116+0000","last_peered":"2024-04-18T03:37:38.696116+0000","last_clean":"2024-04-18T03:37:38.696116+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:37:38.696116+0000","last_undegraded":"2024-04-18T03:37:38.696116+0000","last_fullsized":"2024-04-18T03:37:38.696116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310799+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:37:38.310799+0000","last_peered":"2024-04-18T03:37:38.310799+0000","last_clean":"2024-04-18T03:37:38.310799+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:37:38.310799+0000","last_undegraded":"2024-04-18T03:37:38.310799+0000","last_fullsized":"2024-04-18T03:37:38.310799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:15:10.489560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331472+0000","last_change":"2024-04-18T03:37:33.921368+0000","last_active":"2024-04-18T03:37:38.331472+0000","last_peered":"2024-04-18T03:37:38.331472+0000","last_clean":"2024-04-18T03:37:38.331472+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:37:38.331472+0000","last_undegraded":"2024-04-18T03:37:38.331472+0000","last_fullsized":"2024-04-18T03:37:38.331472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.557731+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:37:38.557731+0000","last_peered":"2024-04-18T03:37:38.557731+0000","last_clean":"2024-04-18T03:37:38.557731+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:37:38.557731+0000","last_undegraded":"2024-04-18T03:37:38.557731+0000","last_fullsized":"2024-04-18T03:37:38.557731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:26.586052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695700+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:37:38.695700+0000","last_peered":"2024-04-18T03:37:38.695700+0000","last_clean":"2024-04-18T03:37:38.695700+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:37:38.695700+0000","last_undegraded":"2024-04-18T03:37:38.695700+0000","last_fullsized":"2024-04-18T03:37:38.695700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:55.630435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546525+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:37:38.546525+0000","last_peered":"2024-04-18T03:37:38.546525+0000","last_clean":"2024-04-18T03:37:38.546525+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:37:38.546525+0000","last_undegraded":"2024-04-18T03:37:38.546525+0000","last_fullsized":"2024-04-18T03:37:38.546525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:07:09.652439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696398+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:37:38.696398+0000","last_peered":"2024-04-18T03:37:38.696398+0000","last_clean":"2024-04-18T03:37:38.696398+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:37:38.696398+0000","last_undegraded":"2024-04-18T03:37:38.696398+0000","last_fullsized":"2024-04-18T03:37:38.696398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.322177+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:37:38.322177+0000","last_peered":"2024-04-18T03:37:38.322177+0000","last_clean":"2024-04-18T03:37:38.322177+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:37:38.322177+0000","last_undegraded":"2024-04-18T03:37:38.322177+0000","last_fullsized":"2024-04-18T03:37:38.322177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320990+0000","last_change":"2024-04-18T03:37:33.929905+0000","last_active":"2024-04-18T03:37:38.320990+0000","last_peered":"2024-04-18T03:37:38.320990+0000","last_clean":"2024-04-18T03:37:38.320990+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:37:38.320990+0000","last_undegraded":"2024-04-18T03:37:38.320990+0000","last_fullsized":"2024-04-18T03:37:38.320990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694891+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:37:38.694891+0000","last_peered":"2024-04-18T03:37:38.694891+0000","last_clean":"2024-04-18T03:37:38.694891+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:37:38.694891+0000","last_undegraded":"2024-04-18T03:37:38.694891+0000","last_fullsized":"2024-04-18T03:37:38.694891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314450+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:37:38.314450+0000","last_peered":"2024-04-18T03:37:38.314450+0000","last_clean":"2024-04-18T03:37:38.314450+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:37:38.314450+0000","last_undegraded":"2024-04-18T03:37:38.314450+0000","last_fullsized":"2024-04-18T03:37:38.314450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:16.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335509+0000","last_change":"2024-04-18T03:37:33.932828+0000","last_active":"2024-04-18T03:37:38.335509+0000","last_peered":"2024-04-18T03:37:38.335509+0000","last_clean":"2024-04-18T03:37:38.335509+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:37:38.335509+0000","last_undegraded":"2024-04-18T03:37:38.335509+0000","last_fullsized":"2024-04-18T03:37:38.335509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:54.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.556815+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:37:38.556815+0000","last_peered":"2024-04-18T03:37:38.556815+0000","last_clean":"2024-04-18T03:37:38.556815+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:37:38.556815+0000","last_undegraded":"2024-04-18T03:37:38.556815+0000","last_fullsized":"2024-04-18T03:37:38.556815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:45.707050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331249+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:37:38.331249+0000","last_peered":"2024-04-18T03:37:38.331249+0000","last_clean":"2024-04-18T03:37:38.331249+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:37:38.331249+0000","last_undegraded":"2024-04-18T03:37:38.331249+0000","last_fullsized":"2024-04-18T03:37:38.331249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548397+0000","last_change":"2024-04-18T03:37:33.924320+0000","last_active":"2024-04-18T03:37:38.548397+0000","last_peered":"2024-04-18T03:37:38.548397+0000","last_clean":"2024-04-18T03:37:38.548397+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:37:38.548397+0000","last_undegraded":"2024-04-18T03:37:38.548397+0000","last_fullsized":"2024-04-18T03:37:38.548397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.552431+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:37:38.552431+0000","last_peered":"2024-04-18T03:37:38.552431+0000","last_clean":"2024-04-18T03:37:38.552431+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:37:38.552431+0000","last_undegraded":"2024-04-18T03:37:38.552431+0000","last_fullsized":"2024-04-18T03:37:38.552431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317341+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:37:38.317341+0000","last_peered":"2024-04-18T03:37:38.317341+0000","last_clean":"2024-04-18T03:37:38.317341+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:37:38.317341+0000","last_undegraded":"2024-04-18T03:37:38.317341+0000","last_fullsized":"2024-04-18T03:37:38.317341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331339+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:37:38.331339+0000","last_peered":"2024-04-18T03:37:38.331339+0000","last_clean":"2024-04-18T03:37:38.331339+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:37:38.331339+0000","last_undegraded":"2024-04-18T03:37:38.331339+0000","last_fullsized":"2024-04-18T03:37:38.331339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:09.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.342038+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:37:38.342038+0000","last_peered":"2024-04-18T03:37:38.342038+0000","last_clean":"2024-04-18T03:37:38.342038+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:37:38.342038+0000","last_undegraded":"2024-04-18T03:37:38.342038+0000","last_fullsized":"2024-04-18T03:37:38.342038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695911+0000","last_change":"2024-04-18T03:37:34.308669+0000","last_active":"2024-04-18T03:37:38.695911+0000","last_peered":"2024-04-18T03:37:38.695911+0000","last_clean":"2024-04-18T03:37:38.695911+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:37:38.695911+0000","last_undegraded":"2024-04-18T03:37:38.695911+0000","last_fullsized":"2024-04-18T03:37:38.695911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:07.525115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317671+0000","last_change":"2024-04-18T03:37:33.921017+0000","last_active":"2024-04-18T03:37:38.317671+0000","last_peered":"2024-04-18T03:37:38.317671+0000","last_clean":"2024-04-18T03:37:38.317671+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:37:38.317671+0000","last_undegraded":"2024-04-18T03:37:38.317671+0000","last_fullsized":"2024-04-18T03:37:38.317671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341916+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:37:38.341916+0000","last_peered":"2024-04-18T03:37:38.341916+0000","last_clean":"2024-04-18T03:37:38.341916+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:37:38.341916+0000","last_undegraded":"2024-04-18T03:37:38.341916+0000","last_fullsized":"2024-04-18T03:37:38.341916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.330075+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:37:38.330075+0000","last_peered":"2024-04-18T03:37:38.330075+0000","last_clean":"2024-04-18T03:37:38.330075+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:37:38.330075+0000","last_undegraded":"2024-04-18T03:37:38.330075+0000","last_fullsized":"2024-04-18T03:37:38.330075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.318063+0000","last_change":"2024-04-18T03:37:33.916761+0000","last_active":"2024-04-18T03:37:38.318063+0000","last_peered":"2024-04-18T03:37:38.318063+0000","last_clean":"2024-04-18T03:37:38.318063+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:37:38.318063+0000","last_undegraded":"2024-04-18T03:37:38.318063+0000","last_fullsized":"2024-04-18T03:37:38.318063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341986+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:37:38.341986+0000","last_peered":"2024-04-18T03:37:38.341986+0000","last_clean":"2024-04-18T03:37:38.341986+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:37:38.341986+0000","last_undegraded":"2024-04-18T03:37:38.341986+0000","last_fullsized":"2024-04-18T03:37:38.341986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320713+0000","last_change":"2024-04-18T03:37:34.301044+0000","last_active":"2024-04-18T03:37:38.320713+0000","last_peered":"2024-04-18T03:37:38.320713+0000","last_clean":"2024-04-18T03:37:38.320713+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:37:38.320713+0000","last_undegraded":"2024-04-18T03:37:38.320713+0000","last_fullsized":"2024-04-18T03:37:38.320713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546634+0000","last_change":"2024-04-18T03:37:33.922934+0000","last_active":"2024-04-18T03:37:38.546634+0000","last_peered":"2024-04-18T03:37:38.546634+0000","last_clean":"2024-04-18T03:37:38.546634+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:37:38.546634+0000","last_undegraded":"2024-04-18T03:37:38.546634+0000","last_fullsized":"2024-04-18T03:37:38.546634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:21.818428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550643+0000","last_change":"2024-04-18T03:37:38.549484+0000","last_active":"2024-04-18T03:37:38.550643+0000","last_peered":"2024-04-18T03:37:38.550643+0000","last_clean":"2024-04-18T03:37:38.550643+0000","last_became_active":"2024-04-18T03:37:38.549067+0000","last_became_peered":"2024-04-18T03:37:38.549067+0000","last_unstale":"2024-04-18T03:37:38.550643+0000","last_undegraded":"2024-04-18T03:37:38.550643+0000","last_fullsized":"2024-04-18T03:37:38.550643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310097+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:37:38.310097+0000","last_peered":"2024-04-18T03:37:38.310097+0000","last_clean":"2024-04-18T03:37:38.310097+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:37:38.310097+0000","last_undegraded":"2024-04-18T03:37:38.310097+0000","last_fullsized":"2024-04-18T03:37:38.310097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317479+0000","last_change":"2024-04-18T03:37:33.919255+0000","last_active":"2024-04-18T03:37:38.317479+0000","last_peered":"2024-04-18T03:37:38.317479+0000","last_clean":"2024-04-18T03:37:38.317479+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:37:38.317479+0000","last_undegraded":"2024-04-18T03:37:38.317479+0000","last_fullsized":"2024-04-18T03:37:38.317479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546780+0000","last_change":"2024-04-18T03:37:28.881821+0000","last_active":"2024-04-18T03:37:38.546780+0000","last_peered":"2024-04-18T03:37:38.546780+0000","last_clean":"2024-04-18T03:37:38.546780+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:37:38.546780+0000","last_undegraded":"2024-04-18T03:37:38.546780+0000","last_fullsized":"2024-04-18T03:37:38.546780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_clean_scrub_stamp":"2024-04-18T03:37:27.828246+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:15.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785244+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:37:38.785244+0000","last_peered":"2024-04-18T03:37:38.785244+0000","last_clean":"2024-04-18T03:37:38.785244+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:37:38.785244+0000","last_undegraded":"2024-04-18T03:37:38.785244+0000","last_fullsized":"2024-04-18T03:37:38.785244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547381+0000","last_change":"2024-04-18T03:37:34.308036+0000","last_active":"2024-04-18T03:37:38.547381+0000","last_peered":"2024-04-18T03:37:38.547381+0000","last_clean":"2024-04-18T03:37:38.547381+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:37:38.547381+0000","last_undegraded":"2024-04-18T03:37:38.547381+0000","last_fullsized":"2024-04-18T03:37:38.547381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320397+0000","last_change":"2024-04-18T03:37:33.922748+0000","last_active":"2024-04-18T03:37:38.320397+0000","last_peered":"2024-04-18T03:37:38.320397+0000","last_clean":"2024-04-18T03:37:38.320397+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:37:38.320397+0000","last_undegraded":"2024-04-18T03:37:38.320397+0000","last_fullsized":"2024-04-18T03:37:38.320397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785119+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:37:38.785119+0000","last_peered":"2024-04-18T03:37:38.785119+0000","last_clean":"2024-04-18T03:37:38.785119+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:37:38.785119+0000","last_undegraded":"2024-04-18T03:37:38.785119+0000","last_fullsized":"2024-04-18T03:37:38.785119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:02.179174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317509+0000","last_change":"2024-04-18T03:37:34.300176+0000","last_active":"2024-04-18T03:37:38.317509+0000","last_peered":"2024-04-18T03:37:38.317509+0000","last_clean":"2024-04-18T03:37:38.317509+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:37:38.317509+0000","last_undegraded":"2024-04-18T03:37:38.317509+0000","last_fullsized":"2024-04-18T03:37:38.317509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335512+0000","last_change":"2024-04-18T03:37:33.916221+0000","last_active":"2024-04-18T03:37:38.335512+0000","last_peered":"2024-04-18T03:37:38.335512+0000","last_clean":"2024-04-18T03:37:38.335512+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:37:38.335512+0000","last_undegraded":"2024-04-18T03:37:38.335512+0000","last_fullsized":"2024-04-18T03:37:38.335512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:06.510816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.340541+0000","last_change":"2024-04-18T03:37:38.339879+0000","last_active":"2024-04-18T03:37:38.340541+0000","last_peered":"2024-04-18T03:37:38.340541+0000","last_clean":"2024-04-18T03:37:38.340541+0000","last_became_active":"2024-04-18T03:37:38.339495+0000","last_became_peered":"2024-04-18T03:37:38.339495+0000","last_unstale":"2024-04-18T03:37:38.340541+0000","last_undegraded":"2024-04-18T03:37:38.340541+0000","last_fullsized":"2024-04-18T03:37:38.340541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548693+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:37:38.548693+0000","last_peered":"2024-04-18T03:37:38.548693+0000","last_clean":"2024-04-18T03:37:38.548693+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:37:38.548693+0000","last_undegraded":"2024-04-18T03:37:38.548693+0000","last_fullsized":"2024-04-18T03:37:38.548693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319392+0000","last_change":"2024-04-18T03:37:33.923743+0000","last_active":"2024-04-18T03:37:38.319392+0000","last_peered":"2024-04-18T03:37:38.319392+0000","last_clean":"2024-04-18T03:37:38.319392+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:37:38.319392+0000","last_undegraded":"2024-04-18T03:37:38.319392+0000","last_fullsized":"2024-04-18T03:37:38.319392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.555017+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:37:38.555017+0000","last_peered":"2024-04-18T03:37:38.555017+0000","last_clean":"2024-04-18T03:37:38.555017+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:37:38.555017+0000","last_undegraded":"2024-04-18T03:37:38.555017+0000","last_fullsized":"2024-04-18T03:37:38.555017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:26:14.663224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548187+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:37:38.548187+0000","last_peered":"2024-04-18T03:37:38.548187+0000","last_clean":"2024-04-18T03:37:38.548187+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:37:38.548187+0000","last_undegraded":"2024-04-18T03:37:38.548187+0000","last_fullsized":"2024-04-18T03:37:38.548187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311385+0000","last_change":"2024-04-18T03:37:33.923624+0000","last_active":"2024-04-18T03:37:38.311385+0000","last_peered":"2024-04-18T03:37:38.311385+0000","last_clean":"2024-04-18T03:37:38.311385+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:37:38.311385+0000","last_undegraded":"2024-04-18T03:37:38.311385+0000","last_fullsized":"2024-04-18T03:37:38.311385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:30:29.619675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694879+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:37:38.694879+0000","last_peered":"2024-04-18T03:37:38.694879+0000","last_clean":"2024-04-18T03:37:38.694879+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:37:38.694879+0000","last_undegraded":"2024-04-18T03:37:38.694879+0000","last_fullsized":"2024-04-18T03:37:38.694879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:42:56.306731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547148+0000","last_change":"2024-04-18T03:37:34.304075+0000","last_active":"2024-04-18T03:37:38.547148+0000","last_peered":"2024-04-18T03:37:38.547148+0000","last_clean":"2024-04-18T03:37:38.547148+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:37:38.547148+0000","last_undegraded":"2024-04-18T03:37:38.547148+0000","last_fullsized":"2024-04-18T03:37:38.547148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.315734+0000","last_change":"2024-04-18T03:37:33.917032+0000","last_active":"2024-04-18T03:37:38.315734+0000","last_peered":"2024-04-18T03:37:38.315734+0000","last_clean":"2024-04-18T03:37:38.315734+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:37:38.315734+0000","last_undegraded":"2024-04-18T03:37:38.315734+0000","last_fullsized":"2024-04-18T03:37:38.315734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.327254+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:37:38.327254+0000","last_peered":"2024-04-18T03:37:38.327254+0000","last_clean":"2024-04-18T03:37:38.327254+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:37:38.327254+0000","last_undegraded":"2024-04-18T03:37:38.327254+0000","last_fullsized":"2024-04-18T03:37:38.327254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785078+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:37:38.785078+0000","last_peered":"2024-04-18T03:37:38.785078+0000","last_clean":"2024-04-18T03:37:38.785078+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:37:38.785078+0000","last_undegraded":"2024-04-18T03:37:38.785078+0000","last_fullsized":"2024-04-18T03:37:38.785078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.318610+0000","last_change":"2024-04-18T03:37:33.930343+0000","last_active":"2024-04-18T03:37:38.318610+0000","last_peered":"2024-04-18T03:37:38.318610+0000","last_clean":"2024-04-18T03:37:38.318610+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:37:38.318610+0000","last_undegraded":"2024-04-18T03:37:38.318610+0000","last_fullsized":"2024-04-18T03:37:38.318610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.559648+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:37:38.559648+0000","last_peered":"2024-04-18T03:37:38.559648+0000","last_clean":"2024-04-18T03:37:38.559648+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:37:38.559648+0000","last_undegraded":"2024-04-18T03:37:38.559648+0000","last_fullsized":"2024-04-18T03:37:38.559648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:57.028939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547062+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:37:38.547062+0000","last_peered":"2024-04-18T03:37:38.547062+0000","last_clean":"2024-04-18T03:37:38.547062+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:37:38.547062+0000","last_undegraded":"2024-04-18T03:37:38.547062+0000","last_fullsized":"2024-04-18T03:37:38.547062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317588+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:37:38.317588+0000","last_peered":"2024-04-18T03:37:38.317588+0000","last_clean":"2024-04-18T03:37:38.317588+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:37:38.317588+0000","last_undegraded":"2024-04-18T03:37:38.317588+0000","last_fullsized":"2024-04-18T03:37:38.317588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.553566+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:37:38.553566+0000","last_peered":"2024-04-18T03:37:38.553566+0000","last_clean":"2024-04-18T03:37:38.553566+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:37:38.553566+0000","last_undegraded":"2024-04-18T03:37:38.553566+0000","last_fullsized":"2024-04-18T03:37:38.553566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:00:18.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321247+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:37:38.321247+0000","last_peered":"2024-04-18T03:37:38.321247+0000","last_clean":"2024-04-18T03:37:38.321247+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:37:38.321247+0000","last_undegraded":"2024-04-18T03:37:38.321247+0000","last_fullsized":"2024-04-18T03:37:38.321247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321839+0000","last_change":"2024-04-18T03:37:33.927394+0000","last_active":"2024-04-18T03:37:38.321839+0000","last_peered":"2024-04-18T03:37:38.321839+0000","last_clean":"2024-04-18T03:37:38.321839+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:37:38.321839+0000","last_undegraded":"2024-04-18T03:37:38.321839+0000","last_fullsized":"2024-04-18T03:37:38.321839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550202+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:37:38.550202+0000","last_peered":"2024-04-18T03:37:38.550202+0000","last_clean":"2024-04-18T03:37:38.550202+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:37:38.550202+0000","last_undegraded":"2024-04-18T03:37:38.550202+0000","last_fullsized":"2024-04-18T03:37:38.550202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:08.435358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547255+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:37:38.547255+0000","last_peered":"2024-04-18T03:37:38.547255+0000","last_clean":"2024-04-18T03:37:38.547255+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:37:38.547255+0000","last_undegraded":"2024-04-18T03:37:38.547255+0000","last_fullsized":"2024-04-18T03:37:38.547255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:16:02.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:43.600171+0000","last_change":"2024-04-18T03:37:33.929970+0000","last_active":"2024-04-18T03:37:43.600171+0000","last_peered":"2024-04-18T03:37:43.600171+0000","last_clean":"2024-04-18T03:37:43.600171+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:37:43.600171+0000","last_undegraded":"2024-04-18T03:37:43.600171+0000","last_fullsized":"2024-04-18T03:37:43.600171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.472626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341441+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:37:38.341441+0000","last_peered":"2024-04-18T03:37:38.341441+0000","last_clean":"2024-04-18T03:37:38.341441+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:37:38.341441+0000","last_undegraded":"2024-04-18T03:37:38.341441+0000","last_fullsized":"2024-04-18T03:37:38.341441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696422+0000","last_change":"2024-04-18T03:37:34.299294+0000","last_active":"2024-04-18T03:37:38.696422+0000","last_peered":"2024-04-18T03:37:38.696422+0000","last_clean":"2024-04-18T03:37:38.696422+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:37:38.696422+0000","last_undegraded":"2024-04-18T03:37:38.696422+0000","last_fullsized":"2024-04-18T03:37:38.696422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:10.767359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335420+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:37:38.335420+0000","last_peered":"2024-04-18T03:37:38.335420+0000","last_clean":"2024-04-18T03:37:38.335420+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:37:38.335420+0000","last_undegraded":"2024-04-18T03:37:38.335420+0000","last_fullsized":"2024-04-18T03:37:38.335420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:42.808326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695451+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:37:38.695451+0000","last_peered":"2024-04-18T03:37:38.695451+0000","last_clean":"2024-04-18T03:37:38.695451+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:37:38.695451+0000","last_undegraded":"2024-04-18T03:37:38.695451+0000","last_fullsized":"2024-04-18T03:37:38.695451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:40:51.668813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321614+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:37:38.321614+0000","last_peered":"2024-04-18T03:37:38.321614+0000","last_clean":"2024-04-18T03:37:38.321614+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:37:38.321614+0000","last_undegraded":"2024-04-18T03:37:38.321614+0000","last_fullsized":"2024-04-18T03:37:38.321614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317117+0000","last_change":"2024-04-18T03:37:33.931236+0000","last_active":"2024-04-18T03:37:38.317117+0000","last_peered":"2024-04-18T03:37:38.317117+0000","last_clean":"2024-04-18T03:37:38.317117+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:37:38.317117+0000","last_undegraded":"2024-04-18T03:37:38.317117+0000","last_fullsized":"2024-04-18T03:37:38.317117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337871+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:37:38.337871+0000","last_peered":"2024-04-18T03:37:38.337871+0000","last_clean":"2024-04-18T03:37:38.337871+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:37:38.337871+0000","last_undegraded":"2024-04-18T03:37:38.337871+0000","last_fullsized":"2024-04-18T03:37:38.337871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:23.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317036+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:37:38.317036+0000","last_peered":"2024-04-18T03:37:38.317036+0000","last_clean":"2024-04-18T03:37:38.317036+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:37:38.317036+0000","last_undegraded":"2024-04-18T03:37:38.317036+0000","last_fullsized":"2024-04-18T03:37:38.317036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320820+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:37:38.320820+0000","last_peered":"2024-04-18T03:37:38.320820+0000","last_clean":"2024-04-18T03:37:38.320820+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:37:38.320820+0000","last_undegraded":"2024-04-18T03:37:38.320820+0000","last_fullsized":"2024-04-18T03:37:38.320820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.560800+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:37:38.560800+0000","last_peered":"2024-04-18T03:37:38.560800+0000","last_clean":"2024-04-18T03:37:38.560800+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:37:38.560800+0000","last_undegraded":"2024-04-18T03:37:38.560800+0000","last_fullsized":"2024-04-18T03:37:38.560800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:29:14.484508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.561200+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:37:38.561200+0000","last_peered":"2024-04-18T03:37:38.561200+0000","last_clean":"2024-04-18T03:37:38.561200+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:37:38.561200+0000","last_undegraded":"2024-04-18T03:37:38.561200+0000","last_fullsized":"2024-04-18T03:37:38.561200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331388+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:37:38.331388+0000","last_peered":"2024-04-18T03:37:38.331388+0000","last_clean":"2024-04-18T03:37:38.331388+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:37:38.331388+0000","last_undegraded":"2024-04-18T03:37:38.331388+0000","last_fullsized":"2024-04-18T03:37:38.331388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317703+0000","last_change":"2024-04-18T03:37:33.925286+0000","last_active":"2024-04-18T03:37:38.317703+0000","last_peered":"2024-04-18T03:37:38.317703+0000","last_clean":"2024-04-18T03:37:38.317703+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:37:38.317703+0000","last_undegraded":"2024-04-18T03:37:38.317703+0000","last_fullsized":"2024-04-18T03:37:38.317703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785340+0000","last_change":"2024-04-18T03:37:38.330622+0000","last_active":"2024-04-18T03:37:38.785340+0000","last_peered":"2024-04-18T03:37:38.785340+0000","last_clean":"2024-04-18T03:37:38.785340+0000","last_became_active":"2024-04-18T03:37:38.330285+0000","last_became_peered":"2024-04-18T03:37:38.330285+0000","last_unstale":"2024-04-18T03:37:38.785340+0000","last_undegraded":"2024-04-18T03:37:38.785340+0000","last_fullsized":"2024-04-18T03:37:38.785340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310661+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:37:38.310661+0000","last_peered":"2024-04-18T03:37:38.310661+0000","last_clean":"2024-04-18T03:37:38.310661+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:37:38.310661+0000","last_undegraded":"2024-04-18T03:37:38.310661+0000","last_fullsized":"2024-04-18T03:37:38.310661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:14:23.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.312412+0000","last_change":"2024-04-18T03:37:33.932436+0000","last_active":"2024-04-18T03:37:38.312412+0000","last_peered":"2024-04-18T03:37:38.312412+0000","last_clean":"2024-04-18T03:37:38.312412+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:37:38.312412+0000","last_undegraded":"2024-04-18T03:37:38.312412+0000","last_fullsized":"2024-04-18T03:37:38.312412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:11.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319430+0000","last_change":"2024-04-18T03:37:33.929695+0000","last_active":"2024-04-18T03:37:38.319430+0000","last_peered":"2024-04-18T03:37:38.319430+0000","last_clean":"2024-04-18T03:37:38.319430+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:37:38.319430+0000","last_undegraded":"2024-04-18T03:37:38.319430+0000","last_fullsized":"2024-04-18T03:37:38.319430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:29.848633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321745+0000","last_change":"2024-04-18T03:37:34.306548+0000","last_active":"2024-04-18T03:37:38.321745+0000","last_peered":"2024-04-18T03:37:38.321745+0000","last_clean":"2024-04-18T03:37:38.321745+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:37:38.321745+0000","last_undegraded":"2024-04-18T03:37:38.321745+0000","last_fullsized":"2024-04-18T03:37:38.321745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337444+0000","last_change":"2024-04-18T03:37:38.336681+0000","last_active":"2024-04-18T03:37:38.337444+0000","last_peered":"2024-04-18T03:37:38.337444+0000","last_clean":"2024-04-18T03:37:38.337444+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:37:38.337444+0000","last_undegraded":"2024-04-18T03:37:38.337444+0000","last_fullsized":"2024-04-18T03:37:38.337444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:16.022475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311123+0000","last_change":"2024-04-18T03:37:33.923165+0000","last_active":"2024-04-18T03:37:38.311123+0000","last_peered":"2024-04-18T03:37:38.311123+0000","last_clean":"2024-04-18T03:37:38.311123+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:37:38.311123+0000","last_undegraded":"2024-04-18T03:37:38.311123+0000","last_fullsized":"2024-04-18T03:37:38.311123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695662+0000","last_change":"2024-04-18T03:37:34.289192+0000","last_active":"2024-04-18T03:37:38.695662+0000","last_peered":"2024-04-18T03:37:38.695662+0000","last_clean":"2024-04-18T03:37:38.695662+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:37:38.695662+0000","last_undegraded":"2024-04-18T03:37:38.695662+0000","last_fullsized":"2024-04-18T03:37:38.695662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:35.397966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337952+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:37:38.337952+0000","last_peered":"2024-04-18T03:37:38.337952+0000","last_clean":"2024-04-18T03:37:38.337952+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:37:38.337952+0000","last_undegraded":"2024-04-18T03:37:38.337952+0000","last_fullsized":"2024-04-18T03:37:38.337952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:57.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785043+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:37:38.785043+0000","last_peered":"2024-04-18T03:37:38.785043+0000","last_clean":"2024-04-18T03:37:38.785043+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:37:38.785043+0000","last_undegraded":"2024-04-18T03:37:38.785043+0000","last_fullsized":"2024-04-18T03:37:38.785043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317963+0000","last_change":"2024-04-18T03:37:34.295362+0000","last_active":"2024-04-18T03:37:38.317963+0000","last_peered":"2024-04-18T03:37:38.317963+0000","last_clean":"2024-04-18T03:37:38.317963+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:37:38.317963+0000","last_undegraded":"2024-04-18T03:37:38.317963+0000","last_fullsized":"2024-04-18T03:37:38.317963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:13.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317562+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:37:38.317562+0000","last_peered":"2024-04-18T03:37:38.317562+0000","last_clean":"2024-04-18T03:37:38.317562+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:37:38.317562+0000","last_undegraded":"2024-04-18T03:37:38.317562+0000","last_fullsized":"2024-04-18T03:37:38.317562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321663+0000","last_change":"2024-04-18T03:37:34.305580+0000","last_active":"2024-04-18T03:37:38.321663+0000","last_peered":"2024-04-18T03:37:38.321663+0000","last_clean":"2024-04-18T03:37:38.321663+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:37:38.321663+0000","last_undegraded":"2024-04-18T03:37:38.321663+0000","last_fullsized":"2024-04-18T03:37:38.321663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310887+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:37:38.310887+0000","last_peered":"2024-04-18T03:37:38.310887+0000","last_clean":"2024-04-18T03:37:38.310887+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:37:38.310887+0000","last_undegraded":"2024-04-18T03:37:38.310887+0000","last_fullsized":"2024-04-18T03:37:38.310887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335308+0000","last_change":"2024-04-18T03:37:34.298453+0000","last_active":"2024-04-18T03:37:38.335308+0000","last_peered":"2024-04-18T03:37:38.335308+0000","last_clean":"2024-04-18T03:37:38.335308+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:37:38.335308+0000","last_undegraded":"2024-04-18T03:37:38.335308+0000","last_fullsized":"2024-04-18T03:37:38.335308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785319+0000","last_change":"2024-04-18T03:37:34.302543+0000","last_active":"2024-04-18T03:37:38.785319+0000","last_peered":"2024-04-18T03:37:38.785319+0000","last_clean":"2024-04-18T03:37:38.785319+0000","last_became_active":"2024-04-18T03:37:34.302123+0000","last_became_peered":"2024-04-18T03:37:34.302123+0000","last_unstale":"2024-04-18T03:37:38.785319+0000","last_undegraded":"2024-04-18T03:37:38.785319+0000","last_fullsized":"2024-04-18T03:37:38.785319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314210+0000","last_change":"2024-04-18T03:37:34.310319+0000","last_active":"2024-04-18T03:37:38.314210+0000","last_peered":"2024-04-18T03:37:38.314210+0000","last_clean":"2024-04-18T03:37:38.314210+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:37:38.314210+0000","last_undegraded":"2024-04-18T03:37:38.314210+0000","last_fullsized":"2024-04-18T03:37:38.314210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:44.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317614+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:37:38.317614+0000","last_peered":"2024-04-18T03:37:38.317614+0000","last_clean":"2024-04-18T03:37:38.317614+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:37:38.317614+0000","last_undegraded":"2024-04-18T03:37:38.317614+0000","last_fullsized":"2024-04-18T03:37:38.317614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.312313+0000","last_change":"2024-04-18T03:37:34.310229+0000","last_active":"2024-04-18T03:37:38.312313+0000","last_peered":"2024-04-18T03:37:38.312313+0000","last_clean":"2024-04-18T03:37:38.312313+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:37:38.312313+0000","last_undegraded":"2024-04-18T03:37:38.312313+0000","last_fullsized":"2024-04-18T03:37:38.312313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317416+0000","last_change":"2024-04-18T03:37:34.305045+0000","last_active":"2024-04-18T03:37:38.317416+0000","last_peered":"2024-04-18T03:37:38.317416+0000","last_clean":"2024-04-18T03:37:38.317416+0000","last_became_active":"2024-04-18T03:37:34.304455+0000","last_became_peered":"2024-04-18T03:37:34.304455+0000","last_unstale":"2024-04-18T03:37:38.317416+0000","last_undegraded":"2024-04-18T03:37:38.317416+0000","last_fullsized":"2024-04-18T03:37:38.317416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321540+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:37:38.321540+0000","last_peered":"2024-04-18T03:37:38.321540+0000","last_clean":"2024-04-18T03:37:38.321540+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:37:38.321540+0000","last_undegraded":"2024-04-18T03:37:38.321540+0000","last_fullsized":"2024-04-18T03:37:38.321540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785199+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:37:38.785199+0000","last_peered":"2024-04-18T03:37:38.785199+0000","last_clean":"2024-04-18T03:37:38.785199+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:37:38.785199+0000","last_undegraded":"2024-04-18T03:37:38.785199+0000","last_fullsized":"2024-04-18T03:37:38.785199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548268+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:37:38.548268+0000","last_peered":"2024-04-18T03:37:38.548268+0000","last_clean":"2024-04-18T03:37:38.548268+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:37:38.548268+0000","last_undegraded":"2024-04-18T03:37:38.548268+0000","last_fullsized":"2024-04-18T03:37:38.548268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319293+0000","last_change":"2024-04-18T03:37:34.313079+0000","last_active":"2024-04-18T03:37:38.319293+0000","last_peered":"2024-04-18T03:37:38.319293+0000","last_clean":"2024-04-18T03:37:38.319293+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:37:38.319293+0000","last_undegraded":"2024-04-18T03:37:38.319293+0000","last_fullsized":"2024-04-18T03:37:38.319293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:50.485855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317325+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:37:38.317325+0000","last_peered":"2024-04-18T03:37:38.317325+0000","last_clean":"2024-04-18T03:37:38.317325+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:37:38.317325+0000","last_undegraded":"2024-04-18T03:37:38.317325+0000","last_fullsized":"2024-04-18T03:37:38.317325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317809+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:37:38.317809+0000","last_peered":"2024-04-18T03:37:38.317809+0000","last_clean":"2024-04-18T03:37:38.317809+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:37:38.317809+0000","last_undegraded":"2024-04-18T03:37:38.317809+0000","last_fullsized":"2024-04-18T03:37:38.317809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331097+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:37:38.331097+0000","last_peered":"2024-04-18T03:37:38.331097+0000","last_clean":"2024-04-18T03:37:38.331097+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:37:38.331097+0000","last_undegraded":"2024-04-18T03:37:38.331097+0000","last_fullsized":"2024-04-18T03:37:38.331097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321157+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:37:38.321157+0000","last_peered":"2024-04-18T03:37:38.321157+0000","last_clean":"2024-04-18T03:37:38.321157+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:37:38.321157+0000","last_undegraded":"2024-04-18T03:37:38.321157+0000","last_fullsized":"2024-04-18T03:37:38.321157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310074+0000","last_change":"2024-04-18T03:37:34.314282+0000","last_active":"2024-04-18T03:37:38.310074+0000","last_peered":"2024-04-18T03:37:38.310074+0000","last_clean":"2024-04-18T03:37:38.310074+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:37:38.310074+0000","last_undegraded":"2024-04-18T03:37:38.310074+0000","last_fullsized":"2024-04-18T03:37:38.310074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696418+0000","last_change":"2024-04-18T03:37:34.299168+0000","last_active":"2024-04-18T03:37:38.696418+0000","last_peered":"2024-04-18T03:37:38.696418+0000","last_clean":"2024-04-18T03:37:38.696418+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:37:38.696418+0000","last_undegraded":"2024-04-18T03:37:38.696418+0000","last_fullsized":"2024-04-18T03:37:38.696418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:43.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785277+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:37:38.785277+0000","last_peered":"2024-04-18T03:37:38.785277+0000","last_clean":"2024-04-18T03:37:38.785277+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:37:38.785277+0000","last_undegraded":"2024-04-18T03:37:38.785277+0000","last_fullsized":"2024-04-18T03:37:38.785277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785299+0000","last_change":"2024-04-18T03:37:34.302785+0000","last_active":"2024-04-18T03:37:38.785299+0000","last_peered":"2024-04-18T03:37:38.785299+0000","last_clean":"2024-04-18T03:37:38.785299+0000","last_became_active":"2024-04-18T03:37:34.302502+0000","last_became_peered":"2024-04-18T03:37:34.302502+0000","last_unstale":"2024-04-18T03:37:38.785299+0000","last_undegraded":"2024-04-18T03:37:38.785299+0000","last_fullsized":"2024-04-18T03:37:38.785299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548581+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:37:38.548581+0000","last_peered":"2024-04-18T03:37:38.548581+0000","last_clean":"2024-04-18T03:37:38.548581+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:37:38.548581+0000","last_undegraded":"2024-04-18T03:37:38.548581+0000","last_fullsized":"2024-04-18T03:37:38.548581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.309559+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:37:38.309559+0000","last_peered":"2024-04-18T03:37:38.309559+0000","last_clean":"2024-04-18T03:37:38.309559+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:37:38.309559+0000","last_undegraded":"2024-04-18T03:37:38.309559+0000","last_fullsized":"2024-04-18T03:37:38.309559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548317+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:37:38.548317+0000","last_peered":"2024-04-18T03:37:38.548317+0000","last_clean":"2024-04-18T03:37:38.548317+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:37:38.548317+0000","last_undegraded":"2024-04-18T03:37:38.548317+0000","last_fullsized":"2024-04-18T03:37:38.548317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317480+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:37:38.317480+0000","last_peered":"2024-04-18T03:37:38.317480+0000","last_clean":"2024-04-18T03:37:38.317480+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:37:38.317480+0000","last_undegraded":"2024-04-18T03:37:38.317480+0000","last_fullsized":"2024-04-18T03:37:38.317480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546732+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:37:38.546732+0000","last_peered":"2024-04-18T03:37:38.546732+0000","last_clean":"2024-04-18T03:37:38.546732+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:37:38.546732+0000","last_undegraded":"2024-04-18T03:37:38.546732+0000","last_fullsized":"2024-04-18T03:37:38.546732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317122+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:37:38.317122+0000","last_peered":"2024-04-18T03:37:38.317122+0000","last_clean":"2024-04-18T03:37:38.317122+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:37:38.317122+0000","last_undegraded":"2024-04-18T03:37:38.317122+0000","last_fullsized":"2024-04-18T03:37:38.317122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321085+0000","last_change":"2024-04-18T03:37:34.300927+0000","last_active":"2024-04-18T03:37:38.321085+0000","last_peered":"2024-04-18T03:37:38.321085+0000","last_clean":"2024-04-18T03:37:38.321085+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:37:38.321085+0000","last_undegraded":"2024-04-18T03:37:38.321085+0000","last_fullsized":"2024-04-18T03:37:38.321085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335417+0000","last_change":"2024-04-18T03:37:34.289446+0000","last_active":"2024-04-18T03:37:38.335417+0000","last_peered":"2024-04-18T03:37:38.335417+0000","last_clean":"2024-04-18T03:37:38.335417+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:37:38.335417+0000","last_undegraded":"2024-04-18T03:37:38.335417+0000","last_fullsized":"2024-04-18T03:37:38.335417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548415+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:37:38.548415+0000","last_peered":"2024-04-18T03:37:38.548415+0000","last_clean":"2024-04-18T03:37:38.548415+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:37:38.548415+0000","last_undegraded":"2024-04-18T03:37:38.548415+0000","last_fullsized":"2024-04-18T03:37:38.548415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:49.338554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":101805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":693243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":102383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":270336,"data_stored":106089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":102293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":266240,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":860160,"data_stored":691632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:37:51.424 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:37:51.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9d0bef700 1 Processor -- start 2024-04-18T03:37:51.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9d0bef700 1 -- start start 2024-04-18T03:37:51.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9d0bef700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa9cc15d110 0x7fa9cc06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9d0bef700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9cc0ae710 0x7fa9cc0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9d0bef700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc0b0ef0 con 0x7fa9cc0c53f0 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9d0bef700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc0b1240 con 0x7fa9cc15d110 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9d0bef700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc06c400 con 0x7fa9cc0ae710 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9cb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa9cc15d110 0x7fa9cc06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9caffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9cc0ae710 0x7fa9cc0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9cb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa9cc15d110 0x7fa9cc06bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49576/0 (socket says 172.21.15.157:49576) 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9caffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9cc0ae710 0x7fa9cc0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:38040/0 (socket says 172.21.15.157:38040) 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9cb7fe700 1 -- 172.21.15.157:0/1849026957 learned_addr learned my addr 172.21.15.157:0/1849026957 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.531+0000 7fa9cbfff700 1 --1- 172.21.15.157:0/1849026957 >> v1:172.21.15.175:6789/0 conn(0x7fa9cc0c53f0 0x7fa9cc0b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:54522/0 (socket says 172.21.15.157:54522) 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9cb7fe700 1 -- 172.21.15.157:0/1849026957 >> v2:172.21.15.175:3300/0 conn(0x7fa9cc0ae710 msgr2=0x7fa9cc0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9cb7fe700 1 --2- 172.21.15.157:0/1849026957 >> v2:172.21.15.175:3300/0 conn(0x7fa9cc0ae710 0x7fa9cc0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9cb7fe700 1 -- 172.21.15.157:0/1849026957 >> v1:172.21.15.175:6789/0 conn(0x7fa9cc0c53f0 legacy=0x7fa9cc0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9cb7fe700 1 -- 172.21.15.157:0/1849026957 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc06c6e0 con 0x7fa9cc15d110 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9cb7fe700 1 --2- 172.21.15.157:0/1849026957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc06bd20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0b5170 tx=0x7fa9c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e52c8f440c3a558 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9ca7fc700 1 -- 172.21.15.157:0/1849026957 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0011830 con 0x7fa9cc15d110 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9ca7fc700 1 -- 172.21.15.157:0/1849026957 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0011990 con 0x7fa9cc15d110 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9ca7fc700 1 -- 172.21.15.157:0/1849026957 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0011d20 con 0x7fa9cc15d110 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9d0bef700 1 -- 172.21.15.157:0/1849026957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 msgr2=0x7fa9cc06bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/1849026957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc06bd20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0b5170 tx=0x7fa9c0009bf0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9d0bef700 1 -- 172.21.15.157:0/1849026957 shutdown_connections 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/1849026957 >> v2:172.21.15.175:3300/0 conn(0x7fa9cc0ae710 0x7fa9cc0b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/1849026957 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc06bd20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9d0bef700 1 -- 172.21.15.157:0/1849026957 >> 172.21.15.157:0/1849026957 conn(0x7fa9cc098a50 msgr2=0x7fa9cc0cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:51.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9d0bef700 1 -- 172.21.15.157:0/1849026957 shutdown_connections 2024-04-18T03:37:51.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.535+0000 7fa9d0bef700 1 -- 172.21.15.157:0/1849026957 wait complete. 2024-04-18T03:37:51.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9d0bef700 1 Processor -- start 2024-04-18T03:37:51.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9d0bef700 1 -- start start 2024-04-18T03:37:51.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9d0bef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9cc0ae710 0x7fa9cc1f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9d0bef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9cc0c53f0 0x7fa9cc1f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9d0bef700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9d0bef700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc1f3a40 con 0x7fa9cc15d110 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9d0bef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0ccff0 con 0x7fa9cc0c53f0 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9d0bef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0cd2d0 con 0x7fa9cc0ae710 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc0b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49578/0 (socket says 172.21.15.157:49578) 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 -- 172.21.15.157:0/2223147290 learned_addr learned my addr 172.21.15.157:0/2223147290 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9caffd700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9cc0c53f0 0x7fa9cc1f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cb7fe700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9cc0ae710 0x7fa9cc1f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 -- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9cc0ae710 msgr2=0x7fa9cc1f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9cc0ae710 0x7fa9cc1f3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 -- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9cc0c53f0 msgr2=0x7fa9cc1f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9cc0c53f0 0x7fa9cc1f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 -- 172.21.15.157:0/2223147290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c0009570 con 0x7fa9cc15d110 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9cbfff700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc0b40c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400cbc0 tx=0x7fa9c400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.539+0000 7fa9b3fff700 1 -- 172.21.15.157:0/2223147290 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400a9e0 con 0x7fa9cc15d110 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9b3fff700 1 -- 172.21.15.157:0/2223147290 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c400ab40 con 0x7fa9cc15d110 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc0aed10 con 0x7fa9cc15d110 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9b3fff700 1 -- 172.21.15.157:0/2223147290 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4007070 con 0x7fa9cc15d110 2024-04-18T03:37:51.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc0cd890 con 0x7fa9cc15d110 2024-04-18T03:37:51.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc0cfd70 con 0x7fa9cc15d110 2024-04-18T03:37:51.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9b3fff700 1 -- 172.21.15.157:0/2223147290 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9c40071d0 con 0x7fa9cc15d110 2024-04-18T03:37:51.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9b3fff700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa9b8066730 0x7fa9b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9b3fff700 1 -- 172.21.15.157:0/2223147290 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9c4083f10 con 0x7fa9cc15d110 2024-04-18T03:37:51.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.543+0000 7fa9cb7fe700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa9b8066730 0x7fa9b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.547+0000 7fa9cb7fe700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa9b8066730 0x7fa9b8068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0000c00 tx=0x7fa9c0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.551+0000 7fa9b3fff700 1 -- 172.21.15.157:0/2223147290 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa9c40510d0 con 0x7fa9cc15d110 2024-04-18T03:37:51.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.715+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9cc0aeb90 con 0x7fa9b8066730 2024-04-18T03:37:51.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.735+0000 7fa9b3fff700 1 -- 172.21.15.157:0/2223147290 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345246 (secure 0 0 0) 0x7fa9c0011c00 con 0x7fa9b8066730 2024-04-18T03:37:51.741 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:51.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa9b8066730 msgr2=0x7fa9b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa9b8066730 0x7fa9b8068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0000c00 tx=0x7fa9c0008030 comp rx=0 tx=0).stop 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 msgr2=0x7fa9cc0b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc0b40c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400cbc0 tx=0x7fa9c400ced0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 shutdown_connections 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa9b8066730 0x7fa9b8068bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9cc0c53f0 0x7fa9cc1f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9cc15d110 0x7fa9cc0b40c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 --2- 172.21.15.157:0/2223147290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9cc0ae710 0x7fa9cc1f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.739+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 >> 172.21.15.157:0/2223147290 conn(0x7fa9cc098a50 msgr2=0x7fa9cc070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.743+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 shutdown_connections 2024-04-18T03:37:51.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.743+0000 7fa9d0bef700 1 -- 172.21.15.157:0/2223147290 wait complete. 2024-04-18T03:37:51.746 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:37:51.759 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-18T03:37:49.768605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235812,"kb_used_data":3232,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738908,"statfs":{"total":773094113280,"available":772852641792,"internally_reserved":0,"allocated":3309568,"data_stored":2005987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3818,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.077318"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321795+0000","last_change":"2024-04-18T03:37:33.922528+0000","last_active":"2024-04-18T03:37:38.321795+0000","last_peered":"2024-04-18T03:37:38.321795+0000","last_clean":"2024-04-18T03:37:38.321795+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:37:38.321795+0000","last_undegraded":"2024-04-18T03:37:38.321795+0000","last_fullsized":"2024-04-18T03:37:38.321795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:05:10.328715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314103+0000","last_change":"2024-04-18T03:37:34.316836+0000","last_active":"2024-04-18T03:37:38.314103+0000","last_peered":"2024-04-18T03:37:38.314103+0000","last_clean":"2024-04-18T03:37:38.314103+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:37:38.314103+0000","last_undegraded":"2024-04-18T03:37:38.314103+0000","last_fullsized":"2024-04-18T03:37:38.314103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.561206+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:37:38.561206+0000","last_peered":"2024-04-18T03:37:38.561206+0000","last_clean":"2024-04-18T03:37:38.561206+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:37:38.561206+0000","last_undegraded":"2024-04-18T03:37:38.561206+0000","last_fullsized":"2024-04-18T03:37:38.561206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:51:07.334398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314521+0000","last_change":"2024-04-18T03:37:33.925462+0000","last_active":"2024-04-18T03:37:38.314521+0000","last_peered":"2024-04-18T03:37:38.314521+0000","last_clean":"2024-04-18T03:37:38.314521+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:37:38.314521+0000","last_undegraded":"2024-04-18T03:37:38.314521+0000","last_fullsized":"2024-04-18T03:37:38.314521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:23.795590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321515+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:37:38.321515+0000","last_peered":"2024-04-18T03:37:38.321515+0000","last_clean":"2024-04-18T03:37:38.321515+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:37:38.321515+0000","last_undegraded":"2024-04-18T03:37:38.321515+0000","last_fullsized":"2024-04-18T03:37:38.321515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694983+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:37:38.694983+0000","last_peered":"2024-04-18T03:37:38.694983+0000","last_clean":"2024-04-18T03:37:38.694983+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:37:38.694983+0000","last_undegraded":"2024-04-18T03:37:38.694983+0000","last_fullsized":"2024-04-18T03:37:38.694983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548268+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:37:38.548268+0000","last_peered":"2024-04-18T03:37:38.548268+0000","last_clean":"2024-04-18T03:37:38.548268+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:37:38.548268+0000","last_undegraded":"2024-04-18T03:37:38.548268+0000","last_fullsized":"2024-04-18T03:37:38.548268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317644+0000","last_change":"2024-04-18T03:37:34.306151+0000","last_active":"2024-04-18T03:37:38.317644+0000","last_peered":"2024-04-18T03:37:38.317644+0000","last_clean":"2024-04-18T03:37:38.317644+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:37:38.317644+0000","last_undegraded":"2024-04-18T03:37:38.317644+0000","last_fullsized":"2024-04-18T03:37:38.317644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695123+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:37:38.695123+0000","last_peered":"2024-04-18T03:37:38.695123+0000","last_clean":"2024-04-18T03:37:38.695123+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:37:38.695123+0000","last_undegraded":"2024-04-18T03:37:38.695123+0000","last_fullsized":"2024-04-18T03:37:38.695123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550252+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:37:38.550252+0000","last_peered":"2024-04-18T03:37:38.550252+0000","last_clean":"2024-04-18T03:37:38.550252+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:37:38.550252+0000","last_undegraded":"2024-04-18T03:37:38.550252+0000","last_fullsized":"2024-04-18T03:37:38.550252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:12.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317258+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:37:38.317258+0000","last_peered":"2024-04-18T03:37:38.317258+0000","last_clean":"2024-04-18T03:37:38.317258+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:37:38.317258+0000","last_undegraded":"2024-04-18T03:37:38.317258+0000","last_fullsized":"2024-04-18T03:37:38.317258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695246+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:37:38.695246+0000","last_peered":"2024-04-18T03:37:38.695246+0000","last_clean":"2024-04-18T03:37:38.695246+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:37:38.695246+0000","last_undegraded":"2024-04-18T03:37:38.695246+0000","last_fullsized":"2024-04-18T03:37:38.695246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:29:44.713922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785151+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:37:38.785151+0000","last_peered":"2024-04-18T03:37:38.785151+0000","last_clean":"2024-04-18T03:37:38.785151+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:37:38.785151+0000","last_undegraded":"2024-04-18T03:37:38.785151+0000","last_fullsized":"2024-04-18T03:37:38.785151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547248+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:37:38.547248+0000","last_peered":"2024-04-18T03:37:38.547248+0000","last_clean":"2024-04-18T03:37:38.547248+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:37:38.547248+0000","last_undegraded":"2024-04-18T03:37:38.547248+0000","last_fullsized":"2024-04-18T03:37:38.547248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:08.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696507+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:37:38.696507+0000","last_peered":"2024-04-18T03:37:38.696507+0000","last_clean":"2024-04-18T03:37:38.696507+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:37:38.696507+0000","last_undegraded":"2024-04-18T03:37:38.696507+0000","last_fullsized":"2024-04-18T03:37:38.696507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:09:17.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311083+0000","last_change":"2024-04-18T03:37:34.308785+0000","last_active":"2024-04-18T03:37:38.311083+0000","last_peered":"2024-04-18T03:37:38.311083+0000","last_clean":"2024-04-18T03:37:38.311083+0000","last_became_active":"2024-04-18T03:37:34.308536+0000","last_became_peered":"2024-04-18T03:37:34.308536+0000","last_unstale":"2024-04-18T03:37:38.311083+0000","last_undegraded":"2024-04-18T03:37:38.311083+0000","last_fullsized":"2024-04-18T03:37:38.311083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331345+0000","last_change":"2024-04-18T03:37:33.928257+0000","last_active":"2024-04-18T03:37:38.331345+0000","last_peered":"2024-04-18T03:37:38.331345+0000","last_clean":"2024-04-18T03:37:38.331345+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:37:38.331345+0000","last_undegraded":"2024-04-18T03:37:38.331345+0000","last_fullsized":"2024-04-18T03:37:38.331345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696116+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:37:38.696116+0000","last_peered":"2024-04-18T03:37:38.696116+0000","last_clean":"2024-04-18T03:37:38.696116+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:37:38.696116+0000","last_undegraded":"2024-04-18T03:37:38.696116+0000","last_fullsized":"2024-04-18T03:37:38.696116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310799+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:37:38.310799+0000","last_peered":"2024-04-18T03:37:38.310799+0000","last_clean":"2024-04-18T03:37:38.310799+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:37:38.310799+0000","last_undegraded":"2024-04-18T03:37:38.310799+0000","last_fullsized":"2024-04-18T03:37:38.310799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:15:10.489560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331472+0000","last_change":"2024-04-18T03:37:33.921368+0000","last_active":"2024-04-18T03:37:38.331472+0000","last_peered":"2024-04-18T03:37:38.331472+0000","last_clean":"2024-04-18T03:37:38.331472+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:37:38.331472+0000","last_undegraded":"2024-04-18T03:37:38.331472+0000","last_fullsized":"2024-04-18T03:37:38.331472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.557731+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:37:38.557731+0000","last_peered":"2024-04-18T03:37:38.557731+0000","last_clean":"2024-04-18T03:37:38.557731+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:37:38.557731+0000","last_undegraded":"2024-04-18T03:37:38.557731+0000","last_fullsized":"2024-04-18T03:37:38.557731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:26.586052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695700+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:37:38.695700+0000","last_peered":"2024-04-18T03:37:38.695700+0000","last_clean":"2024-04-18T03:37:38.695700+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:37:38.695700+0000","last_undegraded":"2024-04-18T03:37:38.695700+0000","last_fullsized":"2024-04-18T03:37:38.695700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:55.630435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546525+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:37:38.546525+0000","last_peered":"2024-04-18T03:37:38.546525+0000","last_clean":"2024-04-18T03:37:38.546525+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:37:38.546525+0000","last_undegraded":"2024-04-18T03:37:38.546525+0000","last_fullsized":"2024-04-18T03:37:38.546525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:07:09.652439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696398+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:37:38.696398+0000","last_peered":"2024-04-18T03:37:38.696398+0000","last_clean":"2024-04-18T03:37:38.696398+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:37:38.696398+0000","last_undegraded":"2024-04-18T03:37:38.696398+0000","last_fullsized":"2024-04-18T03:37:38.696398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.322177+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:37:38.322177+0000","last_peered":"2024-04-18T03:37:38.322177+0000","last_clean":"2024-04-18T03:37:38.322177+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:37:38.322177+0000","last_undegraded":"2024-04-18T03:37:38.322177+0000","last_fullsized":"2024-04-18T03:37:38.322177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320990+0000","last_change":"2024-04-18T03:37:33.929905+0000","last_active":"2024-04-18T03:37:38.320990+0000","last_peered":"2024-04-18T03:37:38.320990+0000","last_clean":"2024-04-18T03:37:38.320990+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:37:38.320990+0000","last_undegraded":"2024-04-18T03:37:38.320990+0000","last_fullsized":"2024-04-18T03:37:38.320990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694891+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:37:38.694891+0000","last_peered":"2024-04-18T03:37:38.694891+0000","last_clean":"2024-04-18T03:37:38.694891+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:37:38.694891+0000","last_undegraded":"2024-04-18T03:37:38.694891+0000","last_fullsized":"2024-04-18T03:37:38.694891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314450+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:37:38.314450+0000","last_peered":"2024-04-18T03:37:38.314450+0000","last_clean":"2024-04-18T03:37:38.314450+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:37:38.314450+0000","last_undegraded":"2024-04-18T03:37:38.314450+0000","last_fullsized":"2024-04-18T03:37:38.314450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:16.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335509+0000","last_change":"2024-04-18T03:37:33.932828+0000","last_active":"2024-04-18T03:37:38.335509+0000","last_peered":"2024-04-18T03:37:38.335509+0000","last_clean":"2024-04-18T03:37:38.335509+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:37:38.335509+0000","last_undegraded":"2024-04-18T03:37:38.335509+0000","last_fullsized":"2024-04-18T03:37:38.335509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:54.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.556815+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:37:38.556815+0000","last_peered":"2024-04-18T03:37:38.556815+0000","last_clean":"2024-04-18T03:37:38.556815+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:37:38.556815+0000","last_undegraded":"2024-04-18T03:37:38.556815+0000","last_fullsized":"2024-04-18T03:37:38.556815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:45.707050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331249+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:37:38.331249+0000","last_peered":"2024-04-18T03:37:38.331249+0000","last_clean":"2024-04-18T03:37:38.331249+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:37:38.331249+0000","last_undegraded":"2024-04-18T03:37:38.331249+0000","last_fullsized":"2024-04-18T03:37:38.331249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548397+0000","last_change":"2024-04-18T03:37:33.924320+0000","last_active":"2024-04-18T03:37:38.548397+0000","last_peered":"2024-04-18T03:37:38.548397+0000","last_clean":"2024-04-18T03:37:38.548397+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:37:38.548397+0000","last_undegraded":"2024-04-18T03:37:38.548397+0000","last_fullsized":"2024-04-18T03:37:38.548397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.552431+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:37:38.552431+0000","last_peered":"2024-04-18T03:37:38.552431+0000","last_clean":"2024-04-18T03:37:38.552431+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:37:38.552431+0000","last_undegraded":"2024-04-18T03:37:38.552431+0000","last_fullsized":"2024-04-18T03:37:38.552431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317341+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:37:38.317341+0000","last_peered":"2024-04-18T03:37:38.317341+0000","last_clean":"2024-04-18T03:37:38.317341+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:37:38.317341+0000","last_undegraded":"2024-04-18T03:37:38.317341+0000","last_fullsized":"2024-04-18T03:37:38.317341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331339+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:37:38.331339+0000","last_peered":"2024-04-18T03:37:38.331339+0000","last_clean":"2024-04-18T03:37:38.331339+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:37:38.331339+0000","last_undegraded":"2024-04-18T03:37:38.331339+0000","last_fullsized":"2024-04-18T03:37:38.331339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:09.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.342038+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:37:38.342038+0000","last_peered":"2024-04-18T03:37:38.342038+0000","last_clean":"2024-04-18T03:37:38.342038+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:37:38.342038+0000","last_undegraded":"2024-04-18T03:37:38.342038+0000","last_fullsized":"2024-04-18T03:37:38.342038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695911+0000","last_change":"2024-04-18T03:37:34.308669+0000","last_active":"2024-04-18T03:37:38.695911+0000","last_peered":"2024-04-18T03:37:38.695911+0000","last_clean":"2024-04-18T03:37:38.695911+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:37:38.695911+0000","last_undegraded":"2024-04-18T03:37:38.695911+0000","last_fullsized":"2024-04-18T03:37:38.695911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:07.525115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317671+0000","last_change":"2024-04-18T03:37:33.921017+0000","last_active":"2024-04-18T03:37:38.317671+0000","last_peered":"2024-04-18T03:37:38.317671+0000","last_clean":"2024-04-18T03:37:38.317671+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:37:38.317671+0000","last_undegraded":"2024-04-18T03:37:38.317671+0000","last_fullsized":"2024-04-18T03:37:38.317671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341916+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:37:38.341916+0000","last_peered":"2024-04-18T03:37:38.341916+0000","last_clean":"2024-04-18T03:37:38.341916+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:37:38.341916+0000","last_undegraded":"2024-04-18T03:37:38.341916+0000","last_fullsized":"2024-04-18T03:37:38.341916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.330075+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:37:38.330075+0000","last_peered":"2024-04-18T03:37:38.330075+0000","last_clean":"2024-04-18T03:37:38.330075+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:37:38.330075+0000","last_undegraded":"2024-04-18T03:37:38.330075+0000","last_fullsized":"2024-04-18T03:37:38.330075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.318063+0000","last_change":"2024-04-18T03:37:33.916761+0000","last_active":"2024-04-18T03:37:38.318063+0000","last_peered":"2024-04-18T03:37:38.318063+0000","last_clean":"2024-04-18T03:37:38.318063+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:37:38.318063+0000","last_undegraded":"2024-04-18T03:37:38.318063+0000","last_fullsized":"2024-04-18T03:37:38.318063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341986+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:37:38.341986+0000","last_peered":"2024-04-18T03:37:38.341986+0000","last_clean":"2024-04-18T03:37:38.341986+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:37:38.341986+0000","last_undegraded":"2024-04-18T03:37:38.341986+0000","last_fullsized":"2024-04-18T03:37:38.341986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320713+0000","last_change":"2024-04-18T03:37:34.301044+0000","last_active":"2024-04-18T03:37:38.320713+0000","last_peered":"2024-04-18T03:37:38.320713+0000","last_clean":"2024-04-18T03:37:38.320713+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:37:38.320713+0000","last_undegraded":"2024-04-18T03:37:38.320713+0000","last_fullsized":"2024-04-18T03:37:38.320713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546634+0000","last_change":"2024-04-18T03:37:33.922934+0000","last_active":"2024-04-18T03:37:38.546634+0000","last_peered":"2024-04-18T03:37:38.546634+0000","last_clean":"2024-04-18T03:37:38.546634+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:37:38.546634+0000","last_undegraded":"2024-04-18T03:37:38.546634+0000","last_fullsized":"2024-04-18T03:37:38.546634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:21.818428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550643+0000","last_change":"2024-04-18T03:37:38.549484+0000","last_active":"2024-04-18T03:37:38.550643+0000","last_peered":"2024-04-18T03:37:38.550643+0000","last_clean":"2024-04-18T03:37:38.550643+0000","last_became_active":"2024-04-18T03:37:38.549067+0000","last_became_peered":"2024-04-18T03:37:38.549067+0000","last_unstale":"2024-04-18T03:37:38.550643+0000","last_undegraded":"2024-04-18T03:37:38.550643+0000","last_fullsized":"2024-04-18T03:37:38.550643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310097+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:37:38.310097+0000","last_peered":"2024-04-18T03:37:38.310097+0000","last_clean":"2024-04-18T03:37:38.310097+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:37:38.310097+0000","last_undegraded":"2024-04-18T03:37:38.310097+0000","last_fullsized":"2024-04-18T03:37:38.310097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317479+0000","last_change":"2024-04-18T03:37:33.919255+0000","last_active":"2024-04-18T03:37:38.317479+0000","last_peered":"2024-04-18T03:37:38.317479+0000","last_clean":"2024-04-18T03:37:38.317479+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:37:38.317479+0000","last_undegraded":"2024-04-18T03:37:38.317479+0000","last_fullsized":"2024-04-18T03:37:38.317479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546780+0000","last_change":"2024-04-18T03:37:28.881821+0000","last_active":"2024-04-18T03:37:38.546780+0000","last_peered":"2024-04-18T03:37:38.546780+0000","last_clean":"2024-04-18T03:37:38.546780+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:37:38.546780+0000","last_undegraded":"2024-04-18T03:37:38.546780+0000","last_fullsized":"2024-04-18T03:37:38.546780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_clean_scrub_stamp":"2024-04-18T03:37:27.828246+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:15.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785244+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:37:38.785244+0000","last_peered":"2024-04-18T03:37:38.785244+0000","last_clean":"2024-04-18T03:37:38.785244+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:37:38.785244+0000","last_undegraded":"2024-04-18T03:37:38.785244+0000","last_fullsized":"2024-04-18T03:37:38.785244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547381+0000","last_change":"2024-04-18T03:37:34.308036+0000","last_active":"2024-04-18T03:37:38.547381+0000","last_peered":"2024-04-18T03:37:38.547381+0000","last_clean":"2024-04-18T03:37:38.547381+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:37:38.547381+0000","last_undegraded":"2024-04-18T03:37:38.547381+0000","last_fullsized":"2024-04-18T03:37:38.547381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320397+0000","last_change":"2024-04-18T03:37:33.922748+0000","last_active":"2024-04-18T03:37:38.320397+0000","last_peered":"2024-04-18T03:37:38.320397+0000","last_clean":"2024-04-18T03:37:38.320397+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:37:38.320397+0000","last_undegraded":"2024-04-18T03:37:38.320397+0000","last_fullsized":"2024-04-18T03:37:38.320397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785119+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:37:38.785119+0000","last_peered":"2024-04-18T03:37:38.785119+0000","last_clean":"2024-04-18T03:37:38.785119+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:37:38.785119+0000","last_undegraded":"2024-04-18T03:37:38.785119+0000","last_fullsized":"2024-04-18T03:37:38.785119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:02.179174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317509+0000","last_change":"2024-04-18T03:37:34.300176+0000","last_active":"2024-04-18T03:37:38.317509+0000","last_peered":"2024-04-18T03:37:38.317509+0000","last_clean":"2024-04-18T03:37:38.317509+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:37:38.317509+0000","last_undegraded":"2024-04-18T03:37:38.317509+0000","last_fullsized":"2024-04-18T03:37:38.317509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335512+0000","last_change":"2024-04-18T03:37:33.916221+0000","last_active":"2024-04-18T03:37:38.335512+0000","last_peered":"2024-04-18T03:37:38.335512+0000","last_clean":"2024-04-18T03:37:38.335512+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:37:38.335512+0000","last_undegraded":"2024-04-18T03:37:38.335512+0000","last_fullsized":"2024-04-18T03:37:38.335512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:06.510816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.340541+0000","last_change":"2024-04-18T03:37:38.339879+0000","last_active":"2024-04-18T03:37:38.340541+0000","last_peered":"2024-04-18T03:37:38.340541+0000","last_clean":"2024-04-18T03:37:38.340541+0000","last_became_active":"2024-04-18T03:37:38.339495+0000","last_became_peered":"2024-04-18T03:37:38.339495+0000","last_unstale":"2024-04-18T03:37:38.340541+0000","last_undegraded":"2024-04-18T03:37:38.340541+0000","last_fullsized":"2024-04-18T03:37:38.340541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548693+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:37:38.548693+0000","last_peered":"2024-04-18T03:37:38.548693+0000","last_clean":"2024-04-18T03:37:38.548693+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:37:38.548693+0000","last_undegraded":"2024-04-18T03:37:38.548693+0000","last_fullsized":"2024-04-18T03:37:38.548693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319392+0000","last_change":"2024-04-18T03:37:33.923743+0000","last_active":"2024-04-18T03:37:38.319392+0000","last_peered":"2024-04-18T03:37:38.319392+0000","last_clean":"2024-04-18T03:37:38.319392+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:37:38.319392+0000","last_undegraded":"2024-04-18T03:37:38.319392+0000","last_fullsized":"2024-04-18T03:37:38.319392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.555017+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:37:38.555017+0000","last_peered":"2024-04-18T03:37:38.555017+0000","last_clean":"2024-04-18T03:37:38.555017+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:37:38.555017+0000","last_undegraded":"2024-04-18T03:37:38.555017+0000","last_fullsized":"2024-04-18T03:37:38.555017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:26:14.663224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548187+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:37:38.548187+0000","last_peered":"2024-04-18T03:37:38.548187+0000","last_clean":"2024-04-18T03:37:38.548187+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:37:38.548187+0000","last_undegraded":"2024-04-18T03:37:38.548187+0000","last_fullsized":"2024-04-18T03:37:38.548187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311385+0000","last_change":"2024-04-18T03:37:33.923624+0000","last_active":"2024-04-18T03:37:38.311385+0000","last_peered":"2024-04-18T03:37:38.311385+0000","last_clean":"2024-04-18T03:37:38.311385+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:37:38.311385+0000","last_undegraded":"2024-04-18T03:37:38.311385+0000","last_fullsized":"2024-04-18T03:37:38.311385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:30:29.619675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694879+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:37:38.694879+0000","last_peered":"2024-04-18T03:37:38.694879+0000","last_clean":"2024-04-18T03:37:38.694879+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:37:38.694879+0000","last_undegraded":"2024-04-18T03:37:38.694879+0000","last_fullsized":"2024-04-18T03:37:38.694879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:42:56.306731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547148+0000","last_change":"2024-04-18T03:37:34.304075+0000","last_active":"2024-04-18T03:37:38.547148+0000","last_peered":"2024-04-18T03:37:38.547148+0000","last_clean":"2024-04-18T03:37:38.547148+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:37:38.547148+0000","last_undegraded":"2024-04-18T03:37:38.547148+0000","last_fullsized":"2024-04-18T03:37:38.547148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.315734+0000","last_change":"2024-04-18T03:37:33.917032+0000","last_active":"2024-04-18T03:37:38.315734+0000","last_peered":"2024-04-18T03:37:38.315734+0000","last_clean":"2024-04-18T03:37:38.315734+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:37:38.315734+0000","last_undegraded":"2024-04-18T03:37:38.315734+0000","last_fullsized":"2024-04-18T03:37:38.315734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.327254+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:37:38.327254+0000","last_peered":"2024-04-18T03:37:38.327254+0000","last_clean":"2024-04-18T03:37:38.327254+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:37:38.327254+0000","last_undegraded":"2024-04-18T03:37:38.327254+0000","last_fullsized":"2024-04-18T03:37:38.327254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785078+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:37:38.785078+0000","last_peered":"2024-04-18T03:37:38.785078+0000","last_clean":"2024-04-18T03:37:38.785078+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:37:38.785078+0000","last_undegraded":"2024-04-18T03:37:38.785078+0000","last_fullsized":"2024-04-18T03:37:38.785078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.318610+0000","last_change":"2024-04-18T03:37:33.930343+0000","last_active":"2024-04-18T03:37:38.318610+0000","last_peered":"2024-04-18T03:37:38.318610+0000","last_clean":"2024-04-18T03:37:38.318610+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:37:38.318610+0000","last_undegraded":"2024-04-18T03:37:38.318610+0000","last_fullsized":"2024-04-18T03:37:38.318610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.559648+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:37:38.559648+0000","last_peered":"2024-04-18T03:37:38.559648+0000","last_clean":"2024-04-18T03:37:38.559648+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:37:38.559648+0000","last_undegraded":"2024-04-18T03:37:38.559648+0000","last_fullsized":"2024-04-18T03:37:38.559648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:57.028939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547062+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:37:38.547062+0000","last_peered":"2024-04-18T03:37:38.547062+0000","last_clean":"2024-04-18T03:37:38.547062+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:37:38.547062+0000","last_undegraded":"2024-04-18T03:37:38.547062+0000","last_fullsized":"2024-04-18T03:37:38.547062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317588+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:37:38.317588+0000","last_peered":"2024-04-18T03:37:38.317588+0000","last_clean":"2024-04-18T03:37:38.317588+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:37:38.317588+0000","last_undegraded":"2024-04-18T03:37:38.317588+0000","last_fullsized":"2024-04-18T03:37:38.317588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.553566+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:37:38.553566+0000","last_peered":"2024-04-18T03:37:38.553566+0000","last_clean":"2024-04-18T03:37:38.553566+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:37:38.553566+0000","last_undegraded":"2024-04-18T03:37:38.553566+0000","last_fullsized":"2024-04-18T03:37:38.553566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:00:18.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321247+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:37:38.321247+0000","last_peered":"2024-04-18T03:37:38.321247+0000","last_clean":"2024-04-18T03:37:38.321247+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:37:38.321247+0000","last_undegraded":"2024-04-18T03:37:38.321247+0000","last_fullsized":"2024-04-18T03:37:38.321247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321839+0000","last_change":"2024-04-18T03:37:33.927394+0000","last_active":"2024-04-18T03:37:38.321839+0000","last_peered":"2024-04-18T03:37:38.321839+0000","last_clean":"2024-04-18T03:37:38.321839+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:37:38.321839+0000","last_undegraded":"2024-04-18T03:37:38.321839+0000","last_fullsized":"2024-04-18T03:37:38.321839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550202+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:37:38.550202+0000","last_peered":"2024-04-18T03:37:38.550202+0000","last_clean":"2024-04-18T03:37:38.550202+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:37:38.550202+0000","last_undegraded":"2024-04-18T03:37:38.550202+0000","last_fullsized":"2024-04-18T03:37:38.550202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:08.435358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547255+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:37:38.547255+0000","last_peered":"2024-04-18T03:37:38.547255+0000","last_clean":"2024-04-18T03:37:38.547255+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:37:38.547255+0000","last_undegraded":"2024-04-18T03:37:38.547255+0000","last_fullsized":"2024-04-18T03:37:38.547255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:16:02.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:43.600171+0000","last_change":"2024-04-18T03:37:33.929970+0000","last_active":"2024-04-18T03:37:43.600171+0000","last_peered":"2024-04-18T03:37:43.600171+0000","last_clean":"2024-04-18T03:37:43.600171+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:37:43.600171+0000","last_undegraded":"2024-04-18T03:37:43.600171+0000","last_fullsized":"2024-04-18T03:37:43.600171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.472626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341441+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:37:38.341441+0000","last_peered":"2024-04-18T03:37:38.341441+0000","last_clean":"2024-04-18T03:37:38.341441+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:37:38.341441+0000","last_undegraded":"2024-04-18T03:37:38.341441+0000","last_fullsized":"2024-04-18T03:37:38.341441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696422+0000","last_change":"2024-04-18T03:37:34.299294+0000","last_active":"2024-04-18T03:37:38.696422+0000","last_peered":"2024-04-18T03:37:38.696422+0000","last_clean":"2024-04-18T03:37:38.696422+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:37:38.696422+0000","last_undegraded":"2024-04-18T03:37:38.696422+0000","last_fullsized":"2024-04-18T03:37:38.696422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:10.767359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335420+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:37:38.335420+0000","last_peered":"2024-04-18T03:37:38.335420+0000","last_clean":"2024-04-18T03:37:38.335420+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:37:38.335420+0000","last_undegraded":"2024-04-18T03:37:38.335420+0000","last_fullsized":"2024-04-18T03:37:38.335420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:42.808326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695451+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:37:38.695451+0000","last_peered":"2024-04-18T03:37:38.695451+0000","last_clean":"2024-04-18T03:37:38.695451+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:37:38.695451+0000","last_undegraded":"2024-04-18T03:37:38.695451+0000","last_fullsized":"2024-04-18T03:37:38.695451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:40:51.668813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321614+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:37:38.321614+0000","last_peered":"2024-04-18T03:37:38.321614+0000","last_clean":"2024-04-18T03:37:38.321614+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:37:38.321614+0000","last_undegraded":"2024-04-18T03:37:38.321614+0000","last_fullsized":"2024-04-18T03:37:38.321614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317117+0000","last_change":"2024-04-18T03:37:33.931236+0000","last_active":"2024-04-18T03:37:38.317117+0000","last_peered":"2024-04-18T03:37:38.317117+0000","last_clean":"2024-04-18T03:37:38.317117+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:37:38.317117+0000","last_undegraded":"2024-04-18T03:37:38.317117+0000","last_fullsized":"2024-04-18T03:37:38.317117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337871+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:37:38.337871+0000","last_peered":"2024-04-18T03:37:38.337871+0000","last_clean":"2024-04-18T03:37:38.337871+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:37:38.337871+0000","last_undegraded":"2024-04-18T03:37:38.337871+0000","last_fullsized":"2024-04-18T03:37:38.337871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:23.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317036+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:37:38.317036+0000","last_peered":"2024-04-18T03:37:38.317036+0000","last_clean":"2024-04-18T03:37:38.317036+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:37:38.317036+0000","last_undegraded":"2024-04-18T03:37:38.317036+0000","last_fullsized":"2024-04-18T03:37:38.317036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320820+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:37:38.320820+0000","last_peered":"2024-04-18T03:37:38.320820+0000","last_clean":"2024-04-18T03:37:38.320820+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:37:38.320820+0000","last_undegraded":"2024-04-18T03:37:38.320820+0000","last_fullsized":"2024-04-18T03:37:38.320820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.560800+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:37:38.560800+0000","last_peered":"2024-04-18T03:37:38.560800+0000","last_clean":"2024-04-18T03:37:38.560800+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:37:38.560800+0000","last_undegraded":"2024-04-18T03:37:38.560800+0000","last_fullsized":"2024-04-18T03:37:38.560800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:29:14.484508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.561200+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:37:38.561200+0000","last_peered":"2024-04-18T03:37:38.561200+0000","last_clean":"2024-04-18T03:37:38.561200+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:37:38.561200+0000","last_undegraded":"2024-04-18T03:37:38.561200+0000","last_fullsized":"2024-04-18T03:37:38.561200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331388+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:37:38.331388+0000","last_peered":"2024-04-18T03:37:38.331388+0000","last_clean":"2024-04-18T03:37:38.331388+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:37:38.331388+0000","last_undegraded":"2024-04-18T03:37:38.331388+0000","last_fullsized":"2024-04-18T03:37:38.331388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317703+0000","last_change":"2024-04-18T03:37:33.925286+0000","last_active":"2024-04-18T03:37:38.317703+0000","last_peered":"2024-04-18T03:37:38.317703+0000","last_clean":"2024-04-18T03:37:38.317703+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:37:38.317703+0000","last_undegraded":"2024-04-18T03:37:38.317703+0000","last_fullsized":"2024-04-18T03:37:38.317703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785340+0000","last_change":"2024-04-18T03:37:38.330622+0000","last_active":"2024-04-18T03:37:38.785340+0000","last_peered":"2024-04-18T03:37:38.785340+0000","last_clean":"2024-04-18T03:37:38.785340+0000","last_became_active":"2024-04-18T03:37:38.330285+0000","last_became_peered":"2024-04-18T03:37:38.330285+0000","last_unstale":"2024-04-18T03:37:38.785340+0000","last_undegraded":"2024-04-18T03:37:38.785340+0000","last_fullsized":"2024-04-18T03:37:38.785340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310661+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:37:38.310661+0000","last_peered":"2024-04-18T03:37:38.310661+0000","last_clean":"2024-04-18T03:37:38.310661+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:37:38.310661+0000","last_undegraded":"2024-04-18T03:37:38.310661+0000","last_fullsized":"2024-04-18T03:37:38.310661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:14:23.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.312412+0000","last_change":"2024-04-18T03:37:33.932436+0000","last_active":"2024-04-18T03:37:38.312412+0000","last_peered":"2024-04-18T03:37:38.312412+0000","last_clean":"2024-04-18T03:37:38.312412+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:37:38.312412+0000","last_undegraded":"2024-04-18T03:37:38.312412+0000","last_fullsized":"2024-04-18T03:37:38.312412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:11.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319430+0000","last_change":"2024-04-18T03:37:33.929695+0000","last_active":"2024-04-18T03:37:38.319430+0000","last_peered":"2024-04-18T03:37:38.319430+0000","last_clean":"2024-04-18T03:37:38.319430+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:37:38.319430+0000","last_undegraded":"2024-04-18T03:37:38.319430+0000","last_fullsized":"2024-04-18T03:37:38.319430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:29.848633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321745+0000","last_change":"2024-04-18T03:37:34.306548+0000","last_active":"2024-04-18T03:37:38.321745+0000","last_peered":"2024-04-18T03:37:38.321745+0000","last_clean":"2024-04-18T03:37:38.321745+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:37:38.321745+0000","last_undegraded":"2024-04-18T03:37:38.321745+0000","last_fullsized":"2024-04-18T03:37:38.321745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337444+0000","last_change":"2024-04-18T03:37:38.336681+0000","last_active":"2024-04-18T03:37:38.337444+0000","last_peered":"2024-04-18T03:37:38.337444+0000","last_clean":"2024-04-18T03:37:38.337444+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:37:38.337444+0000","last_undegraded":"2024-04-18T03:37:38.337444+0000","last_fullsized":"2024-04-18T03:37:38.337444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:16.022475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311123+0000","last_change":"2024-04-18T03:37:33.923165+0000","last_active":"2024-04-18T03:37:38.311123+0000","last_peered":"2024-04-18T03:37:38.311123+0000","last_clean":"2024-04-18T03:37:38.311123+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:37:38.311123+0000","last_undegraded":"2024-04-18T03:37:38.311123+0000","last_fullsized":"2024-04-18T03:37:38.311123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695662+0000","last_change":"2024-04-18T03:37:34.289192+0000","last_active":"2024-04-18T03:37:38.695662+0000","last_peered":"2024-04-18T03:37:38.695662+0000","last_clean":"2024-04-18T03:37:38.695662+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:37:38.695662+0000","last_undegraded":"2024-04-18T03:37:38.695662+0000","last_fullsized":"2024-04-18T03:37:38.695662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:35.397966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337952+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:37:38.337952+0000","last_peered":"2024-04-18T03:37:38.337952+0000","last_clean":"2024-04-18T03:37:38.337952+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:37:38.337952+0000","last_undegraded":"2024-04-18T03:37:38.337952+0000","last_fullsized":"2024-04-18T03:37:38.337952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:57.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785043+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:37:38.785043+0000","last_peered":"2024-04-18T03:37:38.785043+0000","last_clean":"2024-04-18T03:37:38.785043+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:37:38.785043+0000","last_undegraded":"2024-04-18T03:37:38.785043+0000","last_fullsized":"2024-04-18T03:37:38.785043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317963+0000","last_change":"2024-04-18T03:37:34.295362+0000","last_active":"2024-04-18T03:37:38.317963+0000","last_peered":"2024-04-18T03:37:38.317963+0000","last_clean":"2024-04-18T03:37:38.317963+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:37:38.317963+0000","last_undegraded":"2024-04-18T03:37:38.317963+0000","last_fullsized":"2024-04-18T03:37:38.317963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:13.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317562+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:37:38.317562+0000","last_peered":"2024-04-18T03:37:38.317562+0000","last_clean":"2024-04-18T03:37:38.317562+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:37:38.317562+0000","last_undegraded":"2024-04-18T03:37:38.317562+0000","last_fullsized":"2024-04-18T03:37:38.317562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321663+0000","last_change":"2024-04-18T03:37:34.305580+0000","last_active":"2024-04-18T03:37:38.321663+0000","last_peered":"2024-04-18T03:37:38.321663+0000","last_clean":"2024-04-18T03:37:38.321663+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:37:38.321663+0000","last_undegraded":"2024-04-18T03:37:38.321663+0000","last_fullsized":"2024-04-18T03:37:38.321663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310887+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:37:38.310887+0000","last_peered":"2024-04-18T03:37:38.310887+0000","last_clean":"2024-04-18T03:37:38.310887+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:37:38.310887+0000","last_undegraded":"2024-04-18T03:37:38.310887+0000","last_fullsized":"2024-04-18T03:37:38.310887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335308+0000","last_change":"2024-04-18T03:37:34.298453+0000","last_active":"2024-04-18T03:37:38.335308+0000","last_peered":"2024-04-18T03:37:38.335308+0000","last_clean":"2024-04-18T03:37:38.335308+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:37:38.335308+0000","last_undegraded":"2024-04-18T03:37:38.335308+0000","last_fullsized":"2024-04-18T03:37:38.335308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785319+0000","last_change":"2024-04-18T03:37:34.302543+0000","last_active":"2024-04-18T03:37:38.785319+0000","last_peered":"2024-04-18T03:37:38.785319+0000","last_clean":"2024-04-18T03:37:38.785319+0000","last_became_active":"2024-04-18T03:37:34.302123+0000","last_became_peered":"2024-04-18T03:37:34.302123+0000","last_unstale":"2024-04-18T03:37:38.785319+0000","last_undegraded":"2024-04-18T03:37:38.785319+0000","last_fullsized":"2024-04-18T03:37:38.785319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314210+0000","last_change":"2024-04-18T03:37:34.310319+0000","last_active":"2024-04-18T03:37:38.314210+0000","last_peered":"2024-04-18T03:37:38.314210+0000","last_clean":"2024-04-18T03:37:38.314210+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:37:38.314210+0000","last_undegraded":"2024-04-18T03:37:38.314210+0000","last_fullsized":"2024-04-18T03:37:38.314210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:44.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317614+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:37:38.317614+0000","last_peered":"2024-04-18T03:37:38.317614+0000","last_clean":"2024-04-18T03:37:38.317614+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:37:38.317614+0000","last_undegraded":"2024-04-18T03:37:38.317614+0000","last_fullsized":"2024-04-18T03:37:38.317614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.312313+0000","last_change":"2024-04-18T03:37:34.310229+0000","last_active":"2024-04-18T03:37:38.312313+0000","last_peered":"2024-04-18T03:37:38.312313+0000","last_clean":"2024-04-18T03:37:38.312313+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:37:38.312313+0000","last_undegraded":"2024-04-18T03:37:38.312313+0000","last_fullsized":"2024-04-18T03:37:38.312313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317416+0000","last_change":"2024-04-18T03:37:34.305045+0000","last_active":"2024-04-18T03:37:38.317416+0000","last_peered":"2024-04-18T03:37:38.317416+0000","last_clean":"2024-04-18T03:37:38.317416+0000","last_became_active":"2024-04-18T03:37:34.304455+0000","last_became_peered":"2024-04-18T03:37:34.304455+0000","last_unstale":"2024-04-18T03:37:38.317416+0000","last_undegraded":"2024-04-18T03:37:38.317416+0000","last_fullsized":"2024-04-18T03:37:38.317416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321540+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:37:38.321540+0000","last_peered":"2024-04-18T03:37:38.321540+0000","last_clean":"2024-04-18T03:37:38.321540+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:37:38.321540+0000","last_undegraded":"2024-04-18T03:37:38.321540+0000","last_fullsized":"2024-04-18T03:37:38.321540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785199+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:37:38.785199+0000","last_peered":"2024-04-18T03:37:38.785199+0000","last_clean":"2024-04-18T03:37:38.785199+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:37:38.785199+0000","last_undegraded":"2024-04-18T03:37:38.785199+0000","last_fullsized":"2024-04-18T03:37:38.785199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548268+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:37:38.548268+0000","last_peered":"2024-04-18T03:37:38.548268+0000","last_clean":"2024-04-18T03:37:38.548268+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:37:38.548268+0000","last_undegraded":"2024-04-18T03:37:38.548268+0000","last_fullsized":"2024-04-18T03:37:38.548268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319293+0000","last_change":"2024-04-18T03:37:34.313079+0000","last_active":"2024-04-18T03:37:38.319293+0000","last_peered":"2024-04-18T03:37:38.319293+0000","last_clean":"2024-04-18T03:37:38.319293+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:37:38.319293+0000","last_undegraded":"2024-04-18T03:37:38.319293+0000","last_fullsized":"2024-04-18T03:37:38.319293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:50.485855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317325+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:37:38.317325+0000","last_peered":"2024-04-18T03:37:38.317325+0000","last_clean":"2024-04-18T03:37:38.317325+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:37:38.317325+0000","last_undegraded":"2024-04-18T03:37:38.317325+0000","last_fullsized":"2024-04-18T03:37:38.317325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317809+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:37:38.317809+0000","last_peered":"2024-04-18T03:37:38.317809+0000","last_clean":"2024-04-18T03:37:38.317809+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:37:38.317809+0000","last_undegraded":"2024-04-18T03:37:38.317809+0000","last_fullsized":"2024-04-18T03:37:38.317809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331097+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:37:38.331097+0000","last_peered":"2024-04-18T03:37:38.331097+0000","last_clean":"2024-04-18T03:37:38.331097+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:37:38.331097+0000","last_undegraded":"2024-04-18T03:37:38.331097+0000","last_fullsized":"2024-04-18T03:37:38.331097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321157+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:37:38.321157+0000","last_peered":"2024-04-18T03:37:38.321157+0000","last_clean":"2024-04-18T03:37:38.321157+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:37:38.321157+0000","last_undegraded":"2024-04-18T03:37:38.321157+0000","last_fullsized":"2024-04-18T03:37:38.321157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310074+0000","last_change":"2024-04-18T03:37:34.314282+0000","last_active":"2024-04-18T03:37:38.310074+0000","last_peered":"2024-04-18T03:37:38.310074+0000","last_clean":"2024-04-18T03:37:38.310074+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:37:38.310074+0000","last_undegraded":"2024-04-18T03:37:38.310074+0000","last_fullsized":"2024-04-18T03:37:38.310074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696418+0000","last_change":"2024-04-18T03:37:34.299168+0000","last_active":"2024-04-18T03:37:38.696418+0000","last_peered":"2024-04-18T03:37:38.696418+0000","last_clean":"2024-04-18T03:37:38.696418+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:37:38.696418+0000","last_undegraded":"2024-04-18T03:37:38.696418+0000","last_fullsized":"2024-04-18T03:37:38.696418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:43.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785277+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:37:38.785277+0000","last_peered":"2024-04-18T03:37:38.785277+0000","last_clean":"2024-04-18T03:37:38.785277+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:37:38.785277+0000","last_undegraded":"2024-04-18T03:37:38.785277+0000","last_fullsized":"2024-04-18T03:37:38.785277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785299+0000","last_change":"2024-04-18T03:37:34.302785+0000","last_active":"2024-04-18T03:37:38.785299+0000","last_peered":"2024-04-18T03:37:38.785299+0000","last_clean":"2024-04-18T03:37:38.785299+0000","last_became_active":"2024-04-18T03:37:34.302502+0000","last_became_peered":"2024-04-18T03:37:34.302502+0000","last_unstale":"2024-04-18T03:37:38.785299+0000","last_undegraded":"2024-04-18T03:37:38.785299+0000","last_fullsized":"2024-04-18T03:37:38.785299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548581+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:37:38.548581+0000","last_peered":"2024-04-18T03:37:38.548581+0000","last_clean":"2024-04-18T03:37:38.548581+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:37:38.548581+0000","last_undegraded":"2024-04-18T03:37:38.548581+0000","last_fullsized":"2024-04-18T03:37:38.548581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.309559+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:37:38.309559+0000","last_peered":"2024-04-18T03:37:38.309559+0000","last_clean":"2024-04-18T03:37:38.309559+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:37:38.309559+0000","last_undegraded":"2024-04-18T03:37:38.309559+0000","last_fullsized":"2024-04-18T03:37:38.309559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548317+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:37:38.548317+0000","last_peered":"2024-04-18T03:37:38.548317+0000","last_clean":"2024-04-18T03:37:38.548317+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:37:38.548317+0000","last_undegraded":"2024-04-18T03:37:38.548317+0000","last_fullsized":"2024-04-18T03:37:38.548317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317480+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:37:38.317480+0000","last_peered":"2024-04-18T03:37:38.317480+0000","last_clean":"2024-04-18T03:37:38.317480+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:37:38.317480+0000","last_undegraded":"2024-04-18T03:37:38.317480+0000","last_fullsized":"2024-04-18T03:37:38.317480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546732+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:37:38.546732+0000","last_peered":"2024-04-18T03:37:38.546732+0000","last_clean":"2024-04-18T03:37:38.546732+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:37:38.546732+0000","last_undegraded":"2024-04-18T03:37:38.546732+0000","last_fullsized":"2024-04-18T03:37:38.546732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317122+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:37:38.317122+0000","last_peered":"2024-04-18T03:37:38.317122+0000","last_clean":"2024-04-18T03:37:38.317122+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:37:38.317122+0000","last_undegraded":"2024-04-18T03:37:38.317122+0000","last_fullsized":"2024-04-18T03:37:38.317122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321085+0000","last_change":"2024-04-18T03:37:34.300927+0000","last_active":"2024-04-18T03:37:38.321085+0000","last_peered":"2024-04-18T03:37:38.321085+0000","last_clean":"2024-04-18T03:37:38.321085+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:37:38.321085+0000","last_undegraded":"2024-04-18T03:37:38.321085+0000","last_fullsized":"2024-04-18T03:37:38.321085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335417+0000","last_change":"2024-04-18T03:37:34.289446+0000","last_active":"2024-04-18T03:37:38.335417+0000","last_peered":"2024-04-18T03:37:38.335417+0000","last_clean":"2024-04-18T03:37:38.335417+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:37:38.335417+0000","last_undegraded":"2024-04-18T03:37:38.335417+0000","last_fullsized":"2024-04-18T03:37:38.335417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548415+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:37:38.548415+0000","last_peered":"2024-04-18T03:37:38.548415+0000","last_clean":"2024-04-18T03:37:38.548415+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:37:38.548415+0000","last_undegraded":"2024-04-18T03:37:38.548415+0000","last_fullsized":"2024-04-18T03:37:38.548415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:49.338554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":101805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":693243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":102383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":270336,"data_stored":106089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":102293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":266240,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":860160,"data_stored":691632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:37:51.765 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-18T03:37:51.765 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T03:37:51.765 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T03:37:51.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T03:37:51.766 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-18T03:37:51.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.879+0000 7f6595c5c700 1 Processor -- start 2024-04-18T03:37:51.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.879+0000 7f6595c5c700 1 -- start start 2024-04-18T03:37:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.879+0000 7f6595c5c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f65900cb540 0x7f65900cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.879+0000 7f6595c5c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.879+0000 7f6595c5c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900cbbd0 con 0x7f659006e810 2024-04-18T03:37:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.879+0000 7f6595c5c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65900cc5e0 con 0x7f65900cb540 2024-04-18T03:37:51.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.879+0000 7f6595c5c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900701a0 con 0x7f659006eca0 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6587fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f659006e810 0x7f65900cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:42154/0 (socket says 172.21.15.157:42154) 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6587fff700 1 -- 172.21.15.157:0/1994931586 learned_addr learned my addr 172.21.15.157:0/1994931586 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f659545b700 1 --2- 172.21.15.157:0/1994931586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6594c5a700 1 --2- 172.21.15.157:0/1994931586 >> v2:172.21.15.175:3300/0 conn(0x7f65900cb540 0x7f65900cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f65877fe700 1 -- 172.21.15.157:0/1994931586 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310493201 0 0) 0x7f65900cbbd0 con 0x7f659006e810 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f65877fe700 1 -- 172.21.15.157:0/1994931586 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65780035d0 con 0x7f659006e810 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f659545b700 1 -- 172.21.15.157:0/1994931586 >> v2:172.21.15.175:3300/0 conn(0x7f65900cb540 msgr2=0x7f65900cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f659545b700 1 --2- 172.21.15.157:0/1994931586 >> v2:172.21.15.175:3300/0 conn(0x7f65900cb540 0x7f65900cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f659545b700 1 -- 172.21.15.157:0/1994931586 >> v1:172.21.15.157:6789/0 conn(0x7f659006e810 legacy=0x7f65900cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f659545b700 1 -- 172.21.15.157:0/1994931586 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900cb920 con 0x7f659006eca0 2024-04-18T03:37:51.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f659545b700 1 --2- 172.21.15.157:0/1994931586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590070f20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6588009d90 tx=0x7f658800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca1cd3392c6e9948 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f65877fe700 1 -- 172.21.15.157:0/1994931586 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800e070 con 0x7f659006eca0 2024-04-18T03:37:51.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f65877fe700 1 -- 172.21.15.157:0/1994931586 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658800bb20 con 0x7f659006eca0 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f65877fe700 1 -- 172.21.15.157:0/1994931586 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800be90 con 0x7f659006eca0 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6595c5c700 1 -- 172.21.15.157:0/1994931586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 msgr2=0x7f6590070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6595c5c700 1 --2- 172.21.15.157:0/1994931586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590070f20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6588009d90 tx=0x7f658800b330 comp rx=0 tx=0).stop 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6595c5c700 1 -- 172.21.15.157:0/1994931586 shutdown_connections 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6595c5c700 1 --2- 172.21.15.157:0/1994931586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590070f20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6595c5c700 1 --2- 172.21.15.157:0/1994931586 >> v2:172.21.15.175:3300/0 conn(0x7f65900cb540 0x7f65900cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6595c5c700 1 -- 172.21.15.157:0/1994931586 >> 172.21.15.157:0/1994931586 conn(0x7f65900b1330 msgr2=0x7f659006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6595c5c700 1 -- 172.21.15.157:0/1994931586 shutdown_connections 2024-04-18T03:37:51.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.883+0000 7f6595c5c700 1 -- 172.21.15.157:0/1994931586 wait complete. 2024-04-18T03:37:51.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 Processor -- start 2024-04-18T03:37:51.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 -- start start 2024-04-18T03:37:51.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f659006e810 0x7f659014ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65900cb540 0x7f659014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590147640 con 0x7f659006e810 2024-04-18T03:37:51.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590147920 con 0x7f65900cb540 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6590147c00 con 0x7f659006eca0 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f659006e810 0x7f659014ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f659006e810 0x7f659014ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49588/0 (socket says 172.21.15.157:49588) 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 -- 172.21.15.157:0/39840175 learned_addr learned my addr 172.21.15.157:0/39840175 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6587fff700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f659545b700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65900cb540 0x7f659014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 -- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 msgr2=0x7f6590141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 -- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65900cb540 msgr2=0x7f659014b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65900cb540 0x7f659014b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 -- 172.21.15.157:0/39840175 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588009a70 con 0x7f659006e810 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6594c5a700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f659006e810 0x7f659014ed20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f658c00e840 tx=0x7f658c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f65857fa700 1 -- 172.21.15.157:0/39840175 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0095a0 con 0x7f659006e810 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f65857fa700 1 -- 172.21.15.157:0/39840175 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c013680 con 0x7f659006e810 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659014b4d0 con 0x7f659006e810 2024-04-18T03:37:51.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f65857fa700 1 -- 172.21.15.157:0/39840175 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0139f0 con 0x7f659006e810 2024-04-18T03:37:51.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.887+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6590144960 con 0x7f659006e810 2024-04-18T03:37:51.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.891+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659004e650 con 0x7f659006e810 2024-04-18T03:37:51.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.891+0000 7f65857fa700 1 -- 172.21.15.157:0/39840175 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f658c013b50 con 0x7f659006e810 2024-04-18T03:37:51.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.891+0000 7f65857fa700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f657c066730 0x7f657c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:51.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.891+0000 7f65857fa700 1 -- 172.21.15.157:0/39840175 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f658c084330 con 0x7f659006e810 2024-04-18T03:37:51.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.891+0000 7f6587fff700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f657c066730 0x7f657c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:51.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.891+0000 7f6587fff700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f657c066730 0x7f657c068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65900afd00 tx=0x7f6580007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:51.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:51.895+0000 7f65857fa700 1 -- 172.21.15.157:0/39840175 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f658c051310 con 0x7f659006e810 2024-04-18T03:37:52.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.107+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6590157dd0 con 0x7f659006e810 2024-04-18T03:37:52.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.115+0000 7f65857fa700 1 -- 172.21.15.157:0/39840175 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164890 (secure 0 0 0) 0x7f658c054930 con 0x7f659006e810 2024-04-18T03:37:52.120 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:52.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f657c066730 msgr2=0x7f657c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f657c066730 0x7f657c068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65900afd00 tx=0x7f6580007de0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f659006e810 msgr2=0x7f659014ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f659006e810 0x7f659014ed20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f658c00e840 tx=0x7f658c00eb50 comp rx=0 tx=0).stop 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 shutdown_connections 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f657c066730 0x7f657c068bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65900cb540 0x7f659014b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f659006eca0 0x7f6590141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 --2- 172.21.15.157:0/39840175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f659006e810 0x7f659014ed20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 >> 172.21.15.157:0/39840175 conn(0x7f65900b1330 msgr2=0x7f6590157130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 shutdown_connections 2024-04-18T03:37:52.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.119+0000 7f6595c5c700 1 -- 172.21.15.157:0/39840175 wait complete. 2024-04-18T03:37:52.136 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":25864},{"type":"v1","addr":"172.21.15.175:6833","nonce":25864}]},"active_addr":"172.21.15.175:6833/25864","active_change":"2024-04-18T03:37:21.750230+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":1405799383}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":153062761}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":893566021}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":2888815010}]}]} 2024-04-18T03:37:52.139 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T03:37:52.139 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T03:37:52.139 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:52.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063ffff700 1 Processor -- start 2024-04-18T03:37:52.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063ffff700 1 -- start start 2024-04-18T03:37:52.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f064006e810 0x7f0640141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063ffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f064015b590 0x7f06401445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063ffff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0640144ae0 con 0x7f064006ebf0 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063ffff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0640142f80 con 0x7f064006e810 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063ffff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0640142300 con 0x7f064015b590 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f064006ebf0 0x7f06401433a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36600/0 (socket says 172.21.15.157:36600) 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063f7fe700 1 -- 172.21.15.157:0/1295720042 learned_addr learned my addr 172.21.15.157:0/1295720042 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063effd700 1 --2- 172.21.15.157:0/1295720042 >> v2:172.21.15.157:3300/0 conn(0x7f064006e810 0x7f0640141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063e7fc700 1 --2- 172.21.15.157:0/1295720042 >> v2:172.21.15.175:3300/0 conn(0x7f064015b590 0x7f06401445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063dffb700 1 -- 172.21.15.157:0/1295720042 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701343578 0 0) 0x7f0640144ae0 con 0x7f064006ebf0 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063dffb700 1 -- 172.21.15.157:0/1295720042 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06280035d0 con 0x7f064006ebf0 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063effd700 1 -- 172.21.15.157:0/1295720042 >> v2:172.21.15.175:3300/0 conn(0x7f064015b590 msgr2=0x7f06401445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063effd700 1 --2- 172.21.15.157:0/1295720042 >> v2:172.21.15.175:3300/0 conn(0x7f064015b590 0x7f06401445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063effd700 1 -- 172.21.15.157:0/1295720042 >> v1:172.21.15.157:6789/0 conn(0x7f064006ebf0 legacy=0x7f06401433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.251+0000 7f063effd700 1 -- 172.21.15.157:0/1295720042 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06401425e0 con 0x7f064006e810 2024-04-18T03:37:52.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063effd700 1 --2- 172.21.15.157:0/1295720042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640141c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f064006dec0 tx=0x7f0630009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb78abbf90e1684 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063dffb700 1 -- 172.21.15.157:0/1295720042 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630011830 con 0x7f064006e810 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063dffb700 1 -- 172.21.15.157:0/1295720042 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630011990 con 0x7f064006e810 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063dffb700 1 -- 172.21.15.157:0/1295720042 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630011d20 con 0x7f064006e810 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 -- 172.21.15.157:0/1295720042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 msgr2=0x7f0640141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 --2- 172.21.15.157:0/1295720042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640141c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f064006dec0 tx=0x7f0630009b30 comp rx=0 tx=0).stop 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 -- 172.21.15.157:0/1295720042 shutdown_connections 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 --2- 172.21.15.157:0/1295720042 >> v2:172.21.15.175:3300/0 conn(0x7f064015b590 0x7f06401445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 --2- 172.21.15.157:0/1295720042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640141c00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 -- 172.21.15.157:0/1295720042 >> 172.21.15.157:0/1295720042 conn(0x7f06400b1330 msgr2=0x7f064006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 -- 172.21.15.157:0/1295720042 shutdown_connections 2024-04-18T03:37:52.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 -- 172.21.15.157:0/1295720042 wait complete. 2024-04-18T03:37:52.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 Processor -- start 2024-04-18T03:37:52.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.255+0000 7f063ffff700 1 -- start start 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f064006ebf0 0x7f06401e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f064015b590 0x7f064015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064015ade0 con 0x7f064006e810 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0640137d00 con 0x7f064015b590 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0640137fe0 con 0x7f064006ebf0 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640139fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56534/0 (socket says 172.21.15.157:56534) 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 -- 172.21.15.157:0/1668978229 learned_addr learned my addr 172.21.15.157:0/1668978229 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063e7fc700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f064006ebf0 0x7f06401e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063f7fe700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f064015b590 0x7f064015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 -- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f064006ebf0 msgr2=0x7f06401e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f064006ebf0 0x7f06401e3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 -- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f064015b590 msgr2=0x7f064015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f064015b590 0x7f064015a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 -- 172.21.15.157:0/1668978229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300094b0 con 0x7f064006e810 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063effd700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640139fa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0630009b70 tx=0x7f0630004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f0627fff700 1 -- 172.21.15.157:0/1668978229 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630004380 con 0x7f064006e810 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f0627fff700 1 -- 172.21.15.157:0/1668978229 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063001f070 con 0x7f064006e810 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06401382c0 con 0x7f064006e810 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f0627fff700 1 -- 172.21.15.157:0/1668978229 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300036c0 con 0x7f064006e810 2024-04-18T03:37:52.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06401f0770 con 0x7f064006e810 2024-04-18T03:37:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.259+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06401387e0 con 0x7f064006e810 2024-04-18T03:37:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.263+0000 7f0627fff700 1 -- 172.21.15.157:0/1668978229 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0630021030 con 0x7f064006e810 2024-04-18T03:37:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.263+0000 7f0627fff700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f062c066730 0x7f062c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.263+0000 7f0627fff700 1 -- 172.21.15.157:0/1668978229 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0630085840 con 0x7f064006e810 2024-04-18T03:37:52.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.263+0000 7f063e7fc700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f062c066730 0x7f062c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.263+0000 7f063e7fc700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f062c066730 0x7f062c068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f064006e690 tx=0x7f0634009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.271+0000 7f0627fff700 1 -- 172.21.15.157:0/1668978229 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f06401387e0 con 0x7f064006e810 2024-04-18T03:37:52.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.443+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06401387e0 con 0x7f064006e810 2024-04-18T03:37:52.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f0627fff700 1 -- 172.21.15.157:0/1668978229 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f06401387e0 con 0x7f064006e810 2024-04-18T03:37:52.450 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:52.450 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:52.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f062c066730 msgr2=0x7f062c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f062c066730 0x7f062c068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f064006e690 tx=0x7f0634009240 comp rx=0 tx=0).stop 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 msgr2=0x7f0640139fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640139fa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0630009b70 tx=0x7f0630004770 comp rx=0 tx=0).stop 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 shutdown_connections 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f062c066730 0x7f062c068bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f064015b590 0x7f064015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f064006ebf0 0x7f06401e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 --2- 172.21.15.157:0/1668978229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f064006e810 0x7f0640139fa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 >> 172.21.15.157:0/1668978229 conn(0x7f06400b1330 msgr2=0x7f06401432a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 shutdown_connections 2024-04-18T03:37:52.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.447+0000 7f063ffff700 1 -- 172.21.15.157:0/1668978229 wait complete. 2024-04-18T03:37:52.465 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T03:37:52.466 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:52.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.575+0000 7f766bfff700 1 Processor -- start 2024-04-18T03:37:52.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.575+0000 7f766bfff700 1 -- start start 2024-04-18T03:37:52.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f766c0cbfd0 0x7f766c0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c070450 0x7f766c0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c0cc460 con 0x7f766c15cfa0 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c0ccfe0 con 0x7f766c0cbfd0 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0cc740 con 0x7f766c070450 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766a7fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f766c0cbfd0 0x7f766c0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766affd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f766c15cfa0 0x7f766c0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36604/0 (socket says 172.21.15.157:36604) 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766affd700 1 -- 172.21.15.157:0/2794250730 learned_addr learned my addr 172.21.15.157:0/2794250730 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766b7fe700 1 --2- 172.21.15.157:0/2794250730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c070450 0x7f766c0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766a7fc700 1 -- 172.21.15.157:0/2794250730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c070450 msgr2=0x7f766c0708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766a7fc700 1 --2- 172.21.15.157:0/2794250730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c070450 0x7f766c0708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766a7fc700 1 -- 172.21.15.157:0/2794250730 >> v1:172.21.15.157:6789/0 conn(0x7f766c15cfa0 legacy=0x7f766c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f7669ffb700 1 -- 172.21.15.157:0/2794250730 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684276523 0 0) 0x7f766c0cc460 con 0x7f766c15cfa0 2024-04-18T03:37:52.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766a7fc700 1 -- 172.21.15.157:0/2794250730 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0cca20 con 0x7f766c0cbfd0 2024-04-18T03:37:52.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766a7fc700 1 --2- 172.21.15.157:0/2794250730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c0cbfd0 0x7f766c0cef00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7660009850 tx=0x7f7660009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bf5895bba6748d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f7669ffb700 1 -- 172.21.15.157:0/2794250730 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011830 con 0x7f766c0cbfd0 2024-04-18T03:37:52.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f7669ffb700 1 -- 172.21.15.157:0/2794250730 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660011990 con 0x7f766c0cbfd0 2024-04-18T03:37:52.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f7669ffb700 1 -- 172.21.15.157:0/2794250730 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011d20 con 0x7f766c0cbfd0 2024-04-18T03:37:52.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 -- 172.21.15.157:0/2794250730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c0cbfd0 msgr2=0x7f766c0cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 --2- 172.21.15.157:0/2794250730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c0cbfd0 0x7f766c0cef00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7660009850 tx=0x7f7660009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:52.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 -- 172.21.15.157:0/2794250730 shutdown_connections 2024-04-18T03:37:52.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 --2- 172.21.15.157:0/2794250730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c070450 0x7f766c0708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 --2- 172.21.15.157:0/2794250730 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c0cbfd0 0x7f766c0cef00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 -- 172.21.15.157:0/2794250730 >> 172.21.15.157:0/2794250730 conn(0x7f766c0d0c20 msgr2=0x7f766c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 -- 172.21.15.157:0/2794250730 shutdown_connections 2024-04-18T03:37:52.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.579+0000 7f766bfff700 1 -- 172.21.15.157:0/2794250730 wait complete. 2024-04-18T03:37:52.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766bfff700 1 Processor -- start 2024-04-18T03:37:52.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766bfff700 1 -- start start 2024-04-18T03:37:52.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c070450 0x7f766c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c15cfa0 0x7f766c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f766c1f5e50 0x7f766c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766bfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0c76b0 con 0x7f766c070450 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766bfff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c153a90 con 0x7f766c1f5e50 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766bfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0cab00 con 0x7f766c15cfa0 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c070450 0x7f766c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c070450 0x7f766c0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56552/0 (socket says 172.21.15.157:56552) 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766affd700 1 -- 172.21.15.157:0/1865177242 learned_addr learned my addr 172.21.15.157:0/1865177242 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766a7fc700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c15cfa0 0x7f766c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.583+0000 7f766b7fe700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f766c1f5e50 0x7f766c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766affd700 1 -- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c15cfa0 msgr2=0x7f766c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766affd700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c15cfa0 0x7f766c0ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766affd700 1 -- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f766c1f5e50 msgr2=0x7f766c1510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766affd700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f766c1f5e50 0x7f766c1510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766affd700 1 -- 172.21.15.157:0/1865177242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600094b0 con 0x7f766c070450 2024-04-18T03:37:52.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766affd700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c070450 0x7f766c0c8d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c4e0 tx=0x7f765c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f76537fe700 1 -- 172.21.15.157:0/1865177242 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c005d90 con 0x7f766c070450 2024-04-18T03:37:52.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f76537fe700 1 -- 172.21.15.157:0/1865177242 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c0070d0 con 0x7f766c070450 2024-04-18T03:37:52.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f76537fe700 1 -- 172.21.15.157:0/1865177242 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c007460 con 0x7f766c070450 2024-04-18T03:37:52.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c15d500 con 0x7f766c070450 2024-04-18T03:37:52.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c1f65f0 con 0x7f766c070450 2024-04-18T03:37:52.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c153c40 con 0x7f766c070450 2024-04-18T03:37:52.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f76537fe700 1 -- 172.21.15.157:0/1865177242 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f765c0075c0 con 0x7f766c070450 2024-04-18T03:37:52.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f76537fe700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7658066730 0x7f7658068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f76537fe700 1 -- 172.21.15.157:0/1865177242 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f765c083830 con 0x7f766c070450 2024-04-18T03:37:52.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.587+0000 7f766a7fc700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7658066730 0x7f7658068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.591+0000 7f766a7fc700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7658066730 0x7f7658068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7660009850 tx=0x7f7660008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.595+0000 7f76537fe700 1 -- 172.21.15.157:0/1865177242 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f765c050940 con 0x7f766c070450 2024-04-18T03:37:52.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.759+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f766c04e650 con 0x7f766c070450 2024-04-18T03:37:52.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f76537fe700 1 -- 172.21.15.157:0/1865177242 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f765c053f60 con 0x7f766c070450 2024-04-18T03:37:52.766 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:52.767 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:52.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7658066730 msgr2=0x7f7658068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7658066730 0x7f7658068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7660009850 tx=0x7f7660008030 comp rx=0 tx=0).stop 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c070450 msgr2=0x7f766c0c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c070450 0x7f766c0c8d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c4e0 tx=0x7f765c00c7f0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 shutdown_connections 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7658066730 0x7f7658068bf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f766c1f5e50 0x7f766c1510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f766c15cfa0 0x7f766c0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 --2- 172.21.15.157:0/1865177242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f766c070450 0x7f766c0c8d40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 >> 172.21.15.157:0/1865177242 conn(0x7f766c0d0c20 msgr2=0x7f766c06baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 shutdown_connections 2024-04-18T03:37:52.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.763+0000 7f766bfff700 1 -- 172.21.15.157:0/1865177242 wait complete. 2024-04-18T03:37:52.781 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T03:37:52.781 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T03:37:52.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T03:37:52.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-18T03:37:52.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-18T03:37:52.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-18T03:37:52.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-18T03:37:52.784 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-18T03:37:52.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.927+0000 7f1a51d56700 1 Processor -- start 2024-04-18T03:37:52.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.927+0000 7f1a51d56700 1 -- start start 2024-04-18T03:37:52.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.927+0000 7f1a51d56700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1a4c143400 0x7f1a4c0aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.927+0000 7f1a51d56700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1a4c160d50 0x7f1a4c161180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.927+0000 7f1a51d56700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c1616c0 con 0x7f1a4c06a4b0 2024-04-18T03:37:52.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.927+0000 7f1a51d56700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c06aa50 con 0x7f1a4c143400 2024-04-18T03:37:52.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.927+0000 7f1a51d56700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c06ad30 con 0x7f1a4c160d50 2024-04-18T03:37:52.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1a4c143400 0x7f1a4c0aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4b7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1a4c143400 0x7f1a4c0aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56556/0 (socket says 172.21.15.157:56556) 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4b7fe700 1 -- 172.21.15.157:0/2146907851 learned_addr learned my addr 172.21.15.157:0/2146907851 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4bfff700 1 --2- 172.21.15.157:0/2146907851 >> v2:172.21.15.175:3300/0 conn(0x7f1a4c160d50 0x7f1a4c161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4b7fe700 1 -- 172.21.15.157:0/2146907851 >> v2:172.21.15.175:3300/0 conn(0x7f1a4c160d50 msgr2=0x7f1a4c161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4b7fe700 1 --2- 172.21.15.157:0/2146907851 >> v2:172.21.15.175:3300/0 conn(0x7f1a4c160d50 0x7f1a4c161180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4b7fe700 1 -- 172.21.15.157:0/2146907851 >> v1:172.21.15.175:6789/0 conn(0x7f1a4c06a4b0 legacy=0x7f1a4c06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4b7fe700 1 -- 172.21.15.157:0/2146907851 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c06b010 con 0x7f1a4c143400 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4b7fe700 1 --2- 172.21.15.157:0/2146907851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c143400 0x7f1a4c0aba10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c071a00 tx=0x7f1a3c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60e2ce7e1178197 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4affd700 1 -- 172.21.15.157:0/2146907851 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c004230 con 0x7f1a4c143400 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4affd700 1 -- 172.21.15.157:0/2146907851 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c004390 con 0x7f1a4c143400 2024-04-18T03:37:52.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a4affd700 1 -- 172.21.15.157:0/2146907851 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0036c0 con 0x7f1a4c143400 2024-04-18T03:37:52.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a51d56700 1 -- 172.21.15.157:0/2146907851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c143400 msgr2=0x7f1a4c0aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a51d56700 1 --2- 172.21.15.157:0/2146907851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c143400 0x7f1a4c0aba10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c071a00 tx=0x7f1a3c009bf0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a51d56700 1 -- 172.21.15.157:0/2146907851 shutdown_connections 2024-04-18T03:37:52.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a51d56700 1 --2- 172.21.15.157:0/2146907851 >> v2:172.21.15.175:3300/0 conn(0x7f1a4c160d50 0x7f1a4c161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a51d56700 1 --2- 172.21.15.157:0/2146907851 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c143400 0x7f1a4c0aba10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a51d56700 1 -- 172.21.15.157:0/2146907851 >> 172.21.15.157:0/2146907851 conn(0x7f1a4c06e730 msgr2=0x7f1a4c06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f3b75474700 1 Processor -- start 2024-04-18T03:37:52.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a51d56700 1 -- 172.21.15.157:0/2146907851 shutdown_connections 2024-04-18T03:37:52.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f3b75474700 1 -- start start 2024-04-18T03:37:52.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f3b75474700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3b680e6870 0x7f3b680e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f3b75474700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3b680e4260 0x7f3b680511e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f1a51d56700 1 -- 172.21.15.157:0/2146907851 wait complete. 2024-04-18T03:37:52.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f3b75474700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b680531b0 con 0x7f3b68050d60 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f3b75474700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b680e6c50 con 0x7f3b680e6870 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.931+0000 7f3b75474700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b68052fa0 con 0x7f3b680e4260 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6effd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3b680e6870 0x7f3b680e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6effd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3b680e6870 0x7f3b680e49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56570/0 (socket says 172.21.15.157:56570) 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6effd700 1 -- 172.21.15.157:0/1591648950 learned_addr learned my addr 172.21.15.157:0/1591648950 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6f7fe700 1 --2- 172.21.15.157:0/1591648950 >> v2:172.21.15.175:3300/0 conn(0x7f3b680e4260 0x7f3b680511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6effd700 1 -- 172.21.15.157:0/1591648950 >> v2:172.21.15.175:3300/0 conn(0x7f3b680e4260 msgr2=0x7f3b680511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6effd700 1 --2- 172.21.15.157:0/1591648950 >> v2:172.21.15.175:3300/0 conn(0x7f3b680e4260 0x7f3b680511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6effd700 1 -- 172.21.15.157:0/1591648950 >> v1:172.21.15.175:6789/0 conn(0x7f3b68050d60 legacy=0x7f3b680e3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6effd700 1 -- 172.21.15.157:0/1591648950 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68053490 con 0x7f3b680e6870 2024-04-18T03:37:52.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6effd700 1 --2- 172.21.15.157:0/1591648950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b680e6870 0x7f3b680e49f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b6803b520 tx=0x7f3b60009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c07e77365bac95b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7b43a700 1 Processor -- start 2024-04-18T03:37:52.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f9c4a2bf700 1 Processor -- start 2024-04-18T03:37:52.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7b43a700 1 -- start start 2024-04-18T03:37:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f9c4a2bf700 1 -- start start 2024-04-18T03:37:52.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6dffb700 1 -- 172.21.15.157:0/1591648950 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60011830 con 0x7f3b680e6870 2024-04-18T03:37:52.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6dffb700 1 -- 172.21.15.157:0/1591648950 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b60011990 con 0x7f3b680e6870 2024-04-18T03:37:52.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b6dffb700 1 -- 172.21.15.157:0/1591648950 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60011d20 con 0x7f3b680e6870 2024-04-18T03:37:52.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f68f4448700 1 Processor -- start 2024-04-18T03:37:52.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b75474700 1 -- 172.21.15.157:0/1591648950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b680e6870 msgr2=0x7f3b680e49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b75474700 1 --2- 172.21.15.157:0/1591648950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b680e6870 0x7f3b680e49f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b6803b520 tx=0x7f3b60009bf0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7b43a700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e740cd9b0 0x7f4e740cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7b43a700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e74141950 con 0x7f4e74141570 2024-04-18T03:37:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7b43a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e740b2930 con 0x7f4e740cc400 2024-04-18T03:37:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7b43a700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e740ccdd0 con 0x7f4e740cd9b0 2024-04-18T03:37:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7a438700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f4e74141570 0x7f4e74141d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36616/0 (socket says 172.21.15.157:36616) 2024-04-18T03:37:52.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7a438700 1 -- 172.21.15.157:0/2379263851 learned_addr learned my addr 172.21.15.157:0/2379263851 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f4e7ac39700 1 --2- 172.21.15.157:0/2379263851 >> v2:172.21.15.175:3300/0 conn(0x7f4e740cd9b0 0x7f4e740cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a51d56700 1 Processor -- start 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a51d56700 1 -- start start 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a51d56700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a4c06a4b0 0x7f1a4c13d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a51d56700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c143400 0x7f1a4c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a51d56700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c160d50 0x7f1a4c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a51d56700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c13e180 con 0x7f1a4c160d50 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a51d56700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c15d790 con 0x7f1a4c143400 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a51d56700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0af430 con 0x7f1a4c06a4b0 2024-04-18T03:37:52.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c160d50 0x7f1a4c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c160d50 0x7f1a4c0cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56584/0 (socket says 172.21.15.157:56584) 2024-04-18T03:37:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4bfff700 1 -- 172.21.15.157:0/2075952579 learned_addr learned my addr 172.21.15.157:0/2075952579 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4b7fe700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a4c06a4b0 0x7f1a4c13d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a43fff700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c143400 0x7f1a4c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b75474700 1 -- 172.21.15.157:0/1591648950 shutdown_connections 2024-04-18T03:37:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b75474700 1 --2- 172.21.15.157:0/1591648950 >> v2:172.21.15.175:3300/0 conn(0x7f3b680e4260 0x7f3b680511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b75474700 1 --2- 172.21.15.157:0/1591648950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b680e6870 0x7f3b680e49f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f3b75474700 1 -- 172.21.15.157:0/1591648950 >> 172.21.15.157:0/1591648950 conn(0x7f3b680553d0 msgr2=0x7f3b680557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f434aaf5700 1 Processor -- start 2024-04-18T03:37:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f68f4448700 1 -- start start 2024-04-18T03:37:52.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f434aaf5700 1 -- start start 2024-04-18T03:37:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e79436700 1 -- 172.21.15.157:0/2379263851 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215936414 0 0) 0x7f4e74141950 con 0x7f4e74141570 2024-04-18T03:37:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e79436700 1 -- 172.21.15.157:0/2379263851 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e600035d0 con 0x7f4e74141570 2024-04-18T03:37:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4bfff700 1 -- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a4c06a4b0 msgr2=0x7f1a4c13d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4bfff700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a4c06a4b0 0x7f1a4c13d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4bfff700 1 -- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c143400 msgr2=0x7f1a4c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4bfff700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a4c143400 0x7f1a4c0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f1a4bfff700 1 -- 172.21.15.157:0/2075952579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c009570 con 0x7f1a4c160d50 2024-04-18T03:37:52.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 -- 172.21.15.157:0/1591648950 shutdown_connections 2024-04-18T03:37:52.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f9c4a2bf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c440ce240 0x7f9c44160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.935+0000 7f9c4a2bf700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c4406ad50 0x7f9c44161290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c440ac0b0 con 0x7f9c440ce620 2024-04-18T03:37:52.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4406bfb0 con 0x7f9c4406ad50 2024-04-18T03:37:52.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4406b3a0 con 0x7f9c440ce240 2024-04-18T03:37:52.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f4448700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68ec06c8f0 0x7f68ec142880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f4448700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68ec071080 0x7f68ec0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f1a4bfff700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c160d50 0x7f1a4c0cce70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a44007ec0 tx=0x7f1a4400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 -- 172.21.15.157:0/1591648950 wait complete. 2024-04-18T03:37:52.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c43fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c440ce240 0x7f9c44160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c43fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c440ce240 0x7f9c44160d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60598/0 (socket says 172.21.15.157:60598) 2024-04-18T03:37:52.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c43fff700 1 -- 172.21.15.157:0/855620413 learned_addr learned my addr 172.21.15.157:0/855620413 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e79436700 1 -- 172.21.15.157:0/2379263851 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769515407 0 0) 0x7f4e740b2930 con 0x7f4e740cc400 2024-04-18T03:37:52.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e79436700 1 -- 172.21.15.157:0/2379263851 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e74141950 con 0x7f4e740cc400 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e7ac39700 1 -- 172.21.15.157:0/2379263851 >> v1:172.21.15.175:6789/0 conn(0x7f4e740cc400 legacy=0x7f4e740cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e7ac39700 1 -- 172.21.15.157:0/2379263851 >> v1:172.21.15.157:6789/0 conn(0x7f4e74141570 legacy=0x7f4e74141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e7ac39700 1 -- 172.21.15.157:0/2379263851 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e740b1d20 con 0x7f4e740cd9b0 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f4448700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ec0cbc70 con 0x7f68ec15cdb0 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f4448700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec0cbef0 con 0x7f68ec071080 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f4448700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ec0b1cb0 con 0x7f68ec06c8f0 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f29e5700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f68ec15cdb0 0x7f68ec15d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36630/0 (socket says 172.21.15.157:36630) 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f29e5700 1 -- 172.21.15.157:0/440189390 learned_addr learned my addr 172.21.15.157:0/440189390 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:52.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f21e4700 1 --2- 172.21.15.157:0/440189390 >> v2:172.21.15.175:3300/0 conn(0x7f68ec06c8f0 0x7f68ec142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4885c700 1 --2- 172.21.15.157:0/855620413 >> v2:172.21.15.175:3300/0 conn(0x7f9c4406ad50 0x7f9c44161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c43fff700 1 -- 172.21.15.157:0/855620413 >> v2:172.21.15.175:3300/0 conn(0x7f9c4406ad50 msgr2=0x7f9c44161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c43fff700 1 --2- 172.21.15.157:0/855620413 >> v2:172.21.15.175:3300/0 conn(0x7f9c4406ad50 0x7f9c44161290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c43fff700 1 -- 172.21.15.157:0/855620413 >> v1:172.21.15.175:6789/0 conn(0x7f9c440ce620 legacy=0x7f9c4406a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f19e3700 1 --2- 172.21.15.157:0/440189390 >> v2:172.21.15.157:3300/0 conn(0x7f68ec071080 0x7f68ec0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f11e2700 1 -- 172.21.15.157:0/440189390 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931784881 0 0) 0x7f68ec0cbc70 con 0x7f68ec15cdb0 2024-04-18T03:37:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f11e2700 1 -- 172.21.15.157:0/440189390 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d80035d0 con 0x7f68ec15cdb0 2024-04-18T03:37:52.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c43fff700 1 -- 172.21.15.157:0/855620413 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4406b680 con 0x7f9c440ce240 2024-04-18T03:37:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f21e4700 1 -- 172.21.15.157:0/440189390 >> v2:172.21.15.157:3300/0 conn(0x7f68ec071080 msgr2=0x7f68ec0cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f434aaf5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f434406a4b0 0x7f434406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f434aaf5700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f434406c030 0x7f4344160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f434aaf5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434406aa50 con 0x7f4344143400 2024-04-18T03:37:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f434aaf5700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434406ad30 con 0x7f434406a4b0 2024-04-18T03:37:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f434aaf5700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434406b010 con 0x7f434406c030 2024-04-18T03:37:52.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f43492f2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f434406a4b0 0x7f434406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f43492f2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f434406a4b0 0x7f434406baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56604/0 (socket says 172.21.15.157:56604) 2024-04-18T03:37:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f43492f2700 1 -- 172.21.15.157:0/2460163637 learned_addr learned my addr 172.21.15.157:0/2460163637 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f21e4700 1 --2- 172.21.15.157:0/440189390 >> v2:172.21.15.157:3300/0 conn(0x7f68ec071080 0x7f68ec0cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f21e4700 1 -- 172.21.15.157:0/440189390 >> v1:172.21.15.157:6789/0 conn(0x7f68ec15cdb0 legacy=0x7f68ec15d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f21e4700 1 -- 172.21.15.157:0/440189390 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec0b1f90 con 0x7f68ec06c8f0 2024-04-18T03:37:52.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f19e3700 1 --2- 172.21.15.157:0/440189390 >> v2:172.21.15.157:3300/0 conn(0x7f68ec071080 0x7f68ec0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:52.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e7ac39700 1 --2- 172.21.15.157:0/2379263851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e740cd9b0 0x7f4e740cc890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009850 tx=0x7f4e70009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba08a70133f8d6f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c43fff700 1 --2- 172.21.15.157:0/855620413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c440ce240 0x7f9c44160d50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009e80 tx=0x7f9c3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d99d00fa3ee5e79e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f434a2f4700 1 --2- 172.21.15.157:0/2460163637 >> v2:172.21.15.175:3300/0 conn(0x7f434406c030 0x7f4344160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f43492f2700 1 -- 172.21.15.157:0/2460163637 >> v2:172.21.15.175:3300/0 conn(0x7f434406c030 msgr2=0x7f4344160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f43492f2700 1 --2- 172.21.15.157:0/2460163637 >> v2:172.21.15.175:3300/0 conn(0x7f434406c030 0x7f4344160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f43492f2700 1 -- 172.21.15.157:0/2460163637 >> v1:172.21.15.175:6789/0 conn(0x7f4344143400 legacy=0x7f43440aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f43492f2700 1 -- 172.21.15.157:0/2460163637 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434406b2f0 con 0x7f434406a4b0 2024-04-18T03:37:52.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f21e4700 1 --2- 172.21.15.157:0/440189390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68ec06c8f0 0x7f68ec142880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0b4030 tx=0x7f68e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=718c60e7a82c3622 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 Processor -- start 2024-04-18T03:37:52.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 -- start start 2024-04-18T03:37:52.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f434a2f4700 1 --2- 172.21.15.157:0/2460163637 >> v2:172.21.15.175:3300/0 conn(0x7f434406c030 0x7f4344160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:52.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c42ffd700 1 -- 172.21.15.157:0/855620413 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00e070 con 0x7f9c440ce240 2024-04-18T03:37:52.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c42ffd700 1 -- 172.21.15.157:0/855620413 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c003a40 con 0x7f9c440ce240 2024-04-18T03:37:52.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c42ffd700 1 -- 172.21.15.157:0/855620413 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c003df0 con 0x7f9c440ce240 2024-04-18T03:37:52.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e79436700 1 -- 172.21.15.157:0/2379263851 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70011830 con 0x7f4e740cd9b0 2024-04-18T03:37:52.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e79436700 1 -- 172.21.15.157:0/2379263851 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e70011990 con 0x7f4e740cd9b0 2024-04-18T03:37:52.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e79436700 1 -- 172.21.15.157:0/2379263851 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70011d20 con 0x7f4e740cd9b0 2024-04-18T03:37:52.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400ede0 con 0x7f1a4c160d50 2024-04-18T03:37:52.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f43492f2700 1 --2- 172.21.15.157:0/2460163637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 0x7f434406baf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4344071a00 tx=0x7f4334009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397e437e3b09fc57 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44014420 con 0x7f1a4c160d50 2024-04-18T03:37:52.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a440147d0 con 0x7f1a4c160d50 2024-04-18T03:37:52.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c0af6a0 con 0x7f1a4c160d50 2024-04-18T03:37:52.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c15d9e0 con 0x7f1a4c160d50 2024-04-18T03:37:52.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/855620413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c440ce240 msgr2=0x7f9c44160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 --2- 172.21.15.157:0/855620413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c440ce240 0x7f9c44160d50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009e80 tx=0x7f9c3c00b330 comp rx=0 tx=0).stop 2024-04-18T03:37:52.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b68050d60 0x7f3b68030e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b680e4260 0x7f3b680ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b680e6870 0x7f3b680ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e7b43a700 1 -- 172.21.15.157:0/2379263851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e740cd9b0 msgr2=0x7f4e740cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4e7b43a700 1 --2- 172.21.15.157:0/2379263851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e740cd9b0 0x7f4e740cc890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009850 tx=0x7f4e70009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:52.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f11e2700 1 -- 172.21.15.157:0/440189390 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e400e070 con 0x7f68ec06c8f0 2024-04-18T03:37:52.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f11e2700 1 -- 172.21.15.157:0/440189390 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e400bb20 con 0x7f68ec06c8f0 2024-04-18T03:37:52.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f68f11e2700 1 -- 172.21.15.157:0/440189390 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e400be90 con 0x7f68ec06c8f0 2024-04-18T03:37:52.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680ce9c0 con 0x7f3b68050d60 2024-04-18T03:37:52.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680cd3e0 con 0x7f3b680e4260 2024-04-18T03:37:52.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b75474700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680cd6c0 con 0x7f3b680e6870 2024-04-18T03:37:52.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/855620413 shutdown_connections 2024-04-18T03:37:52.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 --2- 172.21.15.157:0/855620413 >> v2:172.21.15.175:3300/0 conn(0x7f9c4406ad50 0x7f9c44161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 --2- 172.21.15.157:0/855620413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c440ce240 0x7f9c44160d50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/855620413 >> 172.21.15.157:0/855620413 conn(0x7f9c4406e730 msgr2=0x7f9c4406eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/855620413 shutdown_connections 2024-04-18T03:37:52.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b6f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b680e6870 0x7f3b680ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b6effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b68050d60 0x7f3b68030e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b6f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b680e6870 0x7f3b680ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60606/0 (socket says 172.21.15.157:60606) 2024-04-18T03:37:52.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f3b6f7fe700 1 -- 172.21.15.157:0/327500715 learned_addr learned my addr 172.21.15.157:0/327500715 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f68f4448700 1 -- 172.21.15.157:0/440189390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68ec06c8f0 msgr2=0x7f68ec142880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f68f4448700 1 --2- 172.21.15.157:0/440189390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68ec06c8f0 0x7f68ec142880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0b4030 tx=0x7f68e400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:52.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a4c06c200 con 0x7f1a4c160d50 2024-04-18T03:37:52.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b6e7fc700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b680e4260 0x7f3b680ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b6effd700 1 -- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b680e6870 msgr2=0x7f3b680ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b6effd700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b680e6870 0x7f3b680ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b6effd700 1 -- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b680e4260 msgr2=0x7f3b680ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b6effd700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b680e4260 0x7f3b680ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b6effd700 1 -- 172.21.15.157:0/327500715 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b60009570 con 0x7f3b68050d60 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b6e7fc700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b680e4260 0x7f3b680ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b6effd700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b68050d60 0x7f3b68030e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b60016000 tx=0x7f3b60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b577fe700 1 -- 172.21.15.157:0/327500715 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60004590 con 0x7f3b68050d60 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b577fe700 1 -- 172.21.15.157:0/327500715 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6001f070 con 0x7f3b68050d60 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b577fe700 1 -- 172.21.15.157:0/327500715 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60003900 con 0x7f3b68050d60 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b680cd9a0 con 0x7f3b68050d60 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b680cdf60 con 0x7f3b68050d60 2024-04-18T03:37:52.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f4348af1700 1 -- 172.21.15.157:0/2460163637 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400b8a0 con 0x7f434406a4b0 2024-04-18T03:37:52.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f4348af1700 1 -- 172.21.15.157:0/2460163637 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433400ba00 con 0x7f434406a4b0 2024-04-18T03:37:52.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f4348af1700 1 -- 172.21.15.157:0/2460163637 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400bd70 con 0x7f434406a4b0 2024-04-18T03:37:52.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f434aaf5700 1 -- 172.21.15.157:0/2460163637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 msgr2=0x7f434406baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f434aaf5700 1 --2- 172.21.15.157:0/2460163637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 0x7f434406baf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4344071a00 tx=0x7f4334009bf0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.939+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/855620413 wait complete. 2024-04-18T03:37:52.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4a2bf700 1 Processor -- start 2024-04-18T03:37:52.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4a2bf700 1 -- start start 2024-04-18T03:37:52.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f4e7b43a700 1 -- 172.21.15.157:0/2379263851 shutdown_connections 2024-04-18T03:37:52.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f4e7b43a700 1 --2- 172.21.15.157:0/2379263851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e740cd9b0 0x7f4e740cc890 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f4e7b43a700 1 -- 172.21.15.157:0/2379263851 >> 172.21.15.157:0/2379263851 conn(0x7f4e7406e730 msgr2=0x7f4e7406eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f68f4448700 1 -- 172.21.15.157:0/440189390 shutdown_connections 2024-04-18T03:37:52.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f68f4448700 1 --2- 172.21.15.157:0/440189390 >> v2:172.21.15.157:3300/0 conn(0x7f68ec071080 0x7f68ec0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f68f4448700 1 --2- 172.21.15.157:0/440189390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68ec06c8f0 0x7f68ec142880 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f68f4448700 1 -- 172.21.15.157:0/440189390 >> 172.21.15.157:0/440189390 conn(0x7f68ec06e730 msgr2=0x7f68ec06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a44014930 con 0x7f1a4c160d50 2024-04-18T03:37:52.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4a2bf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c4406ad50 0x7f9c4415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4a2bf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c440ce240 0x7f9c440ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4a2bf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c440ce620 0x7f9c4413b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4a2bf700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44143b20 con 0x7f9c440ce620 2024-04-18T03:37:52.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4a2bf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440cd580 con 0x7f9c440ce240 2024-04-18T03:37:52.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4a2bf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44143dc0 con 0x7f9c4406ad50 2024-04-18T03:37:52.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f3b577fe700 1 -- 172.21.15.157:0/327500715 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b60003a60 con 0x7f3b68050d60 2024-04-18T03:37:52.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f68f4448700 1 -- 172.21.15.157:0/440189390 shutdown_connections 2024-04-18T03:37:52.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f434aaf5700 1 -- 172.21.15.157:0/2460163637 shutdown_connections 2024-04-18T03:37:52.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f434aaf5700 1 --2- 172.21.15.157:0/2460163637 >> v2:172.21.15.175:3300/0 conn(0x7f434406c030 0x7f4344160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f434aaf5700 1 --2- 172.21.15.157:0/2460163637 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 0x7f434406baf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f434aaf5700 1 -- 172.21.15.157:0/2460163637 >> 172.21.15.157:0/2460163637 conn(0x7f434406e730 msgr2=0x7f434406eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:52.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f4e7b43a700 1 -- 172.21.15.157:0/2379263851 shutdown_connections 2024-04-18T03:37:52.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f4e7b43a700 1 -- 172.21.15.157:0/2379263851 wait complete. 2024-04-18T03:37:52.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c440ce620 0x7f9c4413b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f434aaf5700 1 -- 172.21.15.157:0/2460163637 shutdown_connections 2024-04-18T03:37:52.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c440ce620 0x7f9c4413b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56632/0 (socket says 172.21.15.157:56632) 2024-04-18T03:37:52.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 -- 172.21.15.157:0/3684997589 learned_addr learned my addr 172.21.15.157:0/3684997589 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f68f4448700 1 -- 172.21.15.157:0/440189390 wait complete. 2024-04-18T03:37:52.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c43fff700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c4406ad50 0x7f9c4415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c437fe700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c440ce240 0x7f9c440ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f434aaf5700 1 -- 172.21.15.157:0/2460163637 wait complete. 2024-04-18T03:37:52.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f3b577fe700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3b58066870 0x7f3b58068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f3b577fe700 1 -- 172.21.15.157:0/327500715 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b60021070 con 0x7f3b68050d60 2024-04-18T03:37:52.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4e7b43a700 1 Processor -- start 2024-04-18T03:37:52.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a48ff9700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1a2c066830 0x7f1a2c068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a44084b00 con 0x7f1a4c160d50 2024-04-18T03:37:52.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a4b7fe700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1a2c066830 0x7f1a2c068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a48ff9700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7f1a2c06fe70 0x7f1a2c0722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 --> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a2c072980 con 0x7f1a2c06fe70 2024-04-18T03:37:52.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a44086ea0 con 0x7f1a4c160d50 2024-04-18T03:37:52.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a43fff700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7f1a2c06fe70 0x7f1a2c0722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f3b6e7fc700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3b58066870 0x7f3b58068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a4b7fe700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1a2c066830 0x7f1a2c068cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c071a00 tx=0x7f1a3c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f68f4448700 1 Processor -- start 2024-04-18T03:37:52.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a43fff700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7f1a2c06fe70 0x7f1a2c0722b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4e7b43a700 1 -- start start 2024-04-18T03:37:52.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f3b6e7fc700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3b58066870 0x7f3b58068d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b7004ff20 tx=0x7f3b70073980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434aaf5700 1 Processor -- start 2024-04-18T03:37:52.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434aaf5700 1 -- start start 2024-04-18T03:37:52.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434aaf5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 0x7f434415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434aaf5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f434406c030 0x7f434415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434aaf5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344143400 0x7f434412d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434aaf5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434415ea80 con 0x7f434406a4b0 2024-04-18T03:37:52.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434aaf5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434415de70 con 0x7f4344143400 2024-04-18T03:37:52.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 -- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c4406ad50 msgr2=0x7f9c4415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c4406ad50 0x7f9c4415b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434aaf5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434415e150 con 0x7f434406c030 2024-04-18T03:37:52.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 -- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c440ce240 msgr2=0x7f9c440ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c440ce240 0x7f9c440ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 -- 172.21.15.157:0/3684997589 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c009b30 con 0x7f9c440ce620 2024-04-18T03:37:52.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.943+0000 7f9c4885c700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c440ce620 0x7f9c4413b4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400e810 tx=0x7f9c3400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400c070 con 0x7f9c440ce620 2024-04-18T03:37:52.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c441440a0 con 0x7f9c440ce620 2024-04-18T03:37:52.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c440cd240 con 0x7f9c440ce620 2024-04-18T03:37:52.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c34013650 con 0x7f9c440ce620 2024-04-18T03:37:52.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34013a00 con 0x7f9c440ce620 2024-04-18T03:37:52.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 <== osd.3 v2:172.21.15.157:6816/26045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f1a2c072980 con 0x7f1a2c06fe70 2024-04-18T03:37:52.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c4406bc40 con 0x7f9c440ce620 2024-04-18T03:37:52.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f68f4448700 1 -- start start 2024-04-18T03:37:52.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c34013b60 con 0x7f9c440ce620 2024-04-18T03:37:52.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 0x7f434415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 0x7f434415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56646/0 (socket says 172.21.15.157:56646) 2024-04-18T03:37:52.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 -- 172.21.15.157:0/2264001462 learned_addr learned my addr 172.21.15.157:0/2264001462 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f434a2f4700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344143400 0x7f434412d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 -- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f434406c030 msgr2=0x7f434415c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f434406c030 0x7f434415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 -- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344143400 msgr2=0x7f434412d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4344143400 0x7f434412d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 -- 172.21.15.157:0/2264001462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334009570 con 0x7f434406a4b0 2024-04-18T03:37:52.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4349af3700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 0x7f434415d7b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f434000c780 tx=0x7f434000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f3fed7f3700 1 Processor -- start 2024-04-18T03:37:52.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7fbbaae40700 1 Processor -- start 2024-04-18T03:37:52.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f3b75474700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f3b500015e0 0x7f3b50003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 --> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b50006bf0 con 0x7f3b500015e0 2024-04-18T03:37:52.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f68f4448700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68ec071080 0x7f68ec1f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7fbbaae40700 1 -- start start 2024-04-18T03:37:52.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f3fed7f3700 1 -- start start 2024-04-18T03:37:52.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f68f4448700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68ec15cdb0 0x7f68ec1f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f68f4448700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68ec1fa470 0x7f68ec0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4e7b43a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e740cc400 0x7f4e7415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4e7b43a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e740cd9b0 0x7f4e741f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.947+0000 7f4e7b43a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e74141570 0x7f4e7413b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7b43a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7415c5a0 con 0x7f4e740cc400 2024-04-18T03:37:52.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7b43a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7415c880 con 0x7f4e740cd9b0 2024-04-18T03:37:52.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7b43a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7415cb60 con 0x7f4e74141570 2024-04-18T03:37:52.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f4448700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec154560 con 0x7f68ec1fa470 2024-04-18T03:37:52.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f4448700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec15a490 con 0x7f68ec15cdb0 2024-04-18T03:37:52.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f4448700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec159880 con 0x7f68ec071080 2024-04-18T03:37:52.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68ec1fa470 0x7f68ec0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68ec1fa470 0x7f68ec0b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56676/0 (socket says 172.21.15.157:56676) 2024-04-18T03:37:52.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 -- 172.21.15.157:0/2222465078 learned_addr learned my addr 172.21.15.157:0/2222465078 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c40ff9700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c30066780 0x7f9c30068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400052d0 con 0x7f434406a4b0 2024-04-18T03:37:52.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e74141570 0x7f4e7413b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e74141570 0x7f4e7413b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60652/0 (socket says 172.21.15.157:60652) 2024-04-18T03:37:52.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 -- 172.21.15.157:0/239378732 learned_addr learned my addr 172.21.15.157:0/239378732 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:52.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e79c37700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e740cd9b0 0x7f4e741f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4340005430 con 0x7f434406a4b0 2024-04-18T03:37:52.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400055a0 con 0x7f434406a4b0 2024-04-18T03:37:52.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434415e430 con 0x7f434406a4b0 2024-04-18T03:37:52.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c34083dd0 con 0x7f9c440ce620 2024-04-18T03:37:52.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434415cd40 con 0x7f434406a4b0 2024-04-18T03:37:52.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f21e4700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68ec071080 0x7f68ec1f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 -- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68ec071080 msgr2=0x7f68ec1f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68ec071080 0x7f68ec1f7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 -- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68ec15cdb0 msgr2=0x7f68ec1f9f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-18T03:37:52.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68ec15cdb0 0x7f68ec1f9f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 -- 172.21.15.157:0/2222465078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc0094b0 con 0x7f68ec1fa470 2024-04-18T03:37:52.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c40ff9700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9c3006fdc0 0x7f9c30072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 --> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c300728d0 con 0x7f9c3006fdc0 2024-04-18T03:37:52.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c340864e0 con 0x7f9c440ce620 2024-04-18T03:37:52.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f29e5700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68ec1fa470 0x7f68ec0b2690 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68e8001200 tx=0x7f68e800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3b6f7fe700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f3b500015e0 0x7f3b50003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3b6f7fe700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f3b500015e0 0x7f3b50003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbbaae40700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415af20 0x7fbba40b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbbaae40700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba406e4c0 con 0x7fbba40b47a0 2024-04-18T03:37:52.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbbaae40700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba406f320 con 0x7fbba415ab40 2024-04-18T03:37:52.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbbaae40700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba40b4c10 con 0x7fbba415af20 2024-04-18T03:37:52.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c437fe700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9c3006fdc0 0x7f9c30072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba9e3e700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbba415ab40 0x7fbba40ce360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:56382/0 (socket says 172.21.15.157:56382) 2024-04-18T03:37:52.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba9e3e700 1 -- 172.21.15.157:0/2882123579 learned_addr learned my addr 172.21.15.157:0/2882123579 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:52.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba963d700 1 --2- 172.21.15.157:0/2882123579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415af20 0x7fbba40b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7a438700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e740cc400 0x7f4e7415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c43fff700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c30066780 0x7f9c30068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 -- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e740cd9b0 msgr2=0x7f4e741f7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e740cd9b0 0x7f4e741f7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 -- 172.21.15.157:0/239378732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e740cc400 msgr2=0x7f4e7415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e740cc400 0x7f4e7415eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:52.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 -- 172.21.15.157:0/239378732 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e700094b0 con 0x7f4e74141570 2024-04-18T03:37:52.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8005d90 con 0x7f68ec1fa470 2024-04-18T03:37:52.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c437fe700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9c3006fdc0 0x7f9c30072200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e4009a70 con 0x7f68ec1fa470 2024-04-18T03:37:52.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec159e40 con 0x7f68ec1fa470 2024-04-18T03:37:52.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba963d700 1 -- 172.21.15.157:0/2882123579 >> v1:172.21.15.175:6789/0 conn(0x7fbba415ab40 legacy=0x7fbba40ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4344161290 con 0x7f434406a4b0 2024-04-18T03:37:52.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fed7f3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3fe815dfb0 0x7f3fe80b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba963d700 1 -- 172.21.15.157:0/2882123579 >> v1:172.21.15.157:6789/0 conn(0x7fbba40b47a0 legacy=0x7fbba4070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba963d700 1 -- 172.21.15.157:0/2882123579 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba415b340 con 0x7fbba415af20 2024-04-18T03:37:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fed7f3700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80b79f0 con 0x7f3fe81611a0 2024-04-18T03:37:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fed7f3700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80702a0 con 0x7f3fe80d2a20 2024-04-18T03:37:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fe67fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3fe81611a0 0x7f3fe8070730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36648/0 (socket says 172.21.15.157:36648) 2024-04-18T03:37:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fed7f3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe8154440 con 0x7f3fe815dfb0 2024-04-18T03:37:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fe67fc700 1 -- 172.21.15.157:0/3829971003 learned_addr learned my addr 172.21.15.157:0/3829971003 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fe77fe700 1 --2- 172.21.15.157:0/3829971003 >> v2:172.21.15.175:3300/0 conn(0x7f3fe815dfb0 0x7f3fe80b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba963d700 1 --2- 172.21.15.157:0/2882123579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415af20 0x7fbba40b4260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009e10 tx=0x7fbb9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18734ba9110bb495 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba8e3c700 1 -- 172.21.15.157:0/2882123579 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00e070 con 0x7fbba415af20 2024-04-18T03:37:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fe77fe700 1 -- 172.21.15.157:0/3829971003 >> v1:172.21.15.175:6789/0 conn(0x7f3fe80d2a20 legacy=0x7f3fe8160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fe77fe700 1 -- 172.21.15.157:0/3829971003 >> v1:172.21.15.157:6789/0 conn(0x7f3fe81611a0 legacy=0x7f3fe8070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fe77fe700 1 -- 172.21.15.157:0/3829971003 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80b7c30 con 0x7f3fe815dfb0 2024-04-18T03:37:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f9c43fff700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c30066780 0x7f9c30068c40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000f80 tx=0x7f9c3c009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba8e3c700 1 -- 172.21.15.157:0/2882123579 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c003a40 con 0x7fbba415af20 2024-04-18T03:37:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7fbba8e3c700 1 -- 172.21.15.157:0/2882123579 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c003df0 con 0x7fbba415af20 2024-04-18T03:37:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3fe77fe700 1 --2- 172.21.15.157:0/3829971003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe815dfb0 0x7f3fe80b74b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009850 tx=0x7f3fdc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3cebfbf45e63814 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68ec0cc1d0 con 0x7f68ec1fa470 2024-04-18T03:37:52.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f3b577fe700 1 -- 172.21.15.157:0/327500715 <== osd.4 v2:172.21.15.175:6800/26209 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f3b50006bf0 con 0x7f3b500015e0 2024-04-18T03:37:52.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e7ac39700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e74141570 0x7f4e7413b450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e700090b0 tx=0x7f4e70004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.951+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7001b900 con 0x7f4e74141570 2024-04-18T03:37:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7415ce40 con 0x7f4e74141570 2024-04-18T03:37:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7415f0e0 con 0x7f4e74141570 2024-04-18T03:37:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7001f070 con 0x7f4e74141570 2024-04-18T03:37:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7001bca0 con 0x7f4e74141570 2024-04-18T03:37:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7fbbaae40700 1 -- 172.21.15.157:0/2882123579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415af20 msgr2=0x7fbba40b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7fbbaae40700 1 --2- 172.21.15.157:0/2882123579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415af20 0x7fbba40b4260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009e10 tx=0x7fbb9c00b330 comp rx=0 tx=0).stop 2024-04-18T03:37:53.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f3fe5ffb700 1 -- 172.21.15.157:0/3829971003 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc004230 con 0x7f3fe815dfb0 2024-04-18T03:37:53.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f3fe5ffb700 1 -- 172.21.15.157:0/3829971003 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc004390 con 0x7f3fe815dfb0 2024-04-18T03:37:53.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f3fe5ffb700 1 -- 172.21.15.157:0/3829971003 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0036c0 con 0x7f3fe815dfb0 2024-04-18T03:37:53.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 <== osd.7 v2:172.21.15.175:6809/26208 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9c300728d0 con 0x7f9c3006fdc0 2024-04-18T03:37:53.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4340006ac0 con 0x7f434406a4b0 2024-04-18T03:37:53.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f3fed7f3700 1 -- 172.21.15.157:0/3829971003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe815dfb0 msgr2=0x7f3fe80b74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f3fed7f3700 1 --2- 172.21.15.157:0/3829971003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe815dfb0 0x7f3fe80b74b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009850 tx=0x7f3fdc009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:53.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e5c000fc0 con 0x7f4e74141570 2024-04-18T03:37:53.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e80070d0 con 0x7f68ec1fa470 2024-04-18T03:37:53.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8007440 con 0x7f68ec1fa470 2024-04-18T03:37:53.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68e8007620 con 0x7f68ec1fa470 2024-04-18T03:37:53.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68e2ffd700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68d0066880 0x7f68d0068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68e8083900 con 0x7f68ec1fa470 2024-04-18T03:37:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68e2ffd700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f68d006fec0 0x7f68d0072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f433a7fc700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4328066760 0x7f4328068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4340083ae0 con 0x7f434406a4b0 2024-04-18T03:37:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f433a7fc700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f432806fca0 0x7f43280720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 --> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43280727b0 con 0x7f432806fca0 2024-04-18T03:37:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68f21e4700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68d0066880 0x7f68d0068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 --> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68d00729d0 con 0x7f68d006fec0 2024-04-18T03:37:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68e8088220 con 0x7f68ec1fa470 2024-04-18T03:37:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f434a2f4700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f432806fca0 0x7f43280720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4340001190 con 0x7f434406a4b0 2024-04-18T03:37:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e70026480 con 0x7f4e74141570 2024-04-18T03:37:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f3fed7f3700 1 -- 172.21.15.157:0/3829971003 shutdown_connections 2024-04-18T03:37:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f3fed7f3700 1 --2- 172.21.15.157:0/3829971003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe815dfb0 0x7f3fe80b74b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f3fed7f3700 1 -- 172.21.15.157:0/3829971003 >> 172.21.15.157:0/3829971003 conn(0x7f3fe80d2e70 msgr2=0x7f3fe80d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e6affd700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4e58066730 0x7f4e58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e70021070 con 0x7f4e74141570 2024-04-18T03:37:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e6affd700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f4e5806fd70 0x7f4e580721b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 --> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e58072880 con 0x7f4e5806fd70 2024-04-18T03:37:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e70086340 con 0x7f4e74141570 2024-04-18T03:37:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f43492f2700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4328066760 0x7f4328068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f434a2f4700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f432806fca0 0x7f43280720e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f43492f2700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4328066760 0x7f4328068c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f434415fb00 tx=0x7f4334010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f68f21e4700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68d0066880 0x7f68d0068d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68e4014040 tx=0x7f68e4011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.955+0000 7f4e79c37700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f4e5806fd70 0x7f4e580721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 -- 172.21.15.157:0/3829971003 shutdown_connections 2024-04-18T03:37:53.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 -- 172.21.15.157:0/3829971003 wait complete. 2024-04-18T03:37:53.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f4e79c37700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f4e5806fd70 0x7f4e580721b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f4e7a438700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4e58066730 0x7f4e58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f4e7a438700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4e58066730 0x7f4e58068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c001560 tx=0x7f4e6c0019f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 <== osd.6 v2:172.21.15.175:6808/26207 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f43280727b0 con 0x7f432806fca0 2024-04-18T03:37:53.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 Processor -- start 2024-04-18T03:37:53.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 <== osd.1 v2:172.21.15.157:6808/26043 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f4e58072880 con 0x7f4e5806fd70 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 -- start start 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe80d2a20 0x7f3fe814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe815dfb0 0x7f3fe8154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fe81611a0 0x7f3fe81554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe814e780 con 0x7f3fe81611a0 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe81563a0 con 0x7f3fe815dfb0 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fed7f3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe814e470 con 0x7f3fe80d2a20 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fe81611a0 0x7f3fe81554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fe81611a0 0x7f3fe81554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56688/0 (socket says 172.21.15.157:56688) 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe77fe700 1 -- 172.21.15.157:0/972023269 learned_addr learned my addr 172.21.15.157:0/972023269 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe6ffd700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe80d2a20 0x7f3fe814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe77fe700 1 -- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe80d2a20 msgr2=0x7f3fe814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe77fe700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fe80d2a20 0x7f3fe814dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe77fe700 1 -- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe815dfb0 msgr2=0x7f3fe8154f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:53.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe77fe700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fe815dfb0 0x7f3fe8154f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.959+0000 7f3fe77fe700 1 -- 172.21.15.157:0/972023269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0094b0 con 0x7f3fe81611a0 2024-04-18T03:37:53.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fe77fe700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fe81611a0 0x7f3fe81554d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80d3de0 tx=0x7f3fdc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7fbbaae40700 1 -- 172.21.15.157:0/2882123579 shutdown_connections 2024-04-18T03:37:53.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7fbbaae40700 1 --2- 172.21.15.157:0/2882123579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415af20 0x7fbba40b4260 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7fbbaae40700 1 -- 172.21.15.157:0/2882123579 >> 172.21.15.157:0/2882123579 conn(0x7fbba40b0c50 msgr2=0x7fbba40b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fcf7fe700 1 -- 172.21.15.157:0/972023269 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc011630 con 0x7f3fe81611a0 2024-04-18T03:37:53.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fcf7fe700 1 -- 172.21.15.157:0/972023269 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc01f070 con 0x7f3fe81611a0 2024-04-18T03:37:53.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fcf7fe700 1 -- 172.21.15.157:0/972023269 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0119d0 con 0x7f3fe81611a0 2024-04-18T03:37:53.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe814e290 con 0x7f3fe81611a0 2024-04-18T03:37:53.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe8155de0 con 0x7f3fe81611a0 2024-04-18T03:37:53.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fcf7fe700 1 -- 172.21.15.157:0/972023269 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3fdc011b30 con 0x7f3fe81611a0 2024-04-18T03:37:53.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fcf7fe700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3fd4066730 0x7f3fd4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fcf7fe700 1 -- 172.21.15.157:0/972023269 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3fdc021070 con 0x7f3fe81611a0 2024-04-18T03:37:53.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fe6ffd700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3fd4066730 0x7f3fd4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.963+0000 7f3fe6ffd700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3fd4066730 0x7f3fd4068bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000f300 tx=0x7f3fe00042e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.967+0000 7f68f19e3700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f68d006fec0 0x7f68d0072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.967+0000 7f68f19e3700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f68d006fec0 0x7f68d0072300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.967+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 <== osd.2 v2:172.21.15.157:6800/26044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f68d00729d0 con 0x7f68d006fec0 2024-04-18T03:37:53.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.971+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 --> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b50005cd0 con 0x7f3b500015e0 2024-04-18T03:37:53.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.971+0000 7fbbaae40700 1 -- 172.21.15.157:0/2882123579 shutdown_connections 2024-04-18T03:37:53.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.971+0000 7fbbaae40700 1 -- 172.21.15.157:0/2882123579 wait complete. 2024-04-18T03:37:53.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.971+0000 7f3fed7f3700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f3fe8155f70 0x7f3fe80d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.971+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 --> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fe80b81f0 con 0x7f3fe8155f70 2024-04-18T03:37:53.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.971+0000 7f3fe67fc700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f3fe8155f70 0x7f3fe80d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.971+0000 7f3b577fe700 1 -- 172.21.15.157:0/327500715 <== osd.4 v2:172.21.15.175:6800/26209 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b50005cd0 con 0x7f3b500015e0 2024-04-18T03:37:53.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.971+0000 7f3fe67fc700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f3fe8155f70 0x7f3fe80d13c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7f3fcf7fe700 1 -- 172.21.15.157:0/972023269 <== osd.0 v2:172.21.15.157:6820/26046 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f3fd80011a0 con 0x7f3fe8155f70 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 Processor -- start 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 -- start start 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40b47a0 0x7fbba4157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415ab40 0x7fbba4168170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbba415af20 0x7fbba4143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba41315e0 con 0x7fbba40b47a0 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba4143660 con 0x7fbba415af20 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba4131830 con 0x7fbba415ab40 2024-04-18T03:37:53.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40b47a0 0x7fbba4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40b47a0 0x7fbba4157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56702/0 (socket says 172.21.15.157:56702) 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 -- 172.21.15.157:0/2538577938 learned_addr learned my addr 172.21.15.157:0/2538577938 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba963d700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415ab40 0x7fbba4168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaa63f700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbba415af20 0x7fbba4143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 -- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415ab40 msgr2=0x7fbba4168170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415ab40 0x7fbba4168170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 -- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbba415af20 msgr2=0x7fbba4143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbba415af20 0x7fbba4143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 -- 172.21.15.157:0/2538577938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c009a70 con 0x7fbba40b47a0 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba963d700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbba415ab40 0x7fbba4168170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbba9e3e700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40b47a0 0x7fbba4157790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400c700 tx=0x7fbb9400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbb9a7fc700 1 -- 172.21.15.157:0/2538577938 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94005d90 con 0x7fbba40b47a0 2024-04-18T03:37:53.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbb9a7fc700 1 -- 172.21.15.157:0/2538577938 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb940070d0 con 0x7fbba40b47a0 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbb9a7fc700 1 -- 172.21.15.157:0/2538577938 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94007440 con 0x7fbba40b47a0 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 --> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a4c06b5d0 con 0x7f1a2c06fe70 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a48ff9700 1 -- 172.21.15.157:0/2075952579 <== osd.3 v2:172.21.15.157:6816/26045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a34001520 con 0x7f1a2c06fe70 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7f1a2c06fe70 msgr2=0x7f1a2c0722b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7f1a2c06fe70 0x7f1a2c0722b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1a2c066830 msgr2=0x7f1a2c068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1a2c066830 0x7f1a2c068cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c071a00 tx=0x7f1a3c008030 comp rx=0 tx=0).stop 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c160d50 msgr2=0x7f1a4c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 --2- 172.21.15.157:0/2075952579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a4c160d50 0x7f1a4c0cce70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a44007ec0 tx=0x7f1a4400e3c0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a4bfff700 1 -- 172.21.15.157:0/2075952579 reap_dead start 2024-04-18T03:37:53.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba4131b10 con 0x7fbba40b47a0 2024-04-18T03:37:53.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.975+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba41321a0 con 0x7fbba40b47a0 2024-04-18T03:37:53.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7fbb9a7fc700 1 -- 172.21.15.157:0/2538577938 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb940075a0 con 0x7fbba40b47a0 2024-04-18T03:37:53.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 --> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c44143f30 con 0x7f9c3006fdc0 2024-04-18T03:37:53.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c40ff9700 1 -- 172.21.15.157:0/3684997589 <== osd.7 v2:172.21.15.175:6809/26208 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c44143f30 con 0x7f9c3006fdc0 2024-04-18T03:37:53.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 shutdown_connections 2024-04-18T03:37:53.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 >> 172.21.15.157:0/2075952579 conn(0x7f1a4c06e730 msgr2=0x7f1a4c1463c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7fbb9a7fc700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbb90066870 0x7fbb90068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9c3006fdc0 msgr2=0x7f9c30072200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9c3006fdc0 0x7f9c30072200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7fbb9a7fc700 1 -- 172.21.15.157:0/2538577938 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb94083e40 con 0x7fbba40b47a0 2024-04-18T03:37:53.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c30066780 msgr2=0x7f9c30068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c30066780 0x7f9c30068c40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000f80 tx=0x7f9c3c009000 comp rx=0 tx=0).stop 2024-04-18T03:37:53.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c440ce620 msgr2=0x7f9c4413b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 --2- 172.21.15.157:0/3684997589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c440ce620 0x7f9c4413b4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400e810 tx=0x7f9c3400eb20 comp rx=0 tx=0).stop 2024-04-18T03:37:53.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4885c700 1 -- 172.21.15.157:0/3684997589 reap_dead start 2024-04-18T03:37:53.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 shutdown_connections 2024-04-18T03:37:53.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 >> 172.21.15.157:0/3684997589 conn(0x7f9c4406e730 msgr2=0x7f9c440b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 shutdown_connections 2024-04-18T03:37:53.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 shutdown_connections 2024-04-18T03:37:53.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f1a51d56700 1 -- 172.21.15.157:0/2075952579 wait complete. 2024-04-18T03:37:53.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7f9c4a2bf700 1 -- 172.21.15.157:0/3684997589 wait complete. 2024-04-18T03:37:53.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.979+0000 7fbba963d700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbb90066870 0x7fbb90068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7fbba963d700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbb90066870 0x7fbb90068d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c000f80 tx=0x7fbb9c011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f3b500015e0 msgr2=0x7f3b50003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f3b500015e0 0x7f3b50003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3b58066870 msgr2=0x7f3b58068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3b58066870 0x7f3b58068d30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b7004ff20 tx=0x7f3b70073980 comp rx=0 tx=0).stop 2024-04-18T03:37:53.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b68050d60 msgr2=0x7f3b68030e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 --2- 172.21.15.157:0/327500715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b68050d60 0x7f3b68030e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3b60016000 tx=0x7f3b60004770 comp rx=0 tx=0).stop 2024-04-18T03:37:53.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b6f7fe700 1 -- 172.21.15.157:0/327500715 reap_dead start 2024-04-18T03:37:53.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 shutdown_connections 2024-04-18T03:37:53.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 >> 172.21.15.157:0/327500715 conn(0x7f3b680553d0 msgr2=0x7f3b680e29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 shutdown_connections 2024-04-18T03:37:53.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f3b75474700 1 -- 172.21.15.157:0/327500715 wait complete. 2024-04-18T03:37:53.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 --> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e5c002d60 con 0x7f4e5806fd70 2024-04-18T03:37:53.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7fbbaae40700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7fbb8c0015e0 0x7fbb8c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 --> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb8c006bf0 con 0x7fbb8c0015e0 2024-04-18T03:37:53.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7fbbaa63f700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7fbb8c0015e0 0x7fbb8c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e6affd700 1 -- 172.21.15.157:0/239378732 <== osd.1 v2:172.21.15.157:6808/26043 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e5c002d60 con 0x7f4e5806fd70 2024-04-18T03:37:53.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7fbbaa63f700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7fbb8c0015e0 0x7fbb8c003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f4e5806fd70 msgr2=0x7f4e580721b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f4e5806fd70 0x7f4e580721b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4e58066730 msgr2=0x7f4e58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4e58066730 0x7f4e58068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c001560 tx=0x7f4e6c0019f0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e74141570 msgr2=0x7f4e7413b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 --2- 172.21.15.157:0/239378732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e74141570 0x7f4e7413b450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e700090b0 tx=0x7f4e70004770 comp rx=0 tx=0).stop 2024-04-18T03:37:53.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7ac39700 1 -- 172.21.15.157:0/239378732 reap_dead start 2024-04-18T03:37:53.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 shutdown_connections 2024-04-18T03:37:53.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 >> 172.21.15.157:0/239378732 conn(0x7f4e7406e730 msgr2=0x7f4e740ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 shutdown_connections 2024-04-18T03:37:53.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.983+0000 7f4e7b43a700 1 -- 172.21.15.157:0/239378732 wait complete. 2024-04-18T03:37:53.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.987+0000 7fbb9a7fc700 1 -- 172.21.15.157:0/2538577938 <== osd.5 v2:172.21.15.175:6824/26210 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fbb8c006bf0 con 0x7fbb8c0015e0 2024-04-18T03:37:53.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.987+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 --> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68ec04e650 con 0x7f68d006fec0 2024-04-18T03:37:53.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.991+0000 7f68e2ffd700 1 -- 172.21.15.157:0/2222465078 <== osd.2 v2:172.21.15.157:6800/26044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68ec04e650 con 0x7f68d006fec0 2024-04-18T03:37:53.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f68d006fec0 msgr2=0x7f68d0072300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f68d006fec0 0x7f68d0072300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68d0066880 msgr2=0x7f68d0068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68d0066880 0x7f68d0068d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68e4014040 tx=0x7f68e4011000 comp rx=0 tx=0).stop 2024-04-18T03:37:53.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68ec1fa470 msgr2=0x7f68ec0b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.031 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:53.032 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T03:37:53.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 --2- 172.21.15.157:0/2222465078 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68ec1fa470 0x7f68ec0b2690 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68e8001200 tx=0x7f68e800c7f0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f29e5700 1 -- 172.21.15.157:0/2222465078 reap_dead start 2024-04-18T03:37:53.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 shutdown_connections 2024-04-18T03:37:53.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 >> 172.21.15.157:0/2222465078 conn(0x7f68ec06e730 msgr2=0x7f68ec0ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 shutdown_connections 2024-04-18T03:37:53.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.995+0000 7f68f4448700 1 -- 172.21.15.157:0/2222465078 wait complete. 2024-04-18T03:37:53.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 --> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f434415ebc0 con 0x7f432806fca0 2024-04-18T03:37:53.033 INFO:teuthology.orchestra.run.smithi157.stdout:64424509448 2024-04-18T03:37:53.034 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T03:37:53.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 --> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3fe8070e40 con 0x7f3fe8155f70 2024-04-18T03:37:53.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f433a7fc700 1 -- 172.21.15.157:0/2264001462 <== osd.6 v2:172.21.15.175:6808/26207 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f433c007ce0 con 0x7f432806fca0 2024-04-18T03:37:53.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f3fcf7fe700 1 -- 172.21.15.157:0/972023269 <== osd.0 v2:172.21.15.157:6820/26046 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3fd8005960 con 0x7f3fe8155f70 2024-04-18T03:37:53.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f432806fca0 msgr2=0x7f43280720e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f434aaf5700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f432806fca0 0x7f43280720e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4328066760 msgr2=0x7f4328068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f434aaf5700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4328066760 0x7f4328068c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f434415fb00 tx=0x7f4334010000 comp rx=0 tx=0).stop 2024-04-18T03:37:53.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 msgr2=0x7f434415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f434aaf5700 1 --2- 172.21.15.157:0/2264001462 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f434406a4b0 0x7f434415d7b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f434000c780 tx=0x7f434000ca90 comp rx=0 tx=0).stop 2024-04-18T03:37:53.037 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:53.037 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T03:37:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:52.999+0000 7f434a2f4700 1 -- 172.21.15.157:0/2264001462 reap_dead start 2024-04-18T03:37:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 shutdown_connections 2024-04-18T03:37:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 >> 172.21.15.157:0/2264001462 conn(0x7f434406e730 msgr2=0x7f43441465d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 shutdown_connections 2024-04-18T03:37:53.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f434aaf5700 1 -- 172.21.15.157:0/2264001462 wait complete. 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f3fe8155f70 msgr2=0x7f3fe80d13c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f3fe8155f70 0x7f3fe80d13c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3fd4066730 msgr2=0x7f3fd4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3fd4066730 0x7f3fd4068bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000f300 tx=0x7f3fe00042e0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fe81611a0 msgr2=0x7f3fe81554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 --2- 172.21.15.157:0/972023269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3fe81611a0 0x7f3fe81554d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80d3de0 tx=0x7f3fdc004770 comp rx=0 tx=0).stop 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fe77fe700 1 -- 172.21.15.157:0/972023269 reap_dead start 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 shutdown_connections 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 >> 172.21.15.157:0/972023269 conn(0x7f3fe80d2e70 msgr2=0x7f3fe815d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 shutdown_connections 2024-04-18T03:37:53.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7f3fed7f3700 1 -- 172.21.15.157:0/972023269 wait complete. 2024-04-18T03:37:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 --> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb8c005cd0 con 0x7fbb8c0015e0 2024-04-18T03:37:53.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.003+0000 7fbb9a7fc700 1 -- 172.21.15.157:0/2538577938 <== osd.5 v2:172.21.15.175:6824/26210 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb8c005cd0 con 0x7fbb8c0015e0 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7fbb8c0015e0 msgr2=0x7fbb8c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7fbb8c0015e0 0x7fbb8c003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbb90066870 msgr2=0x7fbb90068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbb90066870 0x7fbb90068d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c000f80 tx=0x7fbb9c011000 comp rx=0 tx=0).stop 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40b47a0 msgr2=0x7fbba4157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 --2- 172.21.15.157:0/2538577938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbba40b47a0 0x7fbba4157790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400c700 tx=0x7fbb9400cac0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaa63f700 1 -- 172.21.15.157:0/2538577938 reap_dead start 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 shutdown_connections 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 >> 172.21.15.157:0/2538577938 conn(0x7fbba40b0c50 msgr2=0x7fbba40ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 shutdown_connections 2024-04-18T03:37:53.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.007+0000 7fbbaae40700 1 -- 172.21.15.157:0/2538577938 wait complete. 2024-04-18T03:37:53.042 INFO:teuthology.orchestra.run.smithi157.stdout:60129542153 2024-04-18T03:37:53.043 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T03:37:53.043 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:53.044 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T03:37:53.044 INFO:teuthology.orchestra.run.smithi157.stdout:64424509447 2024-04-18T03:37:53.044 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T03:37:53.045 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:53.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T03:37:53.047 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:53.047 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T03:37:53.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528f59e700 1 Processor -- start 2024-04-18T03:37:53.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f3798e4d700 1 Processor -- start 2024-04-18T03:37:53.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528f59e700 1 -- start start 2024-04-18T03:37:53.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f3798e4d700 1 -- start start 2024-04-18T03:37:53.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7ff4f25a4700 1 Processor -- start 2024-04-18T03:37:53.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528f59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f52901444e0 0x7f52900cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52901656b0 0x7f5290147450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5290162c70 con 0x7f5290165250 2024-04-18T03:37:53.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528f59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52900ce6d0 con 0x7f52901444e0 2024-04-18T03:37:53.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52900cdb50 con 0x7f52901656b0 2024-04-18T03:37:53.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7ff4f25a4700 1 -- start start 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f3798e4d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f379415cdb0 0x7f3794142880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f3798e4d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f37940cb730 0x7f379415d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f3798e4d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379415d6d0 con 0x7f37940cd6a0 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f3798e4d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940cbef0 con 0x7f37940cb730 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f3798e4d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940b1cb0 con 0x7f379415cdb0 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3792ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f37940cb730 0x7f379415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3793fff700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f37940cd6a0 0x7f37940cdad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:56424/0 (socket says 172.21.15.157:56424) 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3793fff700 1 -- 172.21.15.157:0/3282798552 learned_addr learned my addr 172.21.15.157:0/3282798552 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:53.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f37937fe700 1 --2- 172.21.15.157:0/3282798552 >> v2:172.21.15.175:3300/0 conn(0x7f379415cdb0 0x7f3794142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff4ec15cdb0 0x7ff4ec142880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff4ec0cb730 0x7ff4ec15d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec15d6d0 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ec0cbef0 con 0x7ff4ec15cdb0 2024-04-18T03:37:53.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ec0b1cb0 con 0x7ff4ec0cb730 2024-04-18T03:37:53.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f1da3700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff4ec0cd6a0 0x7ff4ec0cdad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36664/0 (socket says 172.21.15.157:36664) 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f1da3700 1 -- 172.21.15.157:0/2660238074 learned_addr learned my addr 172.21.15.157:0/2660238074 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528e59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f52901444e0 0x7f52900cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528e59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f52901444e0 0x7f52900cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56708/0 (socket says 172.21.15.157:56708) 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f528e59c700 1 -- 172.21.15.157:0/3057312394 learned_addr learned my addr 172.21.15.157:0/3057312394 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528ed9d700 1 --2- 172.21.15.157:0/3057312394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52901656b0 0x7f5290147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528e59c700 1 -- 172.21.15.157:0/3057312394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52901656b0 msgr2=0x7f5290147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528e59c700 1 --2- 172.21.15.157:0/3057312394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52901656b0 0x7f5290147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528e59c700 1 -- 172.21.15.157:0/3057312394 >> v1:172.21.15.175:6789/0 conn(0x7f5290165250 legacy=0x7f5290146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528e59c700 1 -- 172.21.15.157:0/3057312394 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52900cde30 con 0x7f52901444e0 2024-04-18T03:37:53.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528e59c700 1 --2- 172.21.15.157:0/3057312394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52900cd240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5284009910 tx=0x7f5284009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b79ea6c745134b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3792ffd700 1 -- 172.21.15.157:0/3282798552 >> v2:172.21.15.175:3300/0 conn(0x7f379415cdb0 msgr2=0x7f3794142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3792ffd700 1 --2- 172.21.15.157:0/3282798552 >> v2:172.21.15.175:3300/0 conn(0x7f379415cdb0 0x7f3794142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3792ffd700 1 -- 172.21.15.157:0/3282798552 >> v1:172.21.15.175:6789/0 conn(0x7f37940cd6a0 legacy=0x7f37940cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3792ffd700 1 -- 172.21.15.157:0/3282798552 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940b1f90 con 0x7f37940cb730 2024-04-18T03:37:53.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f15a2700 1 --2- 172.21.15.157:0/2660238074 >> v2:172.21.15.157:3300/0 conn(0x7ff4ec15cdb0 0x7ff4ec142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f0da1700 1 --2- 172.21.15.157:0/2660238074 >> v2:172.21.15.175:3300/0 conn(0x7ff4ec0cb730 0x7ff4ec15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3792ffd700 1 --2- 172.21.15.157:0/3282798552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 0x7f379415d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f378c00bfa0 tx=0x7f378c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f375048b44f24c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528d59a700 1 -- 172.21.15.157:0/3057312394 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400ba60 con 0x7f52901444e0 2024-04-18T03:37:53.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528d59a700 1 -- 172.21.15.157:0/3057312394 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400bbc0 con 0x7f52901444e0 2024-04-18T03:37:53.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528d59a700 1 -- 172.21.15.157:0/3057312394 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284009e60 con 0x7f52901444e0 2024-04-18T03:37:53.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7ffad359e700 1 Processor -- start 2024-04-18T03:37:53.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7ffad359e700 1 -- start start 2024-04-18T03:37:53.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad359e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffad4164410 0x7ffad416b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffad416da40 0x7ffad416ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad359e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad40cca60 con 0x7ffad4164410 2024-04-18T03:37:53.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad416e410 con 0x7ffad416da40 2024-04-18T03:37:53.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40b24e0 con 0x7ffad40cb990 2024-04-18T03:37:53.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.223+0000 7f66a15bd700 1 Processor -- start 2024-04-18T03:37:53.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a15bd700 1 -- start start 2024-04-18T03:37:53.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f37927fc700 1 -- 172.21.15.157:0/3282798552 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c010070 con 0x7f37940cb730 2024-04-18T03:37:53.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f37927fc700 1 -- 172.21.15.157:0/3282798552 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c00b2e0 con 0x7f37940cb730 2024-04-18T03:37:53.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f37927fc700 1 -- 172.21.15.157:0/3282798552 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00dc00 con 0x7f37940cb730 2024-04-18T03:37:53.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad1d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad1d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad40cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60692/0 (socket says 172.21.15.157:60692) 2024-04-18T03:37:53.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad1d9b700 1 -- 172.21.15.157:0/311444492 learned_addr learned my addr 172.21.15.157:0/311444492 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f15a2700 1 -- 172.21.15.157:0/2660238074 >> v2:172.21.15.175:3300/0 conn(0x7ff4ec0cb730 msgr2=0x7ff4ec15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f15a2700 1 --2- 172.21.15.157:0/2660238074 >> v2:172.21.15.175:3300/0 conn(0x7ff4ec0cb730 0x7ff4ec15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f15a2700 1 -- 172.21.15.157:0/2660238074 >> v1:172.21.15.157:6789/0 conn(0x7ff4ec0cd6a0 legacy=0x7ff4ec0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f15a2700 1 -- 172.21.15.157:0/2660238074 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0b1f90 con 0x7ff4ec15cdb0 2024-04-18T03:37:53.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad1d9b700 1 -- 172.21.15.157:0/311444492 >> v2:172.21.15.175:3300/0 conn(0x7ffad416da40 msgr2=0x7ffad416ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528f59e700 1 -- 172.21.15.157:0/3057312394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 msgr2=0x7f52900cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528f59e700 1 --2- 172.21.15.157:0/3057312394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52900cd240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5284009910 tx=0x7f5284009c20 comp rx=0 tx=0).stop 2024-04-18T03:37:53.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f15a2700 1 --2- 172.21.15.157:0/2660238074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec15cdb0 0x7ff4ec142880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009850 tx=0x7ff4e8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf973b2265038e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a15bd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad259c700 1 --2- 172.21.15.157:0/311444492 >> v2:172.21.15.157:3300/0 conn(0x7ffad4164410 0x7ffad416b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528f59e700 1 -- 172.21.15.157:0/3057312394 shutdown_connections 2024-04-18T03:37:53.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528f59e700 1 --2- 172.21.15.157:0/3057312394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52901656b0 0x7f5290147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528f59e700 1 --2- 172.21.15.157:0/3057312394 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52900cd240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528f59e700 1 -- 172.21.15.157:0/3057312394 >> 172.21.15.157:0/3057312394 conn(0x7f529006e730 msgr2=0x7f529006eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a15bd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f669c1641a0 0x7f669c16da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3798e4d700 1 -- 172.21.15.157:0/3282798552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 msgr2=0x7f379415d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3798e4d700 1 --2- 172.21.15.157:0/3282798552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 0x7f379415d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f378c00bfa0 tx=0x7f378c00d330 comp rx=0 tx=0).stop 2024-04-18T03:37:53.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a15bd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f669c164620 0x7f669c16df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad2d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffad416da40 0x7ffad416ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a15bd700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c0cca60 con 0x7f669c164620 2024-04-18T03:37:53.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a15bd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c0b24e0 con 0x7f669c1641a0 2024-04-18T03:37:53.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a15bd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0b1c20 con 0x7f669c0cb990 2024-04-18T03:37:53.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f669bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4e3fff700 1 -- 172.21.15.157:0/2660238074 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8004230 con 0x7ff4ec15cdb0 2024-04-18T03:37:53.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad1d9b700 1 --2- 172.21.15.157:0/311444492 >> v2:172.21.15.175:3300/0 conn(0x7ffad416da40 0x7ffad416ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f669bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c0cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60696/0 (socket says 172.21.15.157:60696) 2024-04-18T03:37:53.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f669b7fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f669c1641a0 0x7f669c16da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f669bfff700 1 -- 172.21.15.157:0/4202414123 learned_addr learned my addr 172.21.15.157:0/4202414123 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a0dbc700 1 --2- 172.21.15.157:0/4202414123 >> v2:172.21.15.157:3300/0 conn(0x7f669c164620 0x7f669c16df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4e3fff700 1 -- 172.21.15.157:0/2660238074 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8004390 con 0x7ff4ec15cdb0 2024-04-18T03:37:53.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4e3fff700 1 -- 172.21.15.157:0/2660238074 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80036c0 con 0x7ff4ec15cdb0 2024-04-18T03:37:53.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad1d9b700 1 -- 172.21.15.157:0/311444492 >> v2:172.21.15.157:3300/0 conn(0x7ffad4164410 msgr2=0x7ffad416b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad1d9b700 1 --2- 172.21.15.157:0/311444492 >> v2:172.21.15.157:3300/0 conn(0x7ffad4164410 0x7ffad416b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ffad1d9b700 1 -- 172.21.15.157:0/311444492 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad40cbe10 con 0x7ffad40cb990 2024-04-18T03:37:53.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528f59e700 1 -- 172.21.15.157:0/3057312394 shutdown_connections 2024-04-18T03:37:53.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f528f59e700 1 -- 172.21.15.157:0/3057312394 wait complete. 2024-04-18T03:37:53.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a0dbc700 1 -- 172.21.15.157:0/4202414123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 msgr2=0x7f669c0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a0dbc700 1 --2- 172.21.15.157:0/4202414123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a0dbc700 1 -- 172.21.15.157:0/4202414123 >> v2:172.21.15.175:3300/0 conn(0x7f669c1641a0 msgr2=0x7f669c16da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a0dbc700 1 --2- 172.21.15.157:0/4202414123 >> v2:172.21.15.175:3300/0 conn(0x7f669c1641a0 0x7f669c16da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a0dbc700 1 -- 172.21.15.157:0/4202414123 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0b2170 con 0x7f669c164620 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f66a0dbc700 1 --2- 172.21.15.157:0/4202414123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16df80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f669c0b38d0 tx=0x7f669400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a135bcb11921823 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3798e4d700 1 -- 172.21.15.157:0/3282798552 shutdown_connections 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3798e4d700 1 --2- 172.21.15.157:0/3282798552 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 0x7f379415d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3798e4d700 1 --2- 172.21.15.157:0/3282798552 >> v2:172.21.15.175:3300/0 conn(0x7f379415cdb0 0x7f3794142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3798e4d700 1 -- 172.21.15.157:0/3282798552 >> 172.21.15.157:0/3282798552 conn(0x7f379406e730 msgr2=0x7f379406eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3798e4d700 1 -- 172.21.15.157:0/3282798552 shutdown_connections 2024-04-18T03:37:53.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f3798e4d700 1 -- 172.21.15.157:0/3282798552 wait complete. 2024-04-18T03:37:53.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 -- 172.21.15.157:0/2660238074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec15cdb0 msgr2=0x7ff4ec142880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 --2- 172.21.15.157:0/2660238074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec15cdb0 0x7ff4ec142880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009850 tx=0x7ff4e8009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:53.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 -- 172.21.15.157:0/2660238074 shutdown_connections 2024-04-18T03:37:53.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 --2- 172.21.15.157:0/2660238074 >> v2:172.21.15.175:3300/0 conn(0x7ff4ec0cb730 0x7ff4ec15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 --2- 172.21.15.157:0/2660238074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec15cdb0 0x7ff4ec142880 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 -- 172.21.15.157:0/2660238074 >> 172.21.15.157:0/2660238074 conn(0x7ff4ec06e730 msgr2=0x7ff4ec06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f669affd700 1 -- 172.21.15.157:0/4202414123 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400e070 con 0x7f669c164620 2024-04-18T03:37:53.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f669affd700 1 -- 172.21.15.157:0/4202414123 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400bae0 con 0x7f669c164620 2024-04-18T03:37:53.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7f669affd700 1 -- 172.21.15.157:0/4202414123 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400be90 con 0x7f669c164620 2024-04-18T03:37:53.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 -- 172.21.15.157:0/2660238074 shutdown_connections 2024-04-18T03:37:53.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.227+0000 7ff4f25a4700 1 -- 172.21.15.157:0/2660238074 wait complete. 2024-04-18T03:37:53.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 Processor -- start 2024-04-18T03:37:53.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad1d9b700 1 --2- 172.21.15.157:0/311444492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad40cdbb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffad4089f80 tx=0x7ffac4007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77a59f93568a5e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 -- start start 2024-04-18T03:37:53.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad159a700 1 -- 172.21.15.157:0/311444492 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400bea0 con 0x7ffad40cb990 2024-04-18T03:37:53.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3798e4d700 1 Processor -- start 2024-04-18T03:37:53.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad159a700 1 -- 172.21.15.157:0/311444492 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4003a40 con 0x7ffad40cb990 2024-04-18T03:37:53.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad159a700 1 -- 172.21.15.157:0/311444492 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4003df0 con 0x7ffad40cb990 2024-04-18T03:37:53.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52901f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5290165250 0x7f529006b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52901656b0 0x7f529006bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52901f7720 con 0x7f52901444e0 2024-04-18T03:37:53.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52901fa550 con 0x7f52901656b0 2024-04-18T03:37:53.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5290143f00 con 0x7f5290165250 2024-04-18T03:37:53.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad2d9d700 1 --2- 172.21.15.157:0/311444492 >> v2:172.21.15.175:3300/0 conn(0x7ffad416da40 0x7ffad416ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:53.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad259c700 1 --2- 172.21.15.157:0/311444492 >> v2:172.21.15.157:3300/0 conn(0x7ffad4164410 0x7ffad416b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:53.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52901f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52901f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56760/0 (socket says 172.21.15.157:56760) 2024-04-18T03:37:53.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 -- 172.21.15.157:0/2545108590 learned_addr learned my addr 172.21.15.157:0/2545108590 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528dd9b700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5290165250 0x7f529006b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 -- 172.21.15.157:0/311444492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 msgr2=0x7ffad40cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 --2- 172.21.15.157:0/311444492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad40cdbb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffad4089f80 tx=0x7ffac4007f30 comp rx=0 tx=0).stop 2024-04-18T03:37:53.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528ed9d700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52901656b0 0x7f529006bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3798e4d700 1 -- start start 2024-04-18T03:37:53.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 -- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5290165250 msgr2=0x7f529006b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5290165250 0x7f529006b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 -- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52901656b0 msgr2=0x7f529006bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52901656b0 0x7f529006bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 -- 172.21.15.157:0/2545108590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284009570 con 0x7f52901444e0 2024-04-18T03:37:53.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528ed9d700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52901656b0 0x7f529006bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:53.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f25a4700 1 Processor -- start 2024-04-18T03:37:53.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 -- 172.21.15.157:0/4202414123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 msgr2=0x7f669c16df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 --2- 172.21.15.157:0/4202414123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16df80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f669c0b38d0 tx=0x7f669400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:53.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f25a4700 1 -- start start 2024-04-18T03:37:53.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528e59c700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52901f71e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5284014040 tx=0x7f5284004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3798e4d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 0x7f3794153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3798e4d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37940cd6a0 0x7f379415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3798e4d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f379415cdb0 0x7f3794151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3798e4d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379415a6e0 con 0x7f37940cb730 2024-04-18T03:37:53.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3798e4d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940ac2d0 con 0x7f37940cd6a0 2024-04-18T03:37:53.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3798e4d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3794159ed0 con 0x7f379415cdb0 2024-04-18T03:37:53.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f25a4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ec0cb730 0x7ff4ec144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 -- 172.21.15.157:0/311444492 shutdown_connections 2024-04-18T03:37:53.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f25a4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cd6a0 0x7ff4ec0a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f25a4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ec15cdb0 0x7ff4ec0ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f25a4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec0caa20 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f25a4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1455f0 con 0x7ff4ec0cb730 2024-04-18T03:37:53.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f25a4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec1452e0 con 0x7ff4ec15cdb0 2024-04-18T03:37:53.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f37937fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 0x7f3794153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f37937fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 0x7f3794153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56762/0 (socket says 172.21.15.157:56762) 2024-04-18T03:37:53.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f37937fe700 1 -- 172.21.15.157:0/684043506 learned_addr learned my addr 172.21.15.157:0/684043506 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3792ffd700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37940cd6a0 0x7f379415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 --2- 172.21.15.157:0/311444492 >> v2:172.21.15.175:3300/0 conn(0x7ffad416da40 0x7ffad416ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 --2- 172.21.15.157:0/311444492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad40cdbb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 --2- 172.21.15.157:0/311444492 >> v2:172.21.15.157:3300/0 conn(0x7ffad4164410 0x7ffad416b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 -- 172.21.15.157:0/311444492 >> 172.21.15.157:0/311444492 conn(0x7ffad406e730 msgr2=0x7ffad406eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f15a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ec0cb730 0x7ff4ec144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f15a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ec0cb730 0x7ff4ec144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:58898/0 (socket says 172.21.15.157:58898) 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f15a2700 1 -- 172.21.15.157:0/1531162209 learned_addr learned my addr 172.21.15.157:0/1531162209 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f1da3700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ec15cdb0 0x7ff4ec0ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3793fff700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f379415cdb0 0x7f3794151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3792ffd700 1 -- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f379415cdb0 msgr2=0x7f3794151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3792ffd700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f379415cdb0 0x7f3794151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3792ffd700 1 -- 172.21.15.157:0/684043506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 msgr2=0x7f3794153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3792ffd700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 0x7f3794153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3792ffd700 1 -- 172.21.15.157:0/684043506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c00bc80 con 0x7f37940cd6a0 2024-04-18T03:37:53.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f0da1700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cd6a0 0x7ff4ec0a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f527effd700 1 -- 172.21.15.157:0/2545108590 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284004510 con 0x7f52901444e0 2024-04-18T03:37:53.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529015e420 con 0x7f52901444e0 2024-04-18T03:37:53.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52901536d0 con 0x7f52901444e0 2024-04-18T03:37:53.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f3792ffd700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37940cd6a0 0x7f379415a1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f378c017000 tx=0x7f378c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f0da1700 1 -- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ec15cdb0 msgr2=0x7ff4ec0ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f0da1700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ec15cdb0 0x7ff4ec0ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f0da1700 1 -- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ec0cb730 msgr2=0x7ff4ec144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f0da1700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ec0cb730 0x7ff4ec144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f0da1700 1 -- 172.21.15.157:0/1531162209 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80094b0 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f527effd700 1 -- 172.21.15.157:0/2545108590 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528401f070 con 0x7f52901444e0 2024-04-18T03:37:53.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f527effd700 1 -- 172.21.15.157:0/2545108590 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284003900 con 0x7f52901444e0 2024-04-18T03:37:53.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ff4f1da3700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ec15cdb0 0x7ff4ec0ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:53.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f377bfff700 1 -- 172.21.15.157:0/684043506 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c009300 con 0x7f37940cd6a0 2024-04-18T03:37:53.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4f0da1700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cd6a0 0x7ff4ec0a7e90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00e8a0 tx=0x7ff4dc00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 -- 172.21.15.157:0/311444492 shutdown_connections 2024-04-18T03:37:53.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7ffad359e700 1 -- 172.21.15.157:0/311444492 wait complete. 2024-04-18T03:37:53.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f377bfff700 1 -- 172.21.15.157:0/684043506 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c00b450 con 0x7f37940cd6a0 2024-04-18T03:37:53.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f377bfff700 1 -- 172.21.15.157:0/684043506 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0046d0 con 0x7f37940cd6a0 2024-04-18T03:37:53.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4e1ffb700 1 -- 172.21.15.157:0/1531162209 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc013680 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4e1ffb700 1 -- 172.21.15.157:0/1531162209 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0137e0 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4e1ffb700 1 -- 172.21.15.157:0/1531162209 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc013b70 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4f25a4700 1 -- 172.21.15.157:0/1531162209 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec0a8880 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4f25a4700 1 -- 172.21.15.157:0/1531162209 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec0a8e40 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 -- 172.21.15.157:0/4202414123 shutdown_connections 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 --2- 172.21.15.157:0/4202414123 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16df80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 --2- 172.21.15.157:0/4202414123 >> v2:172.21.15.175:3300/0 conn(0x7f669c1641a0 0x7f669c16da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 --2- 172.21.15.157:0/4202414123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 -- 172.21.15.157:0/4202414123 >> 172.21.15.157:0/4202414123 conn(0x7f669c06e730 msgr2=0x7f669c06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 -- 172.21.15.157:0/4202414123 shutdown_connections 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.231+0000 7f66a15bd700 1 -- 172.21.15.157:0/4202414123 wait complete. 2024-04-18T03:37:53.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a15bd700 1 Processor -- start 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a15bd700 1 -- start start 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a15bd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c163a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a15bd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c1641a0 0x7f669c16d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a15bd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a15bd700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c086cd0 con 0x7f669c164620 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a15bd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c083530 con 0x7f669c1641a0 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a15bd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c083780 con 0x7f669c0cb990 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56768/0 (socket says 172.21.15.157:56768) 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 -- 172.21.15.157:0/299696441 learned_addr learned my addr 172.21.15.157:0/299696441 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f669b7fe700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c1641a0 0x7f669c16d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f669bfff700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 -- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 msgr2=0x7f669c163a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c163a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 -- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c1641a0 msgr2=0x7f669c16d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c1641a0 0x7f669c16d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 -- 172.21.15.157:0/299696441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009a70 con 0x7f669c164620 2024-04-18T03:37:53.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f3798e4d700 1 -- 172.21.15.157:0/684043506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37940ac520 con 0x7f37940cd6a0 2024-04-18T03:37:53.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f3798e4d700 1 -- 172.21.15.157:0/684043506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37941599b0 con 0x7f37940cd6a0 2024-04-18T03:37:53.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4f25a4700 1 -- 172.21.15.157:0/1531162209 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc005310 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4e1ffb700 1 -- 172.21.15.157:0/1531162209 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff4dc013cd0 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f527effd700 1 -- 172.21.15.157:0/2545108590 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5284003a60 con 0x7f52901444e0 2024-04-18T03:37:53.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f527effd700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f52700667b0 0x7f5270068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f527effd700 1 -- 172.21.15.157:0/2545108590 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5284021070 con 0x7f52901444e0 2024-04-18T03:37:53.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f528dd9b700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f52700667b0 0x7f5270068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad359e700 1 Processor -- start 2024-04-18T03:37:53.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad359e700 1 -- start start 2024-04-18T03:37:53.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f528dd9b700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f52700667b0 0x7f5270068c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52901515a0 tx=0x7f5288009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5274005310 con 0x7f52901444e0 2024-04-18T03:37:53.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad4167340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad4164410 0x7ffad406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad416da40 0x7ffad407d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad406cb10 con 0x7ffad416da40 2024-04-18T03:37:53.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7f66a0dbc700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16db40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f669400b370 tx=0x7f6694004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad407ddb0 con 0x7ffad4164410 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4165ee0 con 0x7ffad40cb990 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad1d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad4164410 0x7ffad406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad4167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad1d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad4164410 0x7ffad406c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:58920/0 (socket says 172.21.15.157:58920) 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad1d9b700 1 -- 172.21.15.157:0/3316878615 learned_addr learned my addr 172.21.15.157:0/3316878615 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad2d9d700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad416da40 0x7ffad407d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4e1ffb700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff4d80668e0 0x7ff4d8068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4e1ffb700 1 -- 172.21.15.157:0/1531162209 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4dc084310 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ff4f15a2700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff4d80668e0 0x7ff4d8068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad1d9b700 1 -- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 msgr2=0x7ffad4167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad1d9b700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad4167340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad1d9b700 1 -- 172.21.15.157:0/3316878615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad416da40 msgr2=0x7ffad407d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.235+0000 7ffad1d9b700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad416da40 0x7ffad407d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7ffad1d9b700 1 -- 172.21.15.157:0/3316878615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4007930 con 0x7ffad4164410 2024-04-18T03:37:53.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f3798e4d700 1 -- 172.21.15.157:0/684043506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37940aca40 con 0x7f37940cd6a0 2024-04-18T03:37:53.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7ffad1d9b700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad4164410 0x7ffad406c5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffac40061e0 tx=0x7ffac4004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7ff4f15a2700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff4d80668e0 0x7ff4d8068da0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009ba0 tx=0x7ff4e801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7ffac2ffd700 1 -- 172.21.15.157:0/3316878615 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4027610 con 0x7ffad4164410 2024-04-18T03:37:53.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad406b810 con 0x7ffad4164410 2024-04-18T03:37:53.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad406bdd0 con 0x7ffad4164410 2024-04-18T03:37:53.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2fbfff700 1 Processor -- start 2024-04-18T03:37:53.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2fbfff700 1 -- start start 2024-04-18T03:37:53.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c99f70700 1 Processor -- start 2024-04-18T03:37:53.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c99f70700 1 -- start start 2024-04-18T03:37:53.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad404e650 con 0x7ffad4164410 2024-04-18T03:37:53.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2fbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc141450 0x7fe2fc0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2fbfff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2fc0b35d0 con 0x7fe2fc0cd9b0 2024-04-18T03:37:53.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2fbfff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2fc0b3010 con 0x7fe2fc0b2ad0 2024-04-18T03:37:53.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2fbfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc0b32f0 con 0x7fe2fc141450 2024-04-18T03:37:53.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c99f70700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 0x7f9c9406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c99f70700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c9406c030 0x7f9c94160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c99f70700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9406aa50 con 0x7f9c94143400 2024-04-18T03:37:53.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c99f70700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9406ad30 con 0x7f9c9406c030 2024-04-18T03:37:53.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c99f70700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9406b010 con 0x7f9c9406a4b0 2024-04-18T03:37:53.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2fb7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe2fc0cd9b0 0x7fe2fc1425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36676/0 (socket says 172.21.15.157:36676) 2024-04-18T03:37:53.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2fb7fe700 1 -- 172.21.15.157:0/3668947273 learned_addr learned my addr 172.21.15.157:0/3668947273 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:53.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2faffd700 1 --2- 172.21.15.157:0/3668947273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc141450 0x7fe2fc0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c9976f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c9406c030 0x7f9c94160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c9976f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c9406c030 0x7f9c94160d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:58924/0 (socket says 172.21.15.157:58924) 2024-04-18T03:37:53.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c93fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 0x7f9c9406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c9976f700 1 -- 172.21.15.157:0/4064490692 learned_addr learned my addr 172.21.15.157:0/4064490692 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c9976f700 1 -- 172.21.15.157:0/4064490692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 msgr2=0x7f9c9406baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c9976f700 1 --2- 172.21.15.157:0/4064490692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 0x7f9c9406baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c9976f700 1 -- 172.21.15.157:0/4064490692 >> v1:172.21.15.175:6789/0 conn(0x7f9c94143400 legacy=0x7f9c940aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c9976f700 1 -- 172.21.15.157:0/4064490692 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9406b2f0 con 0x7f9c9406c030 2024-04-18T03:37:53.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2faffd700 1 -- 172.21.15.157:0/3668947273 >> v1:172.21.15.175:6789/0 conn(0x7fe2fc0b2ad0 legacy=0x7fe2fc0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2faffd700 1 -- 172.21.15.157:0/3668947273 >> v1:172.21.15.157:6789/0 conn(0x7fe2fc0cd9b0 legacy=0x7fe2fc1425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7fe2faffd700 1 -- 172.21.15.157:0/3668947273 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc141db0 con 0x7fe2fc141450 2024-04-18T03:37:53.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f377bfff700 1 -- 172.21.15.157:0/684043506 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f378c009050 con 0x7f37940cd6a0 2024-04-18T03:37:53.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.239+0000 7f9c9976f700 1 --2- 172.21.15.157:0/4064490692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c9406c030 0x7f9c94160d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009910 tx=0x7f9c84009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f3b0c329e6e753 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2faffd700 1 --2- 172.21.15.157:0/3668947273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc141450 0x7fe2fc0b2590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0b37c0 tx=0x7fe2f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a61a4a2f77b9b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7f377bfff700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3780066730 0x7f3780068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2f9ffb700 1 -- 172.21.15.157:0/3668947273 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4016070 con 0x7fe2fc141450 2024-04-18T03:37:53.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2f9ffb700 1 -- 172.21.15.157:0/3668947273 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f400bb90 con 0x7fe2fc141450 2024-04-18T03:37:53.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2f9ffb700 1 -- 172.21.15.157:0/3668947273 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f400e070 con 0x7fe2fc141450 2024-04-18T03:37:53.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7f377bfff700 1 -- 172.21.15.157:0/684043506 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f378c085b90 con 0x7f37940cd6a0 2024-04-18T03:37:53.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7f37937fe700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3780066730 0x7f3780068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7f6698ff9700 1 -- 172.21.15.157:0/299696441 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694004600 con 0x7f669c164620 2024-04-18T03:37:53.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c083a60 con 0x7f669c164620 2024-04-18T03:37:53.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- 172.21.15.157:0/3668947273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc141450 msgr2=0x7fe2fc0b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 --2- 172.21.15.157:0/3668947273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc141450 0x7fe2fc0b2590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0b37c0 tx=0x7fe2f400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:53.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- 172.21.15.157:0/3668947273 shutdown_connections 2024-04-18T03:37:53.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 --2- 172.21.15.157:0/3668947273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc141450 0x7fe2fc0b2590 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- 172.21.15.157:0/3668947273 >> 172.21.15.157:0/3668947273 conn(0x7fe2fc06e730 msgr2=0x7fe2fc06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7ff4e1ffb700 1 -- 172.21.15.157:0/1531162209 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff4dc051330 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c084020 con 0x7f669c164620 2024-04-18T03:37:53.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7f37937fe700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3780066730 0x7f3780068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3784009cb0 tx=0x7f3784009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- 172.21.15.157:0/3668947273 shutdown_connections 2024-04-18T03:37:53.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- 172.21.15.157:0/3668947273 wait complete. 2024-04-18T03:37:53.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c084200 con 0x7f669c164620 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 Processor -- start 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- start start 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc0b2ad0 0x7fe2fc13b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2fc0cd9b0 0x7fe2fc1f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2fc141450 0x7fe2fc1f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc138e30 con 0x7fe2fc141450 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc159be0 con 0x7fe2fc0cd9b0 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fbfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc159ec0 con 0x7fe2fc0b2ad0 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2fc141450 0x7fe2fc1f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2fc141450 0x7fe2fc1f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56790/0 (socket says 172.21.15.157:56790) 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 -- 172.21.15.157:0/2715470895 learned_addr learned my addr 172.21.15.157:0/2715470895 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2faffd700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc0b2ad0 0x7fe2fc13b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fa7fc700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2fc0cd9b0 0x7fe2fc1f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 -- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc0b2ad0 msgr2=0x7fe2fc13b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc0b2ad0 0x7fe2fc13b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 -- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2fc0cd9b0 msgr2=0x7fe2fc1f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2fc0cd9b0 0x7fe2fc1f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 -- 172.21.15.157:0/2715470895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4009a70 con 0x7fe2fc141450 2024-04-18T03:37:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fa7fc700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2fc0cd9b0 0x7fe2fc1f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:53.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.243+0000 7fe2fb7fe700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2fc141450 0x7fe2fc1f3a80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000c4a0 tx=0x7fe2f000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f1a143700 1 Processor -- start 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f1a143700 1 -- start start 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f1a143700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f14159560 0x7f0f140cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f1a143700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0f140ce1c0 0x7f0f14070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f1a143700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1415d3d0 con 0x7f0f140cb540 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f1a143700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1415e190 con 0x7f0f140ce1c0 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f1a143700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1415d6b0 con 0x7f0f14159560 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19942700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0f140ce1c0 0x7f0f14070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19942700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0f140ce1c0 0x7f0f14070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56792/0 (socket says 172.21.15.157:56792) 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19942700 1 -- 172.21.15.157:0/1566907969 learned_addr learned my addr 172.21.15.157:0/1566907969 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19141700 1 --2- 172.21.15.157:0/1566907969 >> v2:172.21.15.175:3300/0 conn(0x7f0f14159560 0x7f0f140cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19942700 1 -- 172.21.15.157:0/1566907969 >> v2:172.21.15.175:3300/0 conn(0x7f0f14159560 msgr2=0x7f0f140cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19942700 1 --2- 172.21.15.157:0/1566907969 >> v2:172.21.15.175:3300/0 conn(0x7f0f14159560 0x7f0f140cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19942700 1 -- 172.21.15.157:0/1566907969 >> v1:172.21.15.175:6789/0 conn(0x7f0f140cb540 legacy=0x7f0f140cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19942700 1 -- 172.21.15.157:0/1566907969 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1415d990 con 0x7f0f140ce1c0 2024-04-18T03:37:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f0f19942700 1 --2- 172.21.15.157:0/1566907969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140ce1c0 0x7f0f14070070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f14071c40 tx=0x7f0f08009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43137e325d6063a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7ffac2ffd700 1 -- 172.21.15.157:0/3316878615 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4003dc0 con 0x7ffad4164410 2024-04-18T03:37:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7ffac2ffd700 1 -- 172.21.15.157:0/3316878615 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4027970 con 0x7ffad4164410 2024-04-18T03:37:53.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f377bfff700 1 -- 172.21.15.157:0/684043506 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f378c052c80 con 0x7f37940cd6a0 2024-04-18T03:37:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f6698ff9700 1 -- 172.21.15.157:0/299696441 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694020070 con 0x7f669c164620 2024-04-18T03:37:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f6698ff9700 1 -- 172.21.15.157:0/299696441 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694004980 con 0x7f669c164620 2024-04-18T03:37:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f9c937fe700 1 -- 172.21.15.157:0/4064490692 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84011830 con 0x7f9c9406c030 2024-04-18T03:37:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f9c937fe700 1 -- 172.21.15.157:0/4064490692 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84011990 con 0x7f9c9406c030 2024-04-18T03:37:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f9c937fe700 1 -- 172.21.15.157:0/4064490692 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84011d40 con 0x7f9c9406c030 2024-04-18T03:37:53.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.247+0000 7f527effd700 1 -- 172.21.15.157:0/2545108590 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f528408a060 con 0x7f52901444e0 2024-04-18T03:37:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7f9c99f70700 1 -- 172.21.15.157:0/4064490692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c9406c030 msgr2=0x7f9c94160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7f9c99f70700 1 --2- 172.21.15.157:0/4064490692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c9406c030 0x7f9c94160d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009910 tx=0x7f9c84009c20 comp rx=0 tx=0).stop 2024-04-18T03:37:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7ffac2ffd700 1 -- 172.21.15.157:0/3316878615 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffac4030440 con 0x7ffad4164410 2024-04-18T03:37:53.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7ffac2ffd700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ffab4066730 0x7ffab4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7f6698ff9700 1 -- 172.21.15.157:0/299696441 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6694031470 con 0x7f669c164620 2024-04-18T03:37:53.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7ffac2ffd700 1 -- 172.21.15.157:0/3316878615 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffac4088b30 con 0x7ffad4164410 2024-04-18T03:37:53.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7f6698ff9700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6688066730 0x7f6688068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7f6698ff9700 1 -- 172.21.15.157:0/299696441 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6694022070 con 0x7f669c164620 2024-04-18T03:37:53.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7f669bfff700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6688066730 0x7f6688068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7ffad259c700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ffab4066730 0x7ffab4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7f669bfff700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6688066730 0x7f6688068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f668c009b20 tx=0x7f668c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7ffad259c700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ffab4066730 0x7ffab4068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006bc0 tx=0x7ffac8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.251+0000 7ffac2ffd700 1 -- 172.21.15.157:0/3316878615 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ffac4055c40 con 0x7ffad4164410 2024-04-18T03:37:53.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f9c99f70700 1 -- 172.21.15.157:0/4064490692 shutdown_connections 2024-04-18T03:37:53.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f9c99f70700 1 --2- 172.21.15.157:0/4064490692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c9406c030 0x7f9c94160d50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f9c99f70700 1 --2- 172.21.15.157:0/4064490692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 0x7f9c9406baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f9c99f70700 1 -- 172.21.15.157:0/4064490692 >> 172.21.15.157:0/4064490692 conn(0x7f9c9406e730 msgr2=0x7f9c9406eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f9c99f70700 1 -- 172.21.15.157:0/4064490692 shutdown_connections 2024-04-18T03:37:53.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2e37fe700 1 -- 172.21.15.157:0/2715470895 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0005d90 con 0x7fe2fc141450 2024-04-18T03:37:53.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2e37fe700 1 -- 172.21.15.157:0/2715470895 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f00070d0 con 0x7fe2fc141450 2024-04-18T03:37:53.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2e37fe700 1 -- 172.21.15.157:0/2715470895 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0007440 con 0x7fe2fc141450 2024-04-18T03:37:53.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f0f13fff700 1 -- 172.21.15.157:0/1566907969 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08004230 con 0x7f0f140ce1c0 2024-04-18T03:37:53.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f0f13fff700 1 -- 172.21.15.157:0/1566907969 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08004390 con 0x7f0f140ce1c0 2024-04-18T03:37:53.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f0f13fff700 1 -- 172.21.15.157:0/1566907969 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080036c0 con 0x7f0f140ce1c0 2024-04-18T03:37:53.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f6698ff9700 1 -- 172.21.15.157:0/299696441 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6694057550 con 0x7f669c164620 2024-04-18T03:37:53.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f0f1a143700 1 -- 172.21.15.157:0/1566907969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140ce1c0 msgr2=0x7f0f14070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7f0f1a143700 1 --2- 172.21.15.157:0/1566907969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140ce1c0 0x7f0f14070070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f14071c40 tx=0x7f0f08009bf0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2fbfff700 1 -- 172.21.15.157:0/2715470895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2fc15a1a0 con 0x7fe2fc141450 2024-04-18T03:37:53.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2fbfff700 1 -- 172.21.15.157:0/2715470895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2fc13bf70 con 0x7fe2fc141450 2024-04-18T03:37:53.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2e37fe700 1 -- 172.21.15.157:0/2715470895 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2f00075a0 con 0x7fe2fc141450 2024-04-18T03:37:53.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2e37fe700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2e8066780 0x7fe2e8068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2e37fe700 1 -- 172.21.15.157:0/2715470895 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2f0083670 con 0x7fe2fc141450 2024-04-18T03:37:53.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.255+0000 7fe2faffd700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2e8066780 0x7fe2e8068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- 172.21.15.157:0/1566907969 shutdown_connections 2024-04-18T03:37:53.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 --2- 172.21.15.157:0/1566907969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140ce1c0 0x7f0f14070070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7fe2faffd700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2e8066780 0x7fe2e8068c40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4014040 tx=0x7fe2f4011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 --2- 172.21.15.157:0/1566907969 >> v2:172.21.15.175:3300/0 conn(0x7f0f14159560 0x7f0f140cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- 172.21.15.157:0/1566907969 >> 172.21.15.157:0/1566907969 conn(0x7f0f140b12d0 msgr2=0x7f0f1406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- 172.21.15.157:0/1566907969 shutdown_connections 2024-04-18T03:37:53.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- 172.21.15.157:0/1566907969 wait complete. 2024-04-18T03:37:53.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 Processor -- start 2024-04-18T03:37:53.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- start start 2024-04-18T03:37:53.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140cb540 0x7f0f14151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f140ce1c0 0x7f0f141402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14159560 0x7f0f14153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f141521c0 con 0x7f0f140cb540 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1415a9b0 con 0x7f0f14159560 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14151ee0 con 0x7f0f140ce1c0 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140cb540 0x7f0f14151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140cb540 0x7f0f14151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56802/0 (socket says 172.21.15.157:56802) 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 -- 172.21.15.157:0/451308545 learned_addr learned my addr 172.21.15.157:0/451308545 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f18940700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f140ce1c0 0x7f0f141402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19942700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14159560 0x7f0f14153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 -- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f140ce1c0 msgr2=0x7f0f141402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f140ce1c0 0x7f0f141402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 -- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14159560 msgr2=0x7f0f14153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14159560 0x7f0f14153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 -- 172.21.15.157:0/451308545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f08009570 con 0x7f0f140cb540 2024-04-18T03:37:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f19141700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140cb540 0x7f0f14151020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c007ec0 tx=0x7f0f0c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f11ffb700 1 -- 172.21.15.157:0/451308545 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c00eea0 con 0x7f0f140cb540 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f11ffb700 1 -- 172.21.15.157:0/451308545 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c014420 con 0x7f0f140cb540 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1415abc0 con 0x7f0f140cb540 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.259+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1415af50 con 0x7f0f140cb540 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.263+0000 7f0f11ffb700 1 -- 172.21.15.157:0/451308545 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0147b0 con 0x7f0f140cb540 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.263+0000 7f0f11ffb700 1 -- 172.21.15.157:0/451308545 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0f0c014950 con 0x7f0f140cb540 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.263+0000 7f0f11ffb700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0efc06ae30 0x7f0efc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.263+0000 7f0f11ffb700 1 -- 172.21.15.157:0/451308545 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f0c084d50 con 0x7f0f140cb540 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.263+0000 7f0f18940700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0efc06ae30 0x7f0efc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.263+0000 7f0f18940700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0efc06ae30 0x7f0efc06d2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0f141f1cc0 tx=0x7f0f040090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 -- 172.21.15.157:0/4064490692 wait complete. 2024-04-18T03:37:53.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7fe2e17fa700 1 -- 172.21.15.157:0/2715470895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2fc04e650 con 0x7fe2fc141450 2024-04-18T03:37:53.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef4005310 con 0x7f0f140cb540 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 Processor -- start 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 -- start start 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 0x7f9c940ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c9406c030 0x7f9c940cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c94143400 0x7f9c94138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940aeab0 con 0x7f9c9406c030 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94138cb0 con 0x7f9c94143400 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c99f70700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94152150 con 0x7f9c9406a4b0 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c93fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c9406c030 0x7f9c940cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c93fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c9406c030 0x7f9c940cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56818/0 (socket says 172.21.15.157:56818) 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c93fff700 1 -- 172.21.15.157:0/2018720895 learned_addr learned my addr 172.21.15.157:0/2018720895 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.271+0000 7f9c9976f700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c94143400 0x7f9c94138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.275+0000 7f9c93fff700 1 -- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 msgr2=0x7f9c940ad480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.275+0000 7f9c93fff700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 0x7f9c940ad480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.275+0000 7f9c93fff700 1 -- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c94143400 msgr2=0x7f9c94138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.275+0000 7f9c93fff700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c94143400 0x7f9c94138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.275+0000 7f9c93fff700 1 -- 172.21.15.157:0/2018720895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c84009570 con 0x7f9c9406c030 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.275+0000 7f9c93fff700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c9406c030 0x7f9c940cad70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800e9d0 tx=0x7f9c8800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.279+0000 7fe2e37fe700 1 -- 172.21.15.157:0/2715470895 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe2f0050880 con 0x7fe2fc141450 2024-04-18T03:37:53.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.287+0000 7f9c917fa700 1 -- 172.21.15.157:0/2018720895 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800c850 con 0x7f9c9406c030 2024-04-18T03:37:53.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.287+0000 7f9c917fa700 1 -- 172.21.15.157:0/2018720895 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8800c9b0 con 0x7f9c9406c030 2024-04-18T03:37:53.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.287+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c940ada60 con 0x7f9c9406c030 2024-04-18T03:37:53.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.287+0000 7f9c917fa700 1 -- 172.21.15.157:0/2018720895 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800cd20 con 0x7f9c9406c030 2024-04-18T03:37:53.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.287+0000 7f0f11ffb700 1 -- 172.21.15.157:0/451308545 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0f0c051db0 con 0x7f0f140cb540 2024-04-18T03:37:53.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.287+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c940ae020 con 0x7f9c9406c030 2024-04-18T03:37:53.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.287+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c940aec60 con 0x7f9c9406c030 2024-04-18T03:37:53.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.303+0000 7f9c917fa700 1 -- 172.21.15.157:0/2018720895 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c88013470 con 0x7f9c9406c030 2024-04-18T03:37:53.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.303+0000 7f9c917fa700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c80066730 0x7f9c80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:53.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.303+0000 7f9c917fa700 1 -- 172.21.15.157:0/2018720895 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c88084b80 con 0x7f9c9406c030 2024-04-18T03:37:53.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.303+0000 7f9c98f6e700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c80066730 0x7f9c80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:53.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.303+0000 7f9c98f6e700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c80066730 0x7f9c80068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c001fe0 tx=0x7f9c8c0015f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:53.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.303+0000 7f9c917fa700 1 -- 172.21.15.157:0/2018720895 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9c88051be0 con 0x7f9c9406c030 2024-04-18T03:37:53.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.551+0000 7f3798e4d700 1 -- 172.21.15.157:0/684043506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3794159810 con 0x7f37940cd6a0 2024-04-18T03:37:53.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.551+0000 7f377bfff700 1 -- 172.21.15.157:0/684043506 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3794159810 con 0x7f37940cd6a0 2024-04-18T03:37:53.556 INFO:teuthology.orchestra.run.smithi157.stdout:64424509447 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 -- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3780066730 msgr2=0x7f3780068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3780066730 0x7f3780068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3784009cb0 tx=0x7f3784009240 comp rx=0 tx=0).stop 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 -- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37940cd6a0 msgr2=0x7f379415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37940cd6a0 0x7f379415a1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f378c017000 tx=0x7f378c004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 -- 172.21.15.157:0/684043506 shutdown_connections 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3780066730 0x7f3780068bf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37940cd6a0 0x7f379415a1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f379415cdb0 0x7f3794151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 --2- 172.21.15.157:0/684043506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37940cb730 0x7f3794153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 -- 172.21.15.157:0/684043506 >> 172.21.15.157:0/684043506 conn(0x7f379406e730 msgr2=0x7f379406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 -- 172.21.15.157:0/684043506 shutdown_connections 2024-04-18T03:37:53.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.559+0000 7f3779ffb700 1 -- 172.21.15.157:0/684043506 wait complete. 2024-04-18T03:37:53.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.563+0000 7ff4f25a4700 1 -- 172.21.15.157:0/1531162209 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff4cc0055c0 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.563+0000 7ff4e1ffb700 1 -- 172.21.15.157:0/1531162209 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4dc054950 con 0x7ff4ec0cd6a0 2024-04-18T03:37:53.571 INFO:teuthology.orchestra.run.smithi157.stdout:60129542150 2024-04-18T03:37:53.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.567+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5274005890 con 0x7f52901444e0 2024-04-18T03:37:53.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f527effd700 1 -- 172.21.15.157:0/2545108590 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5284015070 con 0x7f52901444e0 2024-04-18T03:37:53.573 INFO:teuthology.orchestra.run.smithi157.stdout:60129542151 2024-04-18T03:37:53.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f669c04e650 con 0x7f669c164620 2024-04-18T03:37:53.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffad4066640 con 0x7ffad4164410 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 -- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff4d80668e0 msgr2=0x7ff4d8068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff4d80668e0 0x7ff4d8068da0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009ba0 tx=0x7ff4e801c040 comp rx=0 tx=0).stop 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 -- 172.21.15.157:0/1531162209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cd6a0 msgr2=0x7ff4ec0a7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cd6a0 0x7ff4ec0a7e90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00e8a0 tx=0x7ff4dc00ebb0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 -- 172.21.15.157:0/1531162209 shutdown_connections 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff4d80668e0 0x7ff4d8068da0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ec15cdb0 0x7ff4ec0ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4ec0cd6a0 0x7ff4ec0a7e90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 --2- 172.21.15.157:0/1531162209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ec0cb730 0x7ff4ec144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 -- 172.21.15.157:0/1531162209 >> 172.21.15.157:0/1531162209 conn(0x7ff4ec06e730 msgr2=0x7ff4ec0adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f6698ff9700 1 -- 172.21.15.157:0/299696441 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66940570e0 con 0x7f669c164620 2024-04-18T03:37:53.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 -- 172.21.15.157:0/1531162209 shutdown_connections 2024-04-18T03:37:53.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ff4d77fe700 1 -- 172.21.15.157:0/1531162209 wait complete. 2024-04-18T03:37:53.577 INFO:teuthology.orchestra.run.smithi157.stdout:60129542150 2024-04-18T03:37:53.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7ffac2ffd700 1 -- 172.21.15.157:0/3316878615 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffac4059260 con 0x7ffad4164410 2024-04-18T03:37:53.577 INFO:teuthology.orchestra.run.smithi157.stdout:64424509446 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f52700667b0 msgr2=0x7f5270068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f52700667b0 0x7f5270068c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52901515a0 tx=0x7f5288009040 comp rx=0 tx=0).stop 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 msgr2=0x7f52901f71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52901f71e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5284014040 tx=0x7f5284004770 comp rx=0 tx=0).stop 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 shutdown_connections 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f52700667b0 0x7f5270068c70 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52901515a0 tx=0x7f5288009040 comp rx=0 tx=0).stop 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52901656b0 0x7f529006bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5290165250 0x7f529006b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 --2- 172.21.15.157:0/2545108590 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52901444e0 0x7f52901f71e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.571+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 >> 172.21.15.157:0/2545108590 conn(0x7f529006e730 msgr2=0x7f5290163460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-04-18T03:37:53.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 shutdown_connections 2024-04-18T03:37:53.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f528f59e700 1 -- 172.21.15.157:0/2545108590 wait complete. 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6688066730 msgr2=0x7f6688068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6688066730 0x7f6688068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f668c009b20 tx=0x7f668c008040 comp rx=0 tx=0).stop 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 msgr2=0x7f669c16db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16db40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f669400b370 tx=0x7f6694004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 shutdown_connections 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6688066730 0x7f6688068bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c1641a0 0x7f669c16d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669c164620 0x7f669c16db40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 --2- 172.21.15.157:0/299696441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f669c0cb990 0x7f669c163a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 >> 172.21.15.157:0/299696441 conn(0x7f669c06e730 msgr2=0x7f669c0b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ffab4066730 msgr2=0x7ffab4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ffab4066730 0x7ffab4068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006bc0 tx=0x7ffac8008040 comp rx=0 tx=0).stop 2024-04-18T03:37:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad4164410 msgr2=0x7ffad406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad4164410 0x7ffad406c5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffac40061e0 tx=0x7ffac4004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 shutdown_connections 2024-04-18T03:37:53.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7f66a15bd700 1 -- 172.21.15.157:0/299696441 wait complete. 2024-04-18T03:37:53.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 shutdown_connections 2024-04-18T03:37:53.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ffab4066730 0x7ffab4068bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad4164410 0x7ffad406c5d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffad416da40 0x7ffad407d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 --2- 172.21.15.157:0/3316878615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffad40cb990 0x7ffad4167340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 >> 172.21.15.157:0/3316878615 conn(0x7ffad406e730 msgr2=0x7ffad40ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 shutdown_connections 2024-04-18T03:37:53.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.575+0000 7ffad359e700 1 -- 172.21.15.157:0/3316878615 wait complete. 2024-04-18T03:37:53.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.587+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ef40055c0 con 0x7f0f140cb540 2024-04-18T03:37:53.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.7 2024-04-18T03:37:53.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.587+0000 7f0f11ffb700 1 -- 172.21.15.157:0/451308545 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f0c0553d0 con 0x7f0f140cb540 2024-04-18T03:37:53.593 INFO:teuthology.orchestra.run.smithi157.stdout:60129542150 2024-04-18T03:37:53.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.1 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0efc06ae30 msgr2=0x7f0efc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0efc06ae30 0x7f0efc06d2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0f141f1cc0 tx=0x7f0f040090e0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140cb540 msgr2=0x7f0f14151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140cb540 0x7f0f14151020 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c007ec0 tx=0x7f0f0c00e3c0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 shutdown_connections 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0efc06ae30 0x7f0efc06d2f0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0f141f1cc0 tx=0x7f0f040090e0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14159560 0x7f0f14153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f140ce1c0 0x7f0f141402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 --2- 172.21.15.157:0/451308545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f140cb540 0x7f0f14151020 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 >> 172.21.15.157:0/451308545 conn(0x7f0f140b12d0 msgr2=0x7f0f14071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 shutdown_connections 2024-04-18T03:37:53.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.591+0000 7f0f1a143700 1 -- 172.21.15.157:0/451308545 wait complete. 2024-04-18T03:37:53.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-04-18T03:37:53.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.2 2024-04-18T03:37:53.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.595+0000 7fe2e17fa700 1 -- 172.21.15.157:0/2715470895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe2fc0b3820 con 0x7fe2fc141450 2024-04-18T03:37:53.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.595+0000 7fe2e37fe700 1 -- 172.21.15.157:0/2715470895 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2f0017070 con 0x7fe2fc141450 2024-04-18T03:37:53.599 INFO:teuthology.orchestra.run.smithi157.stdout:60129542150 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.595+0000 7fe2e17fa700 1 -- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2e8066780 msgr2=0x7fe2e8068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.595+0000 7fe2e17fa700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2e8066780 0x7fe2e8068c40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4014040 tx=0x7fe2f4011000 comp rx=0 tx=0).stop 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.595+0000 7fe2e17fa700 1 -- 172.21.15.157:0/2715470895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2fc141450 msgr2=0x7fe2fc1f3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.595+0000 7fe2e17fa700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2fc141450 0x7fe2fc1f3a80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000c4a0 tx=0x7fe2f000c7b0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.599+0000 7fe2e17fa700 1 -- 172.21.15.157:0/2715470895 shutdown_connections 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.599+0000 7fe2e17fa700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2e8066780 0x7fe2e8068c40 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4014040 tx=0x7fe2f4011000 comp rx=0 tx=0).stop 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.599+0000 7fe2e17fa700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2fc0cd9b0 0x7fe2fc1f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.599+0000 7fe2e17fa700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2fc141450 0x7fe2fc1f3a80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.599+0000 7fe2e17fa700 1 --2- 172.21.15.157:0/2715470895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2fc0b2ad0 0x7fe2fc13b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.599+0000 7fe2e17fa700 1 -- 172.21.15.157:0/2715470895 >> 172.21.15.157:0/2715470895 conn(0x7fe2fc06e730 msgr2=0x7fe2fc0b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.599+0000 7fe2e17fa700 1 -- 172.21.15.157:0/2715470895 shutdown_connections 2024-04-18T03:37:53.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.599+0000 7fe2e17fa700 1 -- 172.21.15.157:0/2715470895 wait complete. 2024-04-18T03:37:53.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2024-04-18T03:37:53.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.3 2024-04-18T03:37:53.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.607+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9c940cdd60 con 0x7f9c9406c030 2024-04-18T03:37:53.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c917fa700 1 -- 172.21.15.157:0/2018720895 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c88021020 con 0x7f9c9406c030 2024-04-18T03:37:53.613 INFO:teuthology.orchestra.run.smithi157.stdout:60129542150 2024-04-18T03:37:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c80066730 msgr2=0x7f9c80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c80066730 0x7f9c80068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c001fe0 tx=0x7f9c8c0015f0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c9406c030 msgr2=0x7f9c940cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c9406c030 0x7f9c940cad70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800e9d0 tx=0x7f9c8800ece0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 shutdown_connections 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9c80066730 0x7f9c80068bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c94143400 0x7f9c94138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c9406c030 0x7f9c940cad70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 --2- 172.21.15.157:0/2018720895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9406a4b0 0x7f9c940ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 >> 172.21.15.157:0/2018720895 conn(0x7f9c9406e730 msgr2=0x7f9c94144660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 shutdown_connections 2024-04-18T03:37:53.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:53.611+0000 7f9c99f70700 1 -- 172.21.15.157:0/2018720895 wait complete. 2024-04-18T03:37:53.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.5 2024-04-18T03:37:54.580 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-18T03:37:54.593 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-18T03:37:54.595 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T03:37:54.597 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-18T03:37:54.599 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T03:37:54.606 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T03:37:54.612 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T03:37:54.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-18T03:37:54.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.719+0000 7fc04485a700 1 Processor -- start 2024-04-18T03:37:54.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.719+0000 7fc04485a700 1 -- start start 2024-04-18T03:37:54.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc040142880 0x7fc04015d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc040142d10 con 0x7fc04015cdb0 2024-04-18T03:37:54.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04015d6d0 con 0x7fc0400b2790 2024-04-18T03:37:54.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400cbef0 con 0x7fc040142880 2024-04-18T03:37:54.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03e59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc04015cdb0 0x7fc0400cb730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36680/0 (socket says 172.21.15.157:36680) 2024-04-18T03:37:54.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03e59c700 1 -- 172.21.15.157:0/4063317266 learned_addr learned my addr 172.21.15.157:0/4063317266 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:54.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03dd9b700 1 --2- 172.21.15.157:0/4063317266 >> v2:172.21.15.157:3300/0 conn(0x7fc040142880 0x7fc04015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03dd9b700 1 -- 172.21.15.157:0/4063317266 >> v1:172.21.15.175:6789/0 conn(0x7fc0400b2790 legacy=0x7fc0400b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03dd9b700 1 -- 172.21.15.157:0/4063317266 >> v1:172.21.15.157:6789/0 conn(0x7fc04015cdb0 legacy=0x7fc0400cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03dd9b700 1 -- 172.21.15.157:0/4063317266 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400b1cb0 con 0x7fc040142880 2024-04-18T03:37:54.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03dd9b700 1 --2- 172.21.15.157:0/4063317266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc040142880 0x7fc04015d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc034009ae0 tx=0x7fc034009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7fe2cafa07c94a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03d59a700 1 -- 172.21.15.157:0/4063317266 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400b810 con 0x7fc040142880 2024-04-18T03:37:54.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc03d59a700 1 -- 172.21.15.157:0/4063317266 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400b970 con 0x7fc040142880 2024-04-18T03:37:54.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 -- 172.21.15.157:0/4063317266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc040142880 msgr2=0x7fc04015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 --2- 172.21.15.157:0/4063317266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc040142880 0x7fc04015d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc034009ae0 tx=0x7fc034009df0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 -- 172.21.15.157:0/4063317266 shutdown_connections 2024-04-18T03:37:54.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 --2- 172.21.15.157:0/4063317266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc040142880 0x7fc04015d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 -- 172.21.15.157:0/4063317266 >> 172.21.15.157:0/4063317266 conn(0x7fc04006e730 msgr2=0x7fc04006eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:54.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 -- 172.21.15.157:0/4063317266 shutdown_connections 2024-04-18T03:37:54.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.723+0000 7fc04485a700 1 -- 172.21.15.157:0/4063317266 wait complete. 2024-04-18T03:37:54.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc04485a700 1 Processor -- start 2024-04-18T03:37:54.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc04485a700 1 -- start start 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc04485a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0400b2790 0x7fc0400acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc04485a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc040142880 0x7fc04016a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc04485a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc04015cdb0 0x7fc04014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc04485a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400ac2d0 con 0x7fc0400b2790 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc04485a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400acb30 con 0x7fc04015cdb0 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc04485a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040136020 con 0x7fc040142880 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc03e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0400b2790 0x7fc0400acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc03e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0400b2790 0x7fc0400acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56822/0 (socket says 172.21.15.157:56822) 2024-04-18T03:37:54.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc03e59c700 1 -- 172.21.15.157:0/4009107979 learned_addr learned my addr 172.21.15.157:0/4009107979 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.727+0000 7fc03ed9d700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc04015cdb0 0x7fc04014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc03e59c700 1 -- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc040142880 msgr2=0x7fc04016a540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:54.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc03e59c700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc040142880 0x7fc04016a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc03e59c700 1 -- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc04015cdb0 msgr2=0x7fc04014f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc03e59c700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc04015cdb0 0x7fc04014f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc03e59c700 1 -- 172.21.15.157:0/4009107979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0340094b0 con 0x7fc0400b2790 2024-04-18T03:37:54.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc03e59c700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0400b2790 0x7fc0400acfc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc038001fa0 tx=0x7fc038002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc02effd700 1 -- 172.21.15.157:0/4009107979 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800aa00 con 0x7fc0400b2790 2024-04-18T03:37:54.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc02effd700 1 -- 172.21.15.157:0/4009107979 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800ab60 con 0x7fc0400b2790 2024-04-18T03:37:54.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc02effd700 1 -- 172.21.15.157:0/4009107979 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038012400 con 0x7fc0400b2790 2024-04-18T03:37:54.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc04485a700 1 -- 172.21.15.157:0/4009107979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0400ac4e0 con 0x7fc0400b2790 2024-04-18T03:37:54.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc04485a700 1 -- 172.21.15.157:0/4009107979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04016aa80 con 0x7fc0400b2790 2024-04-18T03:37:54.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc04485a700 1 -- 172.21.15.157:0/4009107979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04006a2a0 con 0x7fc0400b2790 2024-04-18T03:37:54.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fe3a157f700 1 Processor -- start 2024-04-18T03:37:54.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc02effd700 1 -- 172.21.15.157:0/4009107979 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc038012560 con 0x7fc0400b2790 2024-04-18T03:37:54.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fc02effd700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc020066780 0x7fc020068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fc02effd700 1 -- 172.21.15.157:0/4009107979 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0380844b0 con 0x7fc0400b2790 2024-04-18T03:37:54.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fc03dd9b700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc020066780 0x7fc020068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.731+0000 7fe3a157f700 1 -- start start 2024-04-18T03:37:54.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c06e810 0x7fe39c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fc03dd9b700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc020066780 0x7fc020068c40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc0400cc720 tx=0x7fc034008000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe39c162010 0x7fe39c0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c0b25e0 con 0x7fe39c161bb0 2024-04-18T03:37:54.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0ce8c0 con 0x7fe39c162010 2024-04-18T03:37:54.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c06f130 con 0x7fe39c06e810 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c06e810 0x7fe39c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39affd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c06e810 0x7fe39c06ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60802/0 (socket says 172.21.15.157:60802) 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39affd700 1 -- 172.21.15.157:0/4119760834 learned_addr learned my addr 172.21.15.157:0/4119760834 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39b7fe700 1 --2- 172.21.15.157:0/4119760834 >> v2:172.21.15.175:3300/0 conn(0x7fe39c162010 0x7fe39c0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39affd700 1 -- 172.21.15.157:0/4119760834 >> v2:172.21.15.175:3300/0 conn(0x7fe39c162010 msgr2=0x7fe39c0b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39affd700 1 --2- 172.21.15.157:0/4119760834 >> v2:172.21.15.175:3300/0 conn(0x7fe39c162010 0x7fe39c0b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39affd700 1 -- 172.21.15.157:0/4119760834 >> v1:172.21.15.175:6789/0 conn(0x7fe39c161bb0 legacy=0x7fe39c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39affd700 1 -- 172.21.15.157:0/4119760834 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c14aa60 con 0x7fe39c06e810 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe399ffb700 1 -- 172.21.15.157:0/4119760834 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049407189 0 0) 0x7fe39c0b25e0 con 0x7fe39c161bb0 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe39affd700 1 --2- 172.21.15.157:0/4119760834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c06e810 0x7fe39c06ebf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe394009e50 tx=0x7fe39400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3af71f0900515362 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe399ffb700 1 -- 172.21.15.157:0/4119760834 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400e070 con 0x7fe39c06e810 2024-04-18T03:37:54.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe399ffb700 1 -- 172.21.15.157:0/4119760834 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400b9c0 con 0x7fe39c06e810 2024-04-18T03:37:54.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 -- 172.21.15.157:0/4119760834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c06e810 msgr2=0x7fe39c06ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 --2- 172.21.15.157:0/4119760834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c06e810 0x7fe39c06ebf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe394009e50 tx=0x7fe39400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:54.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 -- 172.21.15.157:0/4119760834 shutdown_connections 2024-04-18T03:37:54.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 --2- 172.21.15.157:0/4119760834 >> v2:172.21.15.175:3300/0 conn(0x7fe39c162010 0x7fe39c0b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 --2- 172.21.15.157:0/4119760834 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c06e810 0x7fe39c06ebf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.735+0000 7fe3a157f700 1 -- 172.21.15.157:0/4119760834 >> 172.21.15.157:0/4119760834 conn(0x7fe39c0b12d0 msgr2=0x7fe39c06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:54.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 -- 172.21.15.157:0/4119760834 shutdown_connections 2024-04-18T03:37:54.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 -- 172.21.15.157:0/4119760834 wait complete. 2024-04-18T03:37:54.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 Processor -- start 2024-04-18T03:37:54.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 -- start start 2024-04-18T03:37:54.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe39c161bb0 0x7fe39c161160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe39c162010 0x7fe39c145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c148900 0x7fe39c148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1492f0 con 0x7fe39c161bb0 2024-04-18T03:37:54.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0ab5b0 con 0x7fe39c162010 2024-04-18T03:37:54.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe3a157f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0ab890 con 0x7fe39c148900 2024-04-18T03:37:54.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fc02effd700 1 -- 172.21.15.157:0/4009107979 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc038051760 con 0x7fc0400b2790 2024-04-18T03:37:54.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe39a7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe39c162010 0x7fe39c145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe39a7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe39c162010 0x7fe39c145a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:59004/0 (socket says 172.21.15.157:59004) 2024-04-18T03:37:54.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe39a7fc700 1 -- 172.21.15.157:0/2735432314 learned_addr learned my addr 172.21.15.157:0/2735432314 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe39b7fe700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c148900 0x7fe39c148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.739+0000 7fe39affd700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe39c161bb0 0x7fe39c161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe39affd700 1 -- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c148900 msgr2=0x7fe39c148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe39affd700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c148900 0x7fe39c148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe39affd700 1 -- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe39c162010 msgr2=0x7fe39c145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe39affd700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe39c162010 0x7fe39c145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe39affd700 1 -- 172.21.15.157:0/2735432314 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394009b30 con 0x7fe39c161bb0 2024-04-18T03:37:54.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe39affd700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe39c161bb0 0x7fe39c161160 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe394015000 tx=0x7fe394004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe3837fe700 1 -- 172.21.15.157:0/2735432314 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39401b630 con 0x7fe39c161bb0 2024-04-18T03:37:54.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe3837fe700 1 -- 172.21.15.157:0/2735432314 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400b9c0 con 0x7fe39c161bb0 2024-04-18T03:37:54.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe3837fe700 1 -- 172.21.15.157:0/2735432314 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39401b9d0 con 0x7fe39c161bb0 2024-04-18T03:37:54.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe3a157f700 1 -- 172.21.15.157:0/2735432314 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c0abb70 con 0x7fe39c161bb0 2024-04-18T03:37:54.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe3a157f700 1 -- 172.21.15.157:0/2735432314 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c0ac130 con 0x7fe39c161bb0 2024-04-18T03:37:54.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6aa6bc700 1 Processor -- start 2024-04-18T03:37:54.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6aa6bc700 1 -- start start 2024-04-18T03:37:54.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6aa6bc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a415cdb0 0x7fb6a4142880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6aa6bc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb6a40b2790 0x7fb6a40b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6aa6bc700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a40cbef0 con 0x7fb6a40cb730 2024-04-18T03:37:54.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6aa6bc700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a40b1cb0 con 0x7fb6a40b2790 2024-04-18T03:37:54.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6aa6bc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40b1f90 con 0x7fb6a415cdb0 2024-04-18T03:37:54.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fe3837fe700 1 -- 172.21.15.157:0/2735432314 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe39401bb30 con 0x7fe39c161bb0 2024-04-18T03:37:54.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a415cdb0 0x7fb6a4142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a415cdb0 0x7fb6a4142880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60820/0 (socket says 172.21.15.157:60820) 2024-04-18T03:37:54.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.743+0000 7fb6a3fff700 1 -- 172.21.15.157:0/461279381 learned_addr learned my addr 172.21.15.157:0/461279381 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fe3837fe700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe388066800 0x7fe388068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fe3837fe700 1 -- 172.21.15.157:0/2735432314 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe394085d40 con 0x7fe39c161bb0 2024-04-18T03:37:54.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a8c59700 1 --2- 172.21.15.157:0/461279381 >> v2:172.21.15.157:3300/0 conn(0x7fb6a40b2790 0x7fb6a40b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a3fff700 1 -- 172.21.15.157:0/461279381 >> v2:172.21.15.157:3300/0 conn(0x7fb6a40b2790 msgr2=0x7fb6a40b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:54.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a3fff700 1 --2- 172.21.15.157:0/461279381 >> v2:172.21.15.157:3300/0 conn(0x7fb6a40b2790 0x7fb6a40b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a3fff700 1 -- 172.21.15.157:0/461279381 >> v1:172.21.15.157:6789/0 conn(0x7fb6a40cb730 legacy=0x7fb6a415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a3fff700 1 -- 172.21.15.157:0/461279381 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40b2270 con 0x7fb6a415cdb0 2024-04-18T03:37:54.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fe39a7fc700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe388066800 0x7fe388068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a8c59700 1 --2- 172.21.15.157:0/461279381 >> v2:172.21.15.157:3300/0 conn(0x7fb6a40b2790 0x7fb6a40b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:54.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a3fff700 1 --2- 172.21.15.157:0/461279381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a415cdb0 0x7fb6a4142880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00d370 tx=0x7fb69c00d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99a1d32a37d832eb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fe3817fa700 1 -- 172.21.15.157:0/2735432314 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe374005310 con 0x7fe39c161bb0 2024-04-18T03:37:54.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a2ffd700 1 -- 172.21.15.157:0/461279381 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c010070 con 0x7fb6a415cdb0 2024-04-18T03:37:54.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a2ffd700 1 -- 172.21.15.157:0/461279381 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00dd10 con 0x7fb6a415cdb0 2024-04-18T03:37:54.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6a2ffd700 1 -- 172.21.15.157:0/461279381 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c007d50 con 0x7fb6a415cdb0 2024-04-18T03:37:54.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fe39a7fc700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe388066800 0x7fe388068cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0b0340 tx=0x7fe38c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/461279381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a415cdb0 msgr2=0x7fb6a4142880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/461279381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a415cdb0 0x7fb6a4142880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00d370 tx=0x7fb69c00d680 comp rx=0 tx=0).stop 2024-04-18T03:37:54.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/461279381 shutdown_connections 2024-04-18T03:37:54.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/461279381 >> v2:172.21.15.157:3300/0 conn(0x7fb6a40b2790 0x7fb6a40b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/461279381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a415cdb0 0x7fb6a4142880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/461279381 >> 172.21.15.157:0/461279381 conn(0x7fb6a406e730 msgr2=0x7fb6a406eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:54.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/461279381 shutdown_connections 2024-04-18T03:37:54.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.747+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/461279381 wait complete. 2024-04-18T03:37:54.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6aa6bc700 1 Processor -- start 2024-04-18T03:37:54.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6aa6bc700 1 -- start start 2024-04-18T03:37:54.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45aeadc700 1 Processor -- start 2024-04-18T03:37:54.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45aeadc700 1 -- start start 2024-04-18T03:37:54.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6aa6bc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a40b2790 0x7fb6a4157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6aa6bc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6a40cb730 0x7fb6a41585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6aa6bc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6a415cdb0 0x7fb6a4158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6aa6bc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a415ba80 con 0x7fb6a415cdb0 2024-04-18T03:37:54.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6aa6bc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40ad300 con 0x7fb6a40cb730 2024-04-18T03:37:54.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6aa6bc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40ac730 con 0x7fb6a40b2790 2024-04-18T03:37:54.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45aeadc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f45a806a4b0 0x7f45a806baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45aeadc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806c030 0x7f45a8160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45aeadc700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a806aa50 con 0x7f45a8143400 2024-04-18T03:37:54.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45aeadc700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a806ad30 con 0x7f45a806a4b0 2024-04-18T03:37:54.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45aeadc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a806b010 con 0x7f45a806c030 2024-04-18T03:37:54.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a40b2790 0x7fb6a4157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a40b2790 0x7fb6a4157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60836/0 (socket says 172.21.15.157:60836) 2024-04-18T03:37:54.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a3fff700 1 -- 172.21.15.157:0/1493919182 learned_addr learned my addr 172.21.15.157:0/1493919182 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a8c59700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6a415cdb0 0x7fb6a4158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a37fe700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6a40cb730 0x7fb6a41585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ae2db700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806c030 0x7f45a8160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ad2d9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f45a806a4b0 0x7f45a806baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ad2d9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f45a806a4b0 0x7f45a806baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:59018/0 (socket says 172.21.15.157:59018) 2024-04-18T03:37:54.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ad2d9700 1 -- 172.21.15.157:0/3477040247 learned_addr learned my addr 172.21.15.157:0/3477040247 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a8c59700 1 -- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a40b2790 msgr2=0x7fb6a4157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a8c59700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a40b2790 0x7fb6a4157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a8c59700 1 -- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6a40cb730 msgr2=0x7fb6a41585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a8c59700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6a40cb730 0x7fb6a41585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a8c59700 1 -- 172.21.15.157:0/1493919182 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c00d050 con 0x7fb6a415cdb0 2024-04-18T03:37:54.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a3fff700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a40b2790 0x7fb6a4157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:54.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7fb6a8c59700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6a415cdb0 0x7fb6a4158b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c7f0 tx=0x7fb69800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ae2db700 1 -- 172.21.15.157:0/3477040247 >> v2:172.21.15.175:3300/0 conn(0x7f45a806a4b0 msgr2=0x7f45a806baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:54.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ae2db700 1 --2- 172.21.15.157:0/3477040247 >> v2:172.21.15.175:3300/0 conn(0x7f45a806a4b0 0x7f45a806baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ae2db700 1 -- 172.21.15.157:0/3477040247 >> v1:172.21.15.175:6789/0 conn(0x7f45a8143400 legacy=0x7f45a80aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ae2db700 1 -- 172.21.15.157:0/3477040247 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a806b2f0 con 0x7f45a806c030 2024-04-18T03:37:54.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.751+0000 7f45ad2d9700 1 --2- 172.21.15.157:0/3477040247 >> v2:172.21.15.175:3300/0 conn(0x7f45a806a4b0 0x7f45a806baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:54.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45ae2db700 1 --2- 172.21.15.157:0/3477040247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806c030 0x7f45a8160d50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009d90 tx=0x7f45a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=531a8d171be0e97d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45acad8700 1 -- 172.21.15.157:0/3477040247 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000e070 con 0x7f45a806c030 2024-04-18T03:37:54.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45acad8700 1 -- 172.21.15.157:0/3477040247 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a000bb20 con 0x7f45a806c030 2024-04-18T03:37:54.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45acad8700 1 -- 172.21.15.157:0/3477040247 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0012430 con 0x7f45a806c030 2024-04-18T03:37:54.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45aeadc700 1 -- 172.21.15.157:0/3477040247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806c030 msgr2=0x7f45a8160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45aeadc700 1 --2- 172.21.15.157:0/3477040247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806c030 0x7f45a8160d50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009d90 tx=0x7f45a000b330 comp rx=0 tx=0).stop 2024-04-18T03:37:54.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7fb6a0ff9700 1 -- 172.21.15.157:0/1493919182 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698004230 con 0x7fb6a415cdb0 2024-04-18T03:37:54.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45aeadc700 1 -- 172.21.15.157:0/3477040247 shutdown_connections 2024-04-18T03:37:54.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45aeadc700 1 --2- 172.21.15.157:0/3477040247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806c030 0x7f45a8160d50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45aeadc700 1 --2- 172.21.15.157:0/3477040247 >> v2:172.21.15.175:3300/0 conn(0x7f45a806a4b0 0x7f45a806baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45aeadc700 1 -- 172.21.15.157:0/3477040247 >> 172.21.15.157:0/3477040247 conn(0x7f45a806e730 msgr2=0x7f45a806eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:54.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7fb6a0ff9700 1 -- 172.21.15.157:0/1493919182 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698004390 con 0x7fb6a415cdb0 2024-04-18T03:37:54.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a40ac9d0 con 0x7fb6a415cdb0 2024-04-18T03:37:54.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a40acf90 con 0x7fb6a415cdb0 2024-04-18T03:37:54.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7fe3837fe700 1 -- 172.21.15.157:0/2735432314 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe394052e30 con 0x7fe39c161bb0 2024-04-18T03:37:54.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7fb6a0ff9700 1 -- 172.21.15.157:0/1493919182 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980036c0 con 0x7fb6a415cdb0 2024-04-18T03:37:54.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45aeadc700 1 -- 172.21.15.157:0/3477040247 shutdown_connections 2024-04-18T03:37:54.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7f45aeadc700 1 -- 172.21.15.157:0/3477040247 wait complete. 2024-04-18T03:37:54.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a404e650 con 0x7fb6a415cdb0 2024-04-18T03:37:54.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.755+0000 7fb6a0ff9700 1 -- 172.21.15.157:0/1493919182 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb698003840 con 0x7fb6a415cdb0 2024-04-18T03:37:54.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7fb6a0ff9700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb690066760 0x7fb690068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7fb6a0ff9700 1 -- 172.21.15.157:0/1493919182 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb6980842a0 con 0x7fb6a415cdb0 2024-04-18T03:37:54.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45aeadc700 1 Processor -- start 2024-04-18T03:37:54.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45aeadc700 1 -- start start 2024-04-18T03:37:54.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7fb6a3fff700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb690066760 0x7fb690068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45aeadc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806a4b0 0x7f45a81fab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45aeadc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45a806c030 0x7f45a80cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45aeadc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45a8143400 0x7f45a8140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45aeadc700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80af7b0 con 0x7f45a8143400 2024-04-18T03:37:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45aeadc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a81fb090 con 0x7f45a806c030 2024-04-18T03:37:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45aeadc700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80ad480 con 0x7f45a806a4b0 2024-04-18T03:37:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45a8143400 0x7f45a8140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45a8143400 0x7f45a8140040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56872/0 (socket says 172.21.15.157:56872) 2024-04-18T03:37:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 -- 172.21.15.157:0/1831195702 learned_addr learned my addr 172.21.15.157:0/1831195702 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7fb6a3fff700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb690066760 0x7fb690068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb69c007fd0 tx=0x7fb69c012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 -- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806a4b0 msgr2=0x7f45a81fab50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:54.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806a4b0 0x7f45a81fab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 -- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45a806c030 msgr2=0x7f45a80cb140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T03:37:54.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45a806c030 0x7f45a80cb140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 -- 172.21.15.157:0/1831195702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4009570 con 0x7f45a8143400 2024-04-18T03:37:54.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.759+0000 7f45ae2db700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45a8143400 0x7f45a8140040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f45a0014040 tx=0x7f45a0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.767+0000 7fb6a0ff9700 1 -- 172.21.15.157:0/1493919182 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb698051330 con 0x7fb6a415cdb0 2024-04-18T03:37:54.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.767+0000 7f459e7fc700 1 -- 172.21.15.157:0/1831195702 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0012430 con 0x7f45a8143400 2024-04-18T03:37:54.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.767+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a0009a70 con 0x7f45a8143400 2024-04-18T03:37:54.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.767+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a80ada00 con 0x7f45a8143400 2024-04-18T03:37:54.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.771+0000 7f459e7fc700 1 -- 172.21.15.157:0/1831195702 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a0020070 con 0x7f45a8143400 2024-04-18T03:37:54.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.771+0000 7f459e7fc700 1 -- 172.21.15.157:0/1831195702 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0004240 con 0x7f45a8143400 2024-04-18T03:37:54.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.771+0000 7f459e7fc700 1 -- 172.21.15.157:0/1831195702 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45a0004460 con 0x7f45a8143400 2024-04-18T03:37:54.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.771+0000 7f459e7fc700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f458c0667b0 0x7f458c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.771+0000 7f459e7fc700 1 -- 172.21.15.157:0/1831195702 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45a0022070 con 0x7f45a8143400 2024-04-18T03:37:54.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.771+0000 7f45adada700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f458c0667b0 0x7f458c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.771+0000 7f45adada700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f458c0667b0 0x7f458c068c70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4598000f60 tx=0x7f4598007a60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.775+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4590005310 con 0x7f45a8143400 2024-04-18T03:37:54.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.783+0000 7f459e7fc700 1 -- 172.21.15.157:0/1831195702 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f45a0053b60 con 0x7f45a8143400 2024-04-18T03:37:54.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.787+0000 7fd3d0970700 1 Processor -- start 2024-04-18T03:37:54.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.787+0000 7fd3d0970700 1 -- start start 2024-04-18T03:37:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6759e700 1 Processor -- start 2024-04-18T03:37:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3d0970700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc159600 0x7fd3cc06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3d0970700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc06d850 con 0x7fd3cc02c8f0 2024-04-18T03:37:54.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3d0970700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc06bb10 con 0x7fd3cc098a50 2024-04-18T03:37:54.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3d0970700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1599e0 con 0x7fd3cc159600 2024-04-18T03:37:54.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3caffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd3cc02c8f0 0x7fd3cc06cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36700/0 (socket says 172.21.15.157:36700) 2024-04-18T03:37:54.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3caffd700 1 -- 172.21.15.157:0/2946034556 learned_addr learned my addr 172.21.15.157:0/2946034556 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:54.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3cb7fe700 1 --2- 172.21.15.157:0/2946034556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc159600 0x7fd3cc06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3ca7fc700 1 -- 172.21.15.157:0/2946034556 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819613821 0 0) 0x7fd3cc06d850 con 0x7fd3cc02c8f0 2024-04-18T03:37:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3ca7fc700 1 -- 172.21.15.157:0/2946034556 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b40035d0 con 0x7fd3cc02c8f0 2024-04-18T03:37:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3cb7fe700 1 -- 172.21.15.157:0/2946034556 >> v1:172.21.15.175:6789/0 conn(0x7fd3cc098a50 legacy=0x7fd3cc0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3cb7fe700 1 -- 172.21.15.157:0/2946034556 >> v1:172.21.15.157:6789/0 conn(0x7fd3cc02c8f0 legacy=0x7fd3cc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3cb7fe700 1 -- 172.21.15.157:0/2946034556 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc06d570 con 0x7fd3cc159600 2024-04-18T03:37:54.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6759e700 1 -- start start 2024-04-18T03:37:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6759e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcd6815cdb0 0x7fcd68142880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6759e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcd680cb730 0x7fcd6815d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 0x7fcd680cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6759e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6815d6d0 con 0x7fcd680cb730 2024-04-18T03:37:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6759e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd680cbef0 con 0x7fcd6815cdb0 2024-04-18T03:37:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680b1cb0 con 0x7fcd680cd6a0 2024-04-18T03:37:54.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3cb7fe700 1 --2- 172.21.15.157:0/2946034556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc159600 0x7fd3cc06c5b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009880 tx=0x7fd3bc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a06d819c68fcfcd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcd6815cdb0 0x7fcd68142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcd6815cdb0 0x7fcd68142880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:59046/0 (socket says 172.21.15.157:59046) 2024-04-18T03:37:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 -- 172.21.15.157:0/3334058485 learned_addr learned my addr 172.21.15.157:0/3334058485 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd66d9d700 1 --2- 172.21.15.157:0/3334058485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 0x7fcd680cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3ca7fc700 1 -- 172.21.15.157:0/2946034556 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc011830 con 0x7fd3cc159600 2024-04-18T03:37:54.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd65d9b700 1 --2- 172.21.15.157:0/3334058485 >> v2:172.21.15.157:3300/0 conn(0x7fcd680cb730 0x7fcd6815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3ca7fc700 1 -- 172.21.15.157:0/2946034556 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc011990 con 0x7fd3cc159600 2024-04-18T03:37:54.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fd3ca7fc700 1 -- 172.21.15.157:0/2946034556 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc011d00 con 0x7fd3cc159600 2024-04-18T03:37:54.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 -- 172.21.15.157:0/3334058485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 msgr2=0x7fcd680cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 --2- 172.21.15.157:0/3334058485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 0x7fcd680cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 -- 172.21.15.157:0/3334058485 >> v2:172.21.15.157:3300/0 conn(0x7fcd680cb730 msgr2=0x7fcd6815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 --2- 172.21.15.157:0/3334058485 >> v2:172.21.15.157:3300/0 conn(0x7fcd680cb730 0x7fcd6815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 -- 172.21.15.157:0/3334058485 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680b1f90 con 0x7fcd6815cdb0 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd65d9b700 1 --2- 172.21.15.157:0/3334058485 >> v2:172.21.15.157:3300/0 conn(0x7fcd680cb730 0x7fcd6815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6659c700 1 --2- 172.21.15.157:0/3334058485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd6815cdb0 0x7fcd68142880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000c110 tx=0x7fcd6000ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10e241a7a90003e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6559a700 1 -- 172.21.15.157:0/3334058485 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000ce40 con 0x7fcd6815cdb0 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6559a700 1 -- 172.21.15.157:0/3334058485 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd60014480 con 0x7fcd6815cdb0 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.791+0000 7fcd6559a700 1 -- 172.21.15.157:0/3334058485 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60014830 con 0x7fcd6815cdb0 2024-04-18T03:37:54.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 -- 172.21.15.157:0/2946034556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc159600 msgr2=0x7fd3cc06c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 --2- 172.21.15.157:0/2946034556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc159600 0x7fd3cc06c5b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009880 tx=0x7fd3bc009b90 comp rx=0 tx=0).stop 2024-04-18T03:37:54.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 -- 172.21.15.157:0/2946034556 shutdown_connections 2024-04-18T03:37:54.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 --2- 172.21.15.157:0/2946034556 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc159600 0x7fd3cc06c5b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 -- 172.21.15.157:0/2946034556 >> 172.21.15.157:0/2946034556 conn(0x7fd3cc0d0390 msgr2=0x7fd3cc0d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:54.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 -- 172.21.15.157:0/3334058485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd6815cdb0 msgr2=0x7fcd68142880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 --2- 172.21.15.157:0/3334058485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd6815cdb0 0x7fcd68142880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000c110 tx=0x7fcd6000ace0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 -- 172.21.15.157:0/2946034556 shutdown_connections 2024-04-18T03:37:54.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 -- 172.21.15.157:0/3334058485 shutdown_connections 2024-04-18T03:37:54.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 --2- 172.21.15.157:0/3334058485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 0x7fcd680cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 --2- 172.21.15.157:0/3334058485 >> v2:172.21.15.157:3300/0 conn(0x7fcd680cb730 0x7fcd6815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 --2- 172.21.15.157:0/3334058485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd6815cdb0 0x7fcd68142880 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 -- 172.21.15.157:0/3334058485 >> 172.21.15.157:0/3334058485 conn(0x7fcd6806e730 msgr2=0x7fcd6806eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:54.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 -- 172.21.15.157:0/3334058485 shutdown_connections 2024-04-18T03:37:54.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 -- 172.21.15.157:0/2946034556 wait complete. 2024-04-18T03:37:54.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 -- 172.21.15.157:0/3334058485 wait complete. 2024-04-18T03:37:54.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 Processor -- start 2024-04-18T03:37:54.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 -- start start 2024-04-18T03:37:54.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 Processor -- start 2024-04-18T03:37:54.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 -- start start 2024-04-18T03:37:54.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fcd6759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd680cb730 0x7fcd680acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.795+0000 7fd3d0970700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3cc02c8f0 0x7fd3cc1515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 0x7fcd681493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6759e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd6815cdb0 0x7fcd680afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3d0970700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc098a50 0x7fd3cc0c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3d0970700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3cc159600 0x7fd3cc0ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd66d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd6815cdb0 0x7fcd680afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6759e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680ad490 con 0x7fcd6815cdb0 2024-04-18T03:37:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6759e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680a88c0 con 0x7fcd680cb730 2024-04-18T03:37:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680a8ba0 con 0x7fcd680cd6a0 2024-04-18T03:37:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd66d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd6815cdb0 0x7fcd680afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56890/0 (socket says 172.21.15.157:56890) 2024-04-18T03:37:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd66d9d700 1 -- 172.21.15.157:0/3095446333 learned_addr learned my addr 172.21.15.157:0/3095446333 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6659c700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd680cb730 0x7fcd680acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3d0970700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0c40b0 con 0x7fd3cc159600 2024-04-18T03:37:54.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3d0970700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0c7240 con 0x7fd3cc02c8f0 2024-04-18T03:37:54.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3d0970700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0c69a0 con 0x7fd3cc098a50 2024-04-18T03:37:54.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3cb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3cc02c8f0 0x7fd3cc1515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc098a50 0x7fd3cc0c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc098a50 0x7fd3cc0c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60884/0 (socket says 172.21.15.157:60884) 2024-04-18T03:37:54.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 -- 172.21.15.157:0/3473051639 learned_addr learned my addr 172.21.15.157:0/3473051639 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd65d9b700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 0x7fcd681493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3d1bd2700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3cc159600 0x7fd3cc0ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6659c700 1 -- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 msgr2=0x7fcd681493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6659c700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 0x7fcd681493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6659c700 1 -- 172.21.15.157:0/3095446333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd6815cdb0 msgr2=0x7fcd680afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6659c700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd6815cdb0 0x7fcd680afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6659c700 1 -- 172.21.15.157:0/3095446333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60007790 con 0x7fcd680cb730 2024-04-18T03:37:54.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd66d9d700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd6815cdb0 0x7fcd680afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:54.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 -- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3cc02c8f0 msgr2=0x7fd3cc1515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3cc02c8f0 0x7fd3cc1515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 -- 172.21.15.157:0/3473051639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3cc159600 msgr2=0x7fd3cc0ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3cc159600 0x7fd3cc0ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 -- 172.21.15.157:0/3473051639 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0094b0 con 0x7fd3cc098a50 2024-04-18T03:37:54.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6659c700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd680cb730 0x7fcd680acf50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd680b4030 tx=0x7fcd60004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3caffd700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc098a50 0x7fd3cc0c6030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c730 tx=0x7fd3c000ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd56ffd700 1 -- 172.21.15.157:0/3095446333 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60007e70 con 0x7fcd680cb730 2024-04-18T03:37:54.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd56ffd700 1 -- 172.21.15.157:0/3095446333 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd600145f0 con 0x7fcd680cb730 2024-04-18T03:37:54.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6759e700 1 -- 172.21.15.157:0/3095446333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd680a8e80 con 0x7fcd680cb730 2024-04-18T03:37:54.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd6759e700 1 -- 172.21.15.157:0/3095446333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd68149910 con 0x7fcd680cb730 2024-04-18T03:37:54.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fcd56ffd700 1 -- 172.21.15.157:0/3095446333 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60014980 con 0x7fcd680cb730 2024-04-18T03:37:54.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7f182c83c700 1 Processor -- start 2024-04-18T03:37:54.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3b3fff700 1 -- 172.21.15.157:0/3473051639 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0005d90 con 0x7fd3cc098a50 2024-04-18T03:37:54.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3b3fff700 1 -- 172.21.15.157:0/3473051639 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c00070d0 con 0x7fd3cc098a50 2024-04-18T03:37:54.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7fd3b3fff700 1 -- 172.21.15.157:0/3473051639 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0007460 con 0x7fd3cc098a50 2024-04-18T03:37:54.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc0c6c80 con 0x7fd3cc098a50 2024-04-18T03:37:54.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc151b10 con 0x7fd3cc098a50 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.799+0000 7f182c83c700 1 -- start start 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f182c83c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f182815cdb0 0x7f1828142880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f182c83c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 0x7f18280b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f182c83c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280cbef0 con 0x7f18280cb730 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f182c83c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280b1cb0 con 0x7f182815cdb0 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f182c83c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280b1f90 con 0x7f18280b2790 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f18277fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f182815cdb0 0x7f1828142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f1826ffd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f18280cb730 0x7f182815d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:56502/0 (socket says 172.21.15.157:56502) 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f1826ffd700 1 -- 172.21.15.157:0/2221894843 learned_addr learned my addr 172.21.15.157:0/2221894843 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:54.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f1827fff700 1 --2- 172.21.15.157:0/2221894843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 0x7f18280b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fcd54ff9700 1 -- 172.21.15.157:0/3095446333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd680a8ce0 con 0x7fcd680cb730 2024-04-18T03:37:54.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7ff29bfff700 1 Processor -- start 2024-04-18T03:37:54.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fcd56ffd700 1 -- 172.21.15.157:0/3095446333 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd6001b070 con 0x7fcd680cb730 2024-04-18T03:37:54.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f18277fe700 1 -- 172.21.15.157:0/2221894843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 msgr2=0x7f18280b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:54.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f18277fe700 1 --2- 172.21.15.157:0/2221894843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 0x7f18280b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f18277fe700 1 -- 172.21.15.157:0/2221894843 >> v1:172.21.15.175:6789/0 conn(0x7f18280cb730 legacy=0x7f182815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f18277fe700 1 -- 172.21.15.157:0/2221894843 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280b2270 con 0x7f182815cdb0 2024-04-18T03:37:54.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fcd56ffd700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd48066780 0x7fcd48068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7f18277fe700 1 --2- 172.21.15.157:0/2221894843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 0x7f1828142880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f182000bfd0 tx=0x7f182000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=653676ab20797e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fcd56ffd700 1 -- 172.21.15.157:0/3095446333 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd60085de0 con 0x7fcd680cb730 2024-04-18T03:37:54.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fcd65d9b700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd48066780 0x7fcd48068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7ff29bfff700 1 -- start start 2024-04-18T03:37:54.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fcd65d9b700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd48066780 0x7fcd48068c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd680cab30 tx=0x7fcd5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fd3b3fff700 1 -- 172.21.15.157:0/3473051639 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3c00075c0 con 0x7fd3cc098a50 2024-04-18T03:37:54.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7fd3b3fff700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3b4066b90 0x7fd3b4069050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.803+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac005310 con 0x7fd3cc098a50 2024-04-18T03:37:54.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29bfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff29c06a4b0 0x7ff29c06baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff29c06c030 0x7ff29c160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29bfff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c06aa50 con 0x7ff29c143400 2024-04-18T03:37:54.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29bfff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c06ad30 con 0x7ff29c06c030 2024-04-18T03:37:54.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29bfff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c06b010 con 0x7ff29c06a4b0 2024-04-18T03:37:54.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29affd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7ff29c143400 0x7ff29c0aba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36702/0 (socket says 172.21.15.157:36702) 2024-04-18T03:37:54.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29affd700 1 -- 172.21.15.157:0/1014978889 learned_addr learned my addr 172.21.15.157:0/1014978889 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:54.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29b7fe700 1 --2- 172.21.15.157:0/1014978889 >> v2:172.21.15.157:3300/0 conn(0x7ff29c06c030 0x7ff29c160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7fd3cb7fe700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3b4066b90 0x7fd3b4069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29a7fc700 1 --2- 172.21.15.157:0/1014978889 >> v2:172.21.15.175:3300/0 conn(0x7ff29c06a4b0 0x7ff29c06baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7fd3b3fff700 1 -- 172.21.15.157:0/3473051639 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3c00837c0 con 0x7fd3cc098a50 2024-04-18T03:37:54.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29b7fe700 1 -- 172.21.15.157:0/1014978889 >> v2:172.21.15.175:3300/0 conn(0x7ff29c06a4b0 msgr2=0x7ff29c06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:54.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29b7fe700 1 --2- 172.21.15.157:0/1014978889 >> v2:172.21.15.175:3300/0 conn(0x7ff29c06a4b0 0x7ff29c06baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29b7fe700 1 -- 172.21.15.157:0/1014978889 >> v1:172.21.15.157:6789/0 conn(0x7ff29c143400 legacy=0x7ff29c0aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29b7fe700 1 -- 172.21.15.157:0/1014978889 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c06b2f0 con 0x7ff29c06c030 2024-04-18T03:37:54.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29b7fe700 1 --2- 172.21.15.157:0/1014978889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c06c030 0x7ff29c160d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff29c071b70 tx=0x7ff28c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e6e44d2592b495 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff299ffb700 1 -- 172.21.15.157:0/1014978889 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c011830 con 0x7ff29c06c030 2024-04-18T03:37:54.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7fd3cb7fe700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3b4066b90 0x7fd3b4069050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0090b0 tx=0x7fd3bc010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff299ffb700 1 -- 172.21.15.157:0/1014978889 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c011990 con 0x7ff29c06c030 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff299ffb700 1 -- 172.21.15.157:0/1014978889 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c011d20 con 0x7ff29c06c030 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29bfff700 1 -- 172.21.15.157:0/1014978889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c06c030 msgr2=0x7ff29c160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.807+0000 7ff29bfff700 1 --2- 172.21.15.157:0/1014978889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c06c030 0x7ff29c160d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff29c071b70 tx=0x7ff28c009b30 comp rx=0 tx=0).stop 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 -- 172.21.15.157:0/1014978889 shutdown_connections 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 --2- 172.21.15.157:0/1014978889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c06c030 0x7ff29c160d50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 --2- 172.21.15.157:0/1014978889 >> v2:172.21.15.175:3300/0 conn(0x7ff29c06a4b0 0x7ff29c06baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 -- 172.21.15.157:0/1014978889 >> 172.21.15.157:0/1014978889 conn(0x7ff29c06e730 msgr2=0x7ff29c06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 -- 172.21.15.157:0/1014978889 shutdown_connections 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 -- 172.21.15.157:0/1014978889 wait complete. 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 Processor -- start 2024-04-18T03:37:54.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 -- start start 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c06a4b0 0x7ff29c0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff29c06c030 0x7ff29c13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c143400 0x7ff29c143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c1f3280 con 0x7ff29c143400 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c1f3560 con 0x7ff29c06a4b0 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29bfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c1f3840 con 0x7ff29c06c030 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c143400 0x7ff29c143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c143400 0x7ff29c143f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56924/0 (socket says 172.21.15.157:56924) 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29b7fe700 1 -- 172.21.15.157:0/2383539418 learned_addr learned my addr 172.21.15.157:0/2383539418 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29a7fc700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff29c06c030 0x7ff29c13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29affd700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c06a4b0 0x7ff29c0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29b7fe700 1 -- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff29c06c030 msgr2=0x7ff29c13dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29b7fe700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff29c06c030 0x7ff29c13dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29b7fe700 1 -- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c06a4b0 msgr2=0x7ff29c0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29b7fe700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c06a4b0 0x7ff29c0cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.811+0000 7ff29b7fe700 1 -- 172.21.15.157:0/2383539418 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0094b0 con 0x7ff29c143400 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff29b7fe700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c143400 0x7ff29c143f30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009b70 tx=0x7ff28c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff28bfff700 1 -- 172.21.15.157:0/2383539418 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c004380 con 0x7ff29c143400 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff28bfff700 1 -- 172.21.15.157:0/2383539418 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c01f070 con 0x7ff29c143400 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c13d400 con 0x7ff29c143400 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c13e140 con 0x7ff29c143400 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff28bfff700 1 -- 172.21.15.157:0/2383539418 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0036c0 con 0x7ff29c143400 2024-04-18T03:37:54.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7fcd56ffd700 1 -- 172.21.15.157:0/3095446333 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcd680a8ce0 con 0x7fcd680cb730 2024-04-18T03:37:54.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff28bfff700 1 -- 172.21.15.157:0/2383539418 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff28c021030 con 0x7ff29c143400 2024-04-18T03:37:54.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7f18267fc700 1 -- 172.21.15.157:0/2221894843 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820010070 con 0x7f182815cdb0 2024-04-18T03:37:54.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7f18267fc700 1 -- 172.21.15.157:0/2221894843 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000b2e0 con 0x7f182815cdb0 2024-04-18T03:37:54.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7f18267fc700 1 -- 172.21.15.157:0/2221894843 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000dce0 con 0x7f182815cdb0 2024-04-18T03:37:54.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7f182c83c700 1 -- 172.21.15.157:0/2221894843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 msgr2=0x7f1828142880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7f182c83c700 1 --2- 172.21.15.157:0/2221894843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 0x7f1828142880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f182000bfd0 tx=0x7f182000d330 comp rx=0 tx=0).stop 2024-04-18T03:37:54.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff28bfff700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff284066870 0x7ff284068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff28bfff700 1 -- 172.21.15.157:0/2383539418 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff28c0858f0 con 0x7ff29c143400 2024-04-18T03:37:54.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.815+0000 7ff29affd700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff284066870 0x7ff284068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.819+0000 7fd3b3fff700 1 -- 172.21.15.157:0/3473051639 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd3c00509b0 con 0x7fd3cc098a50 2024-04-18T03:37:54.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.819+0000 7f182c83c700 1 -- 172.21.15.157:0/2221894843 shutdown_connections 2024-04-18T03:37:54.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.819+0000 7f182c83c700 1 --2- 172.21.15.157:0/2221894843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 0x7f18280b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.819+0000 7f182c83c700 1 --2- 172.21.15.157:0/2221894843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 0x7f1828142880 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.819+0000 7f182c83c700 1 -- 172.21.15.157:0/2221894843 >> 172.21.15.157:0/2221894843 conn(0x7f182806e730 msgr2=0x7f182806eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:54.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.819+0000 7ff29affd700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff284066870 0x7ff284068d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff290005930 tx=0x7ff290009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.823+0000 7f182c83c700 1 -- 172.21.15.157:0/2221894843 shutdown_connections 2024-04-18T03:37:54.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff278005310 con 0x7ff29c143400 2024-04-18T03:37:54.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 -- 172.21.15.157:0/2221894843 wait complete. 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 Processor -- start 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 -- start start 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 0x7f18281e81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18280cb730 0x7f18280a7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 0x7f182815b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815b2c0 con 0x7f18280cb730 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18281ff450 con 0x7f182815cdb0 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f182c83c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182815a6b0 con 0x7f18280b2790 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1826ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18280cb730 0x7f18280a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1826ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18280cb730 0x7f18280a7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56926/0 (socket says 172.21.15.157:56926) 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1826ffd700 1 -- 172.21.15.157:0/322172497 learned_addr learned my addr 172.21.15.157:0/322172497 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f18277fe700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 0x7f18281e81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1827fff700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 0x7f182815b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1826ffd700 1 -- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 msgr2=0x7f18281e81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1826ffd700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 0x7f18281e81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1826ffd700 1 -- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 msgr2=0x7f182815b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:54.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1826ffd700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 0x7f182815b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:54.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.827+0000 7f1826ffd700 1 -- 172.21.15.157:0/322172497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182000bc80 con 0x7f18280cb730 2024-04-18T03:37:54.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.831+0000 7f1826ffd700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18280cb730 0x7f18280a7520 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f181800c8d0 tx=0x7f181800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:54.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.835+0000 7f180ffff700 1 -- 172.21.15.157:0/322172497 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800ce70 con 0x7f18280cb730 2024-04-18T03:37:54.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.835+0000 7ff28bfff700 1 -- 172.21.15.157:0/2383539418 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff28c052b20 con 0x7ff29c143400 2024-04-18T03:37:54.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.835+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182815a990 con 0x7f18280cb730 2024-04-18T03:37:54.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.835+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182815af50 con 0x7f18280cb730 2024-04-18T03:37:54.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.835+0000 7f180ffff700 1 -- 172.21.15.157:0/322172497 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1818008040 con 0x7f18280cb730 2024-04-18T03:37:54.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.835+0000 7f180ffff700 1 -- 172.21.15.157:0/322172497 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818007a80 con 0x7f18280cb730 2024-04-18T03:37:54.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.835+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1808005310 con 0x7f18280cb730 2024-04-18T03:37:54.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.843+0000 7f180ffff700 1 -- 172.21.15.157:0/322172497 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1818007be0 con 0x7f18280cb730 2024-04-18T03:37:54.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.847+0000 7f180ffff700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1814066730 0x7f1814068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:54.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.847+0000 7f180ffff700 1 -- 172.21.15.157:0/322172497 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1818084610 con 0x7f18280cb730 2024-04-18T03:37:54.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.847+0000 7f180ffff700 1 -- 172.21.15.157:0/322172497 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1818086b80 con 0x7f18280cb730 2024-04-18T03:37:54.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.847+0000 7f18277fe700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1814066730 0x7f1814068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:54.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:54.847+0000 7f18277fe700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1814066730 0x7f1814068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f182000d370 tx=0x7f182000b000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.035+0000 7fc04485a700 1 -- 172.21.15.157:0/4009107979 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc04004e650 con 0x7fc0400b2790 2024-04-18T03:37:55.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.035+0000 7fc02effd700 1 -- 172.21.15.157:0/4009107979 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc03805b020 con 0x7fc0400b2790 2024-04-18T03:37:55.039 INFO:teuthology.orchestra.run.smithi157.stdout:64424509448 2024-04-18T03:37:55.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.043+0000 7fc02cff9700 1 -- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc020066780 msgr2=0x7fc020068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc020066780 0x7fc020068c40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc0400cc720 tx=0x7fc034008000 comp rx=0 tx=0).stop 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 -- 172.21.15.157:0/4009107979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0400b2790 msgr2=0x7fc0400acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0400b2790 0x7fc0400acfc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc038001fa0 tx=0x7fc038002080 comp rx=0 tx=0).stop 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 -- 172.21.15.157:0/4009107979 shutdown_connections 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc020066780 0x7fc020068c40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc04015cdb0 0x7fc04014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc040142880 0x7fc04016a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 --2- 172.21.15.157:0/4009107979 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc0400b2790 0x7fc0400acfc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 -- 172.21.15.157:0/4009107979 >> 172.21.15.157:0/4009107979 conn(0x7fc04006e730 msgr2=0x7fc04006eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 -- 172.21.15.157:0/4009107979 shutdown_connections 2024-04-18T03:37:55.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.047+0000 7fc02cff9700 1 -- 172.21.15.157:0/4009107979 wait complete. 2024-04-18T03:37:55.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.059+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6a40ad440 con 0x7fb6a415cdb0 2024-04-18T03:37:55.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.059+0000 7fb6a0ff9700 1 -- 172.21.15.157:0/1493919182 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb698054950 con 0x7fb6a415cdb0 2024-04-18T03:37:55.062 INFO:teuthology.orchestra.run.smithi157.stdout:60129542153 2024-04-18T03:37:55.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-04-18T03:37:55.064 DEBUG:teuthology.parallel:result is None 2024-04-18T03:37:55.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb690066760 msgr2=0x7fb690068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb690066760 0x7fb690068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb69c007fd0 tx=0x7fb69c012000 comp rx=0 tx=0).stop 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6a415cdb0 msgr2=0x7fb6a4158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6a415cdb0 0x7fb6a4158b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c7f0 tx=0x7fb69800cb00 comp rx=0 tx=0).stop 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 shutdown_connections 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb690066760 0x7fb690068c20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6a40cb730 0x7fb6a41585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6a415cdb0 0x7fb6a4158b30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 --2- 172.21.15.157:0/1493919182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6a40b2790 0x7fb6a4157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 >> 172.21.15.157:0/1493919182 conn(0x7fb6a406e730 msgr2=0x7fb6a40aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 shutdown_connections 2024-04-18T03:37:55.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fb6aa6bc700 1 -- 172.21.15.157:0/1493919182 wait complete. 2024-04-18T03:37:55.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.063+0000 7fe3817fa700 1 -- 172.21.15.157:0/2735432314 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe3740055c0 con 0x7fe39c161bb0 2024-04-18T03:37:55.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.067+0000 7fe3837fe700 1 -- 172.21.15.157:0/2735432314 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe394056450 con 0x7fe39c161bb0 2024-04-18T03:37:55.069 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:55.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 -- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe388066800 msgr2=0x7fe388068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe388066800 0x7fe388068cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0b0340 tx=0x7fe38c009040 comp rx=0 tx=0).stop 2024-04-18T03:37:55.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 -- 172.21.15.157:0/2735432314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe39c161bb0 msgr2=0x7fe39c161160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe39c161bb0 0x7fe39c161160 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe394015000 tx=0x7fe394004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 -- 172.21.15.157:0/2735432314 shutdown_connections 2024-04-18T03:37:55.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe388066800 0x7fe388068cc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe39c162010 0x7fe39c145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe39c148900 0x7fe39c148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 --2- 172.21.15.157:0/2735432314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe39c161bb0 0x7fe39c161160 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 -- 172.21.15.157:0/2735432314 >> 172.21.15.157:0/2735432314 conn(0x7fe39c0b12d0 msgr2=0x7fe39c070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 -- 172.21.15.157:0/2735432314 shutdown_connections 2024-04-18T03:37:55.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.071+0000 7fe3817fa700 1 -- 172.21.15.157:0/2735432314 wait complete. 2024-04-18T03:37:55.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.1 2024-04-18T03:37:55.080 DEBUG:teuthology.parallel:result is None 2024-04-18T03:37:55.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2024-04-18T03:37:55.088 DEBUG:teuthology.parallel:result is None 2024-04-18T03:37:55.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.091+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f45900055c0 con 0x7f45a8143400 2024-04-18T03:37:55.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.091+0000 7f459e7fc700 1 -- 172.21.15.157:0/1831195702 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45a0057180 con 0x7f45a8143400 2024-04-18T03:37:55.095 INFO:teuthology.orchestra.run.smithi157.stdout:64424509447 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f458c0667b0 msgr2=0x7f458c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f458c0667b0 0x7f458c068c70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4598000f60 tx=0x7f4598007a60 comp rx=0 tx=0).stop 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45a8143400 msgr2=0x7f45a8140040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45a8143400 0x7f45a8140040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f45a0014040 tx=0x7f45a0004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 shutdown_connections 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f458c0667b0 0x7f458c068c70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45a806c030 0x7f45a80cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f45a8143400 0x7f45a8140040 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 --2- 172.21.15.157:0/1831195702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45a806a4b0 0x7f45a81fab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 >> 172.21.15.157:0/1831195702 conn(0x7f45a806e730 msgr2=0x7f45a8145430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 shutdown_connections 2024-04-18T03:37:55.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.095+0000 7f45aeadc700 1 -- 172.21.15.157:0/1831195702 wait complete. 2024-04-18T03:37:55.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 -- 172.21.15.157:0/3095446333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd680a8ce0 con 0x7fcd680cb730 2024-04-18T03:37:55.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd56ffd700 1 -- 172.21.15.157:0/3095446333 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd60019020 con 0x7fcd680cb730 2024-04-18T03:37:55.105 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:55.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 -- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd48066780 msgr2=0x7fcd48068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd48066780 0x7fcd48068c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd680cab30 tx=0x7fcd5c008040 comp rx=0 tx=0).stop 2024-04-18T03:37:55.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 -- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd680cb730 msgr2=0x7fcd680acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd680cb730 0x7fcd680acf50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd680b4030 tx=0x7fcd60004af0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 -- 172.21.15.157:0/3095446333 shutdown_connections 2024-04-18T03:37:55.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcd48066780 0x7fcd48068c40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd6815cdb0 0x7fcd680afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd680cd6a0 0x7fcd681493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 --2- 172.21.15.157:0/3095446333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd680cb730 0x7fcd680acf50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 -- 172.21.15.157:0/3095446333 >> 172.21.15.157:0/3095446333 conn(0x7fcd6806e730 msgr2=0x7fcd6806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 -- 172.21.15.157:0/3095446333 shutdown_connections 2024-04-18T03:37:55.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.103+0000 7fcd54ff9700 1 -- 172.21.15.157:0/3095446333 wait complete. 2024-04-18T03:37:55.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-04-18T03:37:55.113 DEBUG:teuthology.parallel:result is None 2024-04-18T03:37:55.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.111+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff278005890 con 0x7ff29c143400 2024-04-18T03:37:55.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.111+0000 7ff28bfff700 1 -- 172.21.15.157:0/2383539418 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff28c015020 con 0x7ff29c143400 2024-04-18T03:37:55.114 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:55.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.111+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff284066870 msgr2=0x7ff284068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.111+0000 7ff29bfff700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff284066870 0x7ff284068d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff290005930 tx=0x7ff290009040 comp rx=0 tx=0).stop 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.111+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c143400 msgr2=0x7ff29c143f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.111+0000 7ff29bfff700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c143400 0x7ff29c143f30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009b70 tx=0x7ff28c004770 comp rx=0 tx=0).stop 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.115+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 shutdown_connections 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.115+0000 7ff29bfff700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff284066870 0x7ff284068d30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.115+0000 7ff29bfff700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff29c143400 0x7ff29c143f30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.115+0000 7ff29bfff700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff29c06c030 0x7ff29c13dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.115+0000 7ff29bfff700 1 --2- 172.21.15.157:0/2383539418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff29c06a4b0 0x7ff29c0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.115+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 >> 172.21.15.157:0/2383539418 conn(0x7ff29c06e730 msgr2=0x7ff29c0b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.115+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 shutdown_connections 2024-04-18T03:37:55.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.115+0000 7ff29bfff700 1 -- 172.21.15.157:0/2383539418 wait complete. 2024-04-18T03:37:55.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.2 2024-04-18T03:37:55.118 DEBUG:teuthology.parallel:result is None 2024-04-18T03:37:55.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3ac005890 con 0x7fd3cc098a50 2024-04-18T03:37:55.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3b3fff700 1 -- 172.21.15.157:0/3473051639 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3c0053fd0 con 0x7fd3cc098a50 2024-04-18T03:37:55.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f18080055c0 con 0x7f18280cb730 2024-04-18T03:37:55.126 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:55.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f180ffff700 1 -- 172.21.15.157:0/322172497 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f181801e090 con 0x7f18280cb730 2024-04-18T03:37:55.126 INFO:teuthology.orchestra.run.smithi157.stdout:60129542152 2024-04-18T03:37:55.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2024-04-18T03:37:55.127 DEBUG:teuthology.parallel:result is None 2024-04-18T03:37:55.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3b4066b90 msgr2=0x7fd3b4069050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3b4066b90 0x7fd3b4069050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0090b0 tx=0x7fd3bc010000 comp rx=0 tx=0).stop 2024-04-18T03:37:55.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc098a50 msgr2=0x7fd3cc0c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc098a50 0x7fd3cc0c6030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c730 tx=0x7fd3c000ca40 comp rx=0 tx=0).stop 2024-04-18T03:37:55.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 shutdown_connections 2024-04-18T03:37:55.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3b4066b90 0x7fd3b4069050 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3cc159600 0x7fd3cc0ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3cc098a50 0x7fd3cc0c6030 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 --2- 172.21.15.157:0/3473051639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3cc02c8f0 0x7fd3cc1515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 >> 172.21.15.157:0/3473051639 conn(0x7fd3cc0d0390 msgr2=0x7fd3cc0afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 shutdown_connections 2024-04-18T03:37:55.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7fd3d0970700 1 -- 172.21.15.157:0/3473051639 wait complete. 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1814066730 msgr2=0x7f1814068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1814066730 0x7f1814068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f182000d370 tx=0x7f182000b000 comp rx=0 tx=0).stop 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18280cb730 msgr2=0x7f18280a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18280cb730 0x7f18280a7520 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f181800c8d0 tx=0x7f181800cc90 comp rx=0 tx=0).stop 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 shutdown_connections 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1814066730 0x7f1814068bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f182815cdb0 0x7f182815b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18280cb730 0x7f18280a7520 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 --2- 172.21.15.157:0/322172497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18280b2790 0x7f18281e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 >> 172.21.15.157:0/322172497 conn(0x7f182806e730 msgr2=0x7f18281547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 shutdown_connections 2024-04-18T03:37:55.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.123+0000 7f182c83c700 1 -- 172.21.15.157:0/322172497 wait complete. 2024-04-18T03:37:55.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-04-18T03:37:55.139 DEBUG:teuthology.parallel:result is None 2024-04-18T03:37:55.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.3 2024-04-18T03:37:55.139 DEBUG:teuthology.parallel:result is None 2024-04-18T03:37:55.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T03:37:55.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:37:55.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 Processor -- start 2024-04-18T03:37:55.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- start start 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe19c06c280 0x7fe19c13f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe19c0cd640 0x7fe19c0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19c0cdf90 con 0x7fe19c159630 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c15a6d0 con 0x7fe19c0cd640 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c159e30 con 0x7fe19c06c280 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19affd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe19c159630 0x7fe19c15d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36708/0 (socket says 172.21.15.157:36708) 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19affd700 1 -- 172.21.15.157:0/844043894 learned_addr learned my addr 172.21.15.157:0/844043894 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19bfff700 1 --2- 172.21.15.157:0/844043894 >> v2:172.21.15.157:3300/0 conn(0x7fe19c0cd640 0x7fe19c0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19b7fe700 1 --2- 172.21.15.157:0/844043894 >> v2:172.21.15.175:3300/0 conn(0x7fe19c06c280 0x7fe19c13f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19a7fc700 1 -- 172.21.15.157:0/844043894 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913549595 0 0) 0x7fe19c0cdf90 con 0x7fe19c159630 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19a7fc700 1 -- 172.21.15.157:0/844043894 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1880035d0 con 0x7fe19c159630 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19a7fc700 1 -- 172.21.15.157:0/844043894 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1388989852 0 0) 0x7fe1880035d0 con 0x7fe19c159630 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19bfff700 1 -- 172.21.15.157:0/844043894 >> v2:172.21.15.175:3300/0 conn(0x7fe19c06c280 msgr2=0x7fe19c13f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19bfff700 1 --2- 172.21.15.157:0/844043894 >> v2:172.21.15.175:3300/0 conn(0x7fe19c06c280 0x7fe19c13f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19bfff700 1 -- 172.21.15.157:0/844043894 >> v1:172.21.15.157:6789/0 conn(0x7fe19c159630 legacy=0x7fe19c15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19bfff700 1 -- 172.21.15.157:0/844043894 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c15a110 con 0x7fe19c0cd640 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19bfff700 1 --2- 172.21.15.157:0/844043894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c0cda50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0713f0 tx=0x7fe194009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5455bcc2c061b679 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19a7fc700 1 -- 172.21.15.157:0/844043894 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184001670 con 0x7fe19c0cd640 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19a7fc700 1 -- 172.21.15.157:0/844043894 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194004030 con 0x7fe19c0cd640 2024-04-18T03:37:55.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe19a7fc700 1 -- 172.21.15.157:0/844043894 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1940043c0 con 0x7fe19c0cd640 2024-04-18T03:37:55.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- 172.21.15.157:0/844043894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 msgr2=0x7fe19c0cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/844043894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c0cda50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0713f0 tx=0x7fe194009b30 comp rx=0 tx=0).stop 2024-04-18T03:37:55.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- 172.21.15.157:0/844043894 shutdown_connections 2024-04-18T03:37:55.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/844043894 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c0cda50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/844043894 >> v2:172.21.15.175:3300/0 conn(0x7fe19c06c280 0x7fe19c13f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- 172.21.15.157:0/844043894 >> 172.21.15.157:0/844043894 conn(0x7fe19c0b1170 msgr2=0x7fe19c06e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- 172.21.15.157:0/844043894 shutdown_connections 2024-04-18T03:37:55.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.287+0000 7fe1a1e21700 1 -- 172.21.15.157:0/844043894 wait complete. 2024-04-18T03:37:55.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 Processor -- start 2024-04-18T03:37:55.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 -- start start 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe19c06c280 0x7fe19c070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe19c159630 0x7fe19c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c13da10 con 0x7fe19c0cd640 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c156860 con 0x7fe19c06c280 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c155c50 con 0x7fe19c159630 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56950/0 (socket says 172.21.15.157:56950) 2024-04-18T03:37:55.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 -- 172.21.15.157:0/1673196233 learned_addr learned my addr 172.21.15.157:0/1673196233 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19b7fe700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe19c06c280 0x7fe19c070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19bfff700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe19c159630 0x7fe19c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 -- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe19c159630 msgr2=0x7fe19c1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe19c159630 0x7fe19c1586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 -- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe19c06c280 msgr2=0x7fe19c070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe19c06c280 0x7fe19c070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 -- 172.21.15.157:0/1673196233 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940094b0 con 0x7fe19c0cd640 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe19affd700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c158190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c520 tx=0x7fe18400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe193fff700 1 -- 172.21.15.157:0/1673196233 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184004ca0 con 0x7fe19c0cd640 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe193fff700 1 -- 172.21.15.157:0/1673196233 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184004e20 con 0x7fe19c0cd640 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19c155f30 con 0x7fe19c0cd640 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe193fff700 1 -- 172.21.15.157:0/1673196233 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184007310 con 0x7fe19c0cd640 2024-04-18T03:37:55.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.291+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c1564f0 con 0x7fe19c0cd640 2024-04-18T03:37:55.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.295+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c1569d0 con 0x7fe19c0cd640 2024-04-18T03:37:55.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.295+0000 7fe193fff700 1 -- 172.21.15.157:0/1673196233 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe184007470 con 0x7fe19c0cd640 2024-04-18T03:37:55.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.295+0000 7fe193fff700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe17c066760 0x7fe17c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.295+0000 7fe193fff700 1 -- 172.21.15.157:0/1673196233 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe184084230 con 0x7fe19c0cd640 2024-04-18T03:37:55.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.295+0000 7fe19b7fe700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe17c066760 0x7fe17c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.295+0000 7fe19b7fe700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe17c066760 0x7fe17c068c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0074a0 tx=0x7fe18c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.307+0000 7fe193fff700 1 -- 172.21.15.157:0/1673196233 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe184051220 con 0x7fe19c0cd640 2024-04-18T03:37:55.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.459+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe19c159ae0 con 0x7fe17c066760 2024-04-18T03:37:55.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.479+0000 7fe193fff700 1 -- 172.21.15.157:0/1673196233 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345246 (secure 0 0 0) 0x7fe18c00f050 con 0x7fe17c066760 2024-04-18T03:37:55.486 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe17c066760 msgr2=0x7fe17c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe17c066760 0x7fe17c068c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0074a0 tx=0x7fe18c00b040 comp rx=0 tx=0).stop 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 msgr2=0x7fe19c158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c158190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c520 tx=0x7fe18400c8e0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 shutdown_connections 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe17c066760 0x7fe17c068c20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe19c159630 0x7fe19c1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe19c0cd640 0x7fe19c158190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 --2- 172.21.15.157:0/1673196233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe19c06c280 0x7fe19c070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 >> 172.21.15.157:0/1673196233 conn(0x7fe19c0b1170 msgr2=0x7fe19c072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 shutdown_connections 2024-04-18T03:37:55.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.483+0000 7fe1a1e21700 1 -- 172.21.15.157:0/1673196233 wait complete. 2024-04-18T03:37:55.490 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:37:55.501 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-18T03:37:53.770458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235812,"kb_used_data":3232,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738908,"statfs":{"total":773094113280,"available":772852641792,"internally_reserved":0,"allocated":3309568,"data_stored":2005987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005045"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321795+0000","last_change":"2024-04-18T03:37:33.922528+0000","last_active":"2024-04-18T03:37:38.321795+0000","last_peered":"2024-04-18T03:37:38.321795+0000","last_clean":"2024-04-18T03:37:38.321795+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:37:38.321795+0000","last_undegraded":"2024-04-18T03:37:38.321795+0000","last_fullsized":"2024-04-18T03:37:38.321795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:05:10.328715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314103+0000","last_change":"2024-04-18T03:37:34.316836+0000","last_active":"2024-04-18T03:37:38.314103+0000","last_peered":"2024-04-18T03:37:38.314103+0000","last_clean":"2024-04-18T03:37:38.314103+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:37:38.314103+0000","last_undegraded":"2024-04-18T03:37:38.314103+0000","last_fullsized":"2024-04-18T03:37:38.314103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.561206+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:37:38.561206+0000","last_peered":"2024-04-18T03:37:38.561206+0000","last_clean":"2024-04-18T03:37:38.561206+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:37:38.561206+0000","last_undegraded":"2024-04-18T03:37:38.561206+0000","last_fullsized":"2024-04-18T03:37:38.561206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:51:07.334398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314521+0000","last_change":"2024-04-18T03:37:33.925462+0000","last_active":"2024-04-18T03:37:38.314521+0000","last_peered":"2024-04-18T03:37:38.314521+0000","last_clean":"2024-04-18T03:37:38.314521+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:37:38.314521+0000","last_undegraded":"2024-04-18T03:37:38.314521+0000","last_fullsized":"2024-04-18T03:37:38.314521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:23.795590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321515+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:37:38.321515+0000","last_peered":"2024-04-18T03:37:38.321515+0000","last_clean":"2024-04-18T03:37:38.321515+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:37:38.321515+0000","last_undegraded":"2024-04-18T03:37:38.321515+0000","last_fullsized":"2024-04-18T03:37:38.321515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694983+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:37:38.694983+0000","last_peered":"2024-04-18T03:37:38.694983+0000","last_clean":"2024-04-18T03:37:38.694983+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:37:38.694983+0000","last_undegraded":"2024-04-18T03:37:38.694983+0000","last_fullsized":"2024-04-18T03:37:38.694983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548268+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:37:38.548268+0000","last_peered":"2024-04-18T03:37:38.548268+0000","last_clean":"2024-04-18T03:37:38.548268+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:37:38.548268+0000","last_undegraded":"2024-04-18T03:37:38.548268+0000","last_fullsized":"2024-04-18T03:37:38.548268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317644+0000","last_change":"2024-04-18T03:37:34.306151+0000","last_active":"2024-04-18T03:37:38.317644+0000","last_peered":"2024-04-18T03:37:38.317644+0000","last_clean":"2024-04-18T03:37:38.317644+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:37:38.317644+0000","last_undegraded":"2024-04-18T03:37:38.317644+0000","last_fullsized":"2024-04-18T03:37:38.317644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695123+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:37:38.695123+0000","last_peered":"2024-04-18T03:37:38.695123+0000","last_clean":"2024-04-18T03:37:38.695123+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:37:38.695123+0000","last_undegraded":"2024-04-18T03:37:38.695123+0000","last_fullsized":"2024-04-18T03:37:38.695123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550252+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:37:38.550252+0000","last_peered":"2024-04-18T03:37:38.550252+0000","last_clean":"2024-04-18T03:37:38.550252+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:37:38.550252+0000","last_undegraded":"2024-04-18T03:37:38.550252+0000","last_fullsized":"2024-04-18T03:37:38.550252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:12.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317258+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:37:38.317258+0000","last_peered":"2024-04-18T03:37:38.317258+0000","last_clean":"2024-04-18T03:37:38.317258+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:37:38.317258+0000","last_undegraded":"2024-04-18T03:37:38.317258+0000","last_fullsized":"2024-04-18T03:37:38.317258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695246+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:37:38.695246+0000","last_peered":"2024-04-18T03:37:38.695246+0000","last_clean":"2024-04-18T03:37:38.695246+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:37:38.695246+0000","last_undegraded":"2024-04-18T03:37:38.695246+0000","last_fullsized":"2024-04-18T03:37:38.695246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:29:44.713922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785151+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:37:38.785151+0000","last_peered":"2024-04-18T03:37:38.785151+0000","last_clean":"2024-04-18T03:37:38.785151+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:37:38.785151+0000","last_undegraded":"2024-04-18T03:37:38.785151+0000","last_fullsized":"2024-04-18T03:37:38.785151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547248+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:37:38.547248+0000","last_peered":"2024-04-18T03:37:38.547248+0000","last_clean":"2024-04-18T03:37:38.547248+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:37:38.547248+0000","last_undegraded":"2024-04-18T03:37:38.547248+0000","last_fullsized":"2024-04-18T03:37:38.547248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:08.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696507+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:37:38.696507+0000","last_peered":"2024-04-18T03:37:38.696507+0000","last_clean":"2024-04-18T03:37:38.696507+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:37:38.696507+0000","last_undegraded":"2024-04-18T03:37:38.696507+0000","last_fullsized":"2024-04-18T03:37:38.696507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:09:17.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311083+0000","last_change":"2024-04-18T03:37:34.308785+0000","last_active":"2024-04-18T03:37:38.311083+0000","last_peered":"2024-04-18T03:37:38.311083+0000","last_clean":"2024-04-18T03:37:38.311083+0000","last_became_active":"2024-04-18T03:37:34.308536+0000","last_became_peered":"2024-04-18T03:37:34.308536+0000","last_unstale":"2024-04-18T03:37:38.311083+0000","last_undegraded":"2024-04-18T03:37:38.311083+0000","last_fullsized":"2024-04-18T03:37:38.311083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331345+0000","last_change":"2024-04-18T03:37:33.928257+0000","last_active":"2024-04-18T03:37:38.331345+0000","last_peered":"2024-04-18T03:37:38.331345+0000","last_clean":"2024-04-18T03:37:38.331345+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:37:38.331345+0000","last_undegraded":"2024-04-18T03:37:38.331345+0000","last_fullsized":"2024-04-18T03:37:38.331345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696116+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:37:38.696116+0000","last_peered":"2024-04-18T03:37:38.696116+0000","last_clean":"2024-04-18T03:37:38.696116+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:37:38.696116+0000","last_undegraded":"2024-04-18T03:37:38.696116+0000","last_fullsized":"2024-04-18T03:37:38.696116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310799+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:37:38.310799+0000","last_peered":"2024-04-18T03:37:38.310799+0000","last_clean":"2024-04-18T03:37:38.310799+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:37:38.310799+0000","last_undegraded":"2024-04-18T03:37:38.310799+0000","last_fullsized":"2024-04-18T03:37:38.310799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:15:10.489560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331472+0000","last_change":"2024-04-18T03:37:33.921368+0000","last_active":"2024-04-18T03:37:38.331472+0000","last_peered":"2024-04-18T03:37:38.331472+0000","last_clean":"2024-04-18T03:37:38.331472+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:37:38.331472+0000","last_undegraded":"2024-04-18T03:37:38.331472+0000","last_fullsized":"2024-04-18T03:37:38.331472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.557731+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:37:38.557731+0000","last_peered":"2024-04-18T03:37:38.557731+0000","last_clean":"2024-04-18T03:37:38.557731+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:37:38.557731+0000","last_undegraded":"2024-04-18T03:37:38.557731+0000","last_fullsized":"2024-04-18T03:37:38.557731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:26.586052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695700+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:37:38.695700+0000","last_peered":"2024-04-18T03:37:38.695700+0000","last_clean":"2024-04-18T03:37:38.695700+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:37:38.695700+0000","last_undegraded":"2024-04-18T03:37:38.695700+0000","last_fullsized":"2024-04-18T03:37:38.695700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:55.630435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546525+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:37:38.546525+0000","last_peered":"2024-04-18T03:37:38.546525+0000","last_clean":"2024-04-18T03:37:38.546525+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:37:38.546525+0000","last_undegraded":"2024-04-18T03:37:38.546525+0000","last_fullsized":"2024-04-18T03:37:38.546525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:07:09.652439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696398+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:37:38.696398+0000","last_peered":"2024-04-18T03:37:38.696398+0000","last_clean":"2024-04-18T03:37:38.696398+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:37:38.696398+0000","last_undegraded":"2024-04-18T03:37:38.696398+0000","last_fullsized":"2024-04-18T03:37:38.696398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.322177+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:37:38.322177+0000","last_peered":"2024-04-18T03:37:38.322177+0000","last_clean":"2024-04-18T03:37:38.322177+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:37:38.322177+0000","last_undegraded":"2024-04-18T03:37:38.322177+0000","last_fullsized":"2024-04-18T03:37:38.322177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320990+0000","last_change":"2024-04-18T03:37:33.929905+0000","last_active":"2024-04-18T03:37:38.320990+0000","last_peered":"2024-04-18T03:37:38.320990+0000","last_clean":"2024-04-18T03:37:38.320990+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:37:38.320990+0000","last_undegraded":"2024-04-18T03:37:38.320990+0000","last_fullsized":"2024-04-18T03:37:38.320990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694891+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:37:38.694891+0000","last_peered":"2024-04-18T03:37:38.694891+0000","last_clean":"2024-04-18T03:37:38.694891+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:37:38.694891+0000","last_undegraded":"2024-04-18T03:37:38.694891+0000","last_fullsized":"2024-04-18T03:37:38.694891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314450+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:37:38.314450+0000","last_peered":"2024-04-18T03:37:38.314450+0000","last_clean":"2024-04-18T03:37:38.314450+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:37:38.314450+0000","last_undegraded":"2024-04-18T03:37:38.314450+0000","last_fullsized":"2024-04-18T03:37:38.314450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:16.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335509+0000","last_change":"2024-04-18T03:37:33.932828+0000","last_active":"2024-04-18T03:37:38.335509+0000","last_peered":"2024-04-18T03:37:38.335509+0000","last_clean":"2024-04-18T03:37:38.335509+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:37:38.335509+0000","last_undegraded":"2024-04-18T03:37:38.335509+0000","last_fullsized":"2024-04-18T03:37:38.335509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:54.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.556815+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:37:38.556815+0000","last_peered":"2024-04-18T03:37:38.556815+0000","last_clean":"2024-04-18T03:37:38.556815+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:37:38.556815+0000","last_undegraded":"2024-04-18T03:37:38.556815+0000","last_fullsized":"2024-04-18T03:37:38.556815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:45.707050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331249+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:37:38.331249+0000","last_peered":"2024-04-18T03:37:38.331249+0000","last_clean":"2024-04-18T03:37:38.331249+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:37:38.331249+0000","last_undegraded":"2024-04-18T03:37:38.331249+0000","last_fullsized":"2024-04-18T03:37:38.331249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548397+0000","last_change":"2024-04-18T03:37:33.924320+0000","last_active":"2024-04-18T03:37:38.548397+0000","last_peered":"2024-04-18T03:37:38.548397+0000","last_clean":"2024-04-18T03:37:38.548397+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:37:38.548397+0000","last_undegraded":"2024-04-18T03:37:38.548397+0000","last_fullsized":"2024-04-18T03:37:38.548397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.552431+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:37:38.552431+0000","last_peered":"2024-04-18T03:37:38.552431+0000","last_clean":"2024-04-18T03:37:38.552431+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:37:38.552431+0000","last_undegraded":"2024-04-18T03:37:38.552431+0000","last_fullsized":"2024-04-18T03:37:38.552431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317341+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:37:38.317341+0000","last_peered":"2024-04-18T03:37:38.317341+0000","last_clean":"2024-04-18T03:37:38.317341+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:37:38.317341+0000","last_undegraded":"2024-04-18T03:37:38.317341+0000","last_fullsized":"2024-04-18T03:37:38.317341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331339+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:37:38.331339+0000","last_peered":"2024-04-18T03:37:38.331339+0000","last_clean":"2024-04-18T03:37:38.331339+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:37:38.331339+0000","last_undegraded":"2024-04-18T03:37:38.331339+0000","last_fullsized":"2024-04-18T03:37:38.331339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:09.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.342038+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:37:38.342038+0000","last_peered":"2024-04-18T03:37:38.342038+0000","last_clean":"2024-04-18T03:37:38.342038+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:37:38.342038+0000","last_undegraded":"2024-04-18T03:37:38.342038+0000","last_fullsized":"2024-04-18T03:37:38.342038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695911+0000","last_change":"2024-04-18T03:37:34.308669+0000","last_active":"2024-04-18T03:37:38.695911+0000","last_peered":"2024-04-18T03:37:38.695911+0000","last_clean":"2024-04-18T03:37:38.695911+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:37:38.695911+0000","last_undegraded":"2024-04-18T03:37:38.695911+0000","last_fullsized":"2024-04-18T03:37:38.695911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:07.525115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317671+0000","last_change":"2024-04-18T03:37:33.921017+0000","last_active":"2024-04-18T03:37:38.317671+0000","last_peered":"2024-04-18T03:37:38.317671+0000","last_clean":"2024-04-18T03:37:38.317671+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:37:38.317671+0000","last_undegraded":"2024-04-18T03:37:38.317671+0000","last_fullsized":"2024-04-18T03:37:38.317671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341916+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:37:38.341916+0000","last_peered":"2024-04-18T03:37:38.341916+0000","last_clean":"2024-04-18T03:37:38.341916+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:37:38.341916+0000","last_undegraded":"2024-04-18T03:37:38.341916+0000","last_fullsized":"2024-04-18T03:37:38.341916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.330075+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:37:38.330075+0000","last_peered":"2024-04-18T03:37:38.330075+0000","last_clean":"2024-04-18T03:37:38.330075+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:37:38.330075+0000","last_undegraded":"2024-04-18T03:37:38.330075+0000","last_fullsized":"2024-04-18T03:37:38.330075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.318063+0000","last_change":"2024-04-18T03:37:33.916761+0000","last_active":"2024-04-18T03:37:38.318063+0000","last_peered":"2024-04-18T03:37:38.318063+0000","last_clean":"2024-04-18T03:37:38.318063+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:37:38.318063+0000","last_undegraded":"2024-04-18T03:37:38.318063+0000","last_fullsized":"2024-04-18T03:37:38.318063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341986+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:37:38.341986+0000","last_peered":"2024-04-18T03:37:38.341986+0000","last_clean":"2024-04-18T03:37:38.341986+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:37:38.341986+0000","last_undegraded":"2024-04-18T03:37:38.341986+0000","last_fullsized":"2024-04-18T03:37:38.341986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320713+0000","last_change":"2024-04-18T03:37:34.301044+0000","last_active":"2024-04-18T03:37:38.320713+0000","last_peered":"2024-04-18T03:37:38.320713+0000","last_clean":"2024-04-18T03:37:38.320713+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:37:38.320713+0000","last_undegraded":"2024-04-18T03:37:38.320713+0000","last_fullsized":"2024-04-18T03:37:38.320713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546634+0000","last_change":"2024-04-18T03:37:33.922934+0000","last_active":"2024-04-18T03:37:38.546634+0000","last_peered":"2024-04-18T03:37:38.546634+0000","last_clean":"2024-04-18T03:37:38.546634+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:37:38.546634+0000","last_undegraded":"2024-04-18T03:37:38.546634+0000","last_fullsized":"2024-04-18T03:37:38.546634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:21.818428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550643+0000","last_change":"2024-04-18T03:37:38.549484+0000","last_active":"2024-04-18T03:37:38.550643+0000","last_peered":"2024-04-18T03:37:38.550643+0000","last_clean":"2024-04-18T03:37:38.550643+0000","last_became_active":"2024-04-18T03:37:38.549067+0000","last_became_peered":"2024-04-18T03:37:38.549067+0000","last_unstale":"2024-04-18T03:37:38.550643+0000","last_undegraded":"2024-04-18T03:37:38.550643+0000","last_fullsized":"2024-04-18T03:37:38.550643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310097+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:37:38.310097+0000","last_peered":"2024-04-18T03:37:38.310097+0000","last_clean":"2024-04-18T03:37:38.310097+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:37:38.310097+0000","last_undegraded":"2024-04-18T03:37:38.310097+0000","last_fullsized":"2024-04-18T03:37:38.310097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317479+0000","last_change":"2024-04-18T03:37:33.919255+0000","last_active":"2024-04-18T03:37:38.317479+0000","last_peered":"2024-04-18T03:37:38.317479+0000","last_clean":"2024-04-18T03:37:38.317479+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:37:38.317479+0000","last_undegraded":"2024-04-18T03:37:38.317479+0000","last_fullsized":"2024-04-18T03:37:38.317479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546780+0000","last_change":"2024-04-18T03:37:28.881821+0000","last_active":"2024-04-18T03:37:38.546780+0000","last_peered":"2024-04-18T03:37:38.546780+0000","last_clean":"2024-04-18T03:37:38.546780+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:37:38.546780+0000","last_undegraded":"2024-04-18T03:37:38.546780+0000","last_fullsized":"2024-04-18T03:37:38.546780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_clean_scrub_stamp":"2024-04-18T03:37:27.828246+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:15.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785244+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:37:38.785244+0000","last_peered":"2024-04-18T03:37:38.785244+0000","last_clean":"2024-04-18T03:37:38.785244+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:37:38.785244+0000","last_undegraded":"2024-04-18T03:37:38.785244+0000","last_fullsized":"2024-04-18T03:37:38.785244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547381+0000","last_change":"2024-04-18T03:37:34.308036+0000","last_active":"2024-04-18T03:37:38.547381+0000","last_peered":"2024-04-18T03:37:38.547381+0000","last_clean":"2024-04-18T03:37:38.547381+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:37:38.547381+0000","last_undegraded":"2024-04-18T03:37:38.547381+0000","last_fullsized":"2024-04-18T03:37:38.547381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320397+0000","last_change":"2024-04-18T03:37:33.922748+0000","last_active":"2024-04-18T03:37:38.320397+0000","last_peered":"2024-04-18T03:37:38.320397+0000","last_clean":"2024-04-18T03:37:38.320397+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:37:38.320397+0000","last_undegraded":"2024-04-18T03:37:38.320397+0000","last_fullsized":"2024-04-18T03:37:38.320397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785119+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:37:38.785119+0000","last_peered":"2024-04-18T03:37:38.785119+0000","last_clean":"2024-04-18T03:37:38.785119+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:37:38.785119+0000","last_undegraded":"2024-04-18T03:37:38.785119+0000","last_fullsized":"2024-04-18T03:37:38.785119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:02.179174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317509+0000","last_change":"2024-04-18T03:37:34.300176+0000","last_active":"2024-04-18T03:37:38.317509+0000","last_peered":"2024-04-18T03:37:38.317509+0000","last_clean":"2024-04-18T03:37:38.317509+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:37:38.317509+0000","last_undegraded":"2024-04-18T03:37:38.317509+0000","last_fullsized":"2024-04-18T03:37:38.317509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335512+0000","last_change":"2024-04-18T03:37:33.916221+0000","last_active":"2024-04-18T03:37:38.335512+0000","last_peered":"2024-04-18T03:37:38.335512+0000","last_clean":"2024-04-18T03:37:38.335512+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:37:38.335512+0000","last_undegraded":"2024-04-18T03:37:38.335512+0000","last_fullsized":"2024-04-18T03:37:38.335512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:06.510816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.340541+0000","last_change":"2024-04-18T03:37:38.339879+0000","last_active":"2024-04-18T03:37:38.340541+0000","last_peered":"2024-04-18T03:37:38.340541+0000","last_clean":"2024-04-18T03:37:38.340541+0000","last_became_active":"2024-04-18T03:37:38.339495+0000","last_became_peered":"2024-04-18T03:37:38.339495+0000","last_unstale":"2024-04-18T03:37:38.340541+0000","last_undegraded":"2024-04-18T03:37:38.340541+0000","last_fullsized":"2024-04-18T03:37:38.340541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548693+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:37:38.548693+0000","last_peered":"2024-04-18T03:37:38.548693+0000","last_clean":"2024-04-18T03:37:38.548693+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:37:38.548693+0000","last_undegraded":"2024-04-18T03:37:38.548693+0000","last_fullsized":"2024-04-18T03:37:38.548693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319392+0000","last_change":"2024-04-18T03:37:33.923743+0000","last_active":"2024-04-18T03:37:38.319392+0000","last_peered":"2024-04-18T03:37:38.319392+0000","last_clean":"2024-04-18T03:37:38.319392+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:37:38.319392+0000","last_undegraded":"2024-04-18T03:37:38.319392+0000","last_fullsized":"2024-04-18T03:37:38.319392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.555017+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:37:38.555017+0000","last_peered":"2024-04-18T03:37:38.555017+0000","last_clean":"2024-04-18T03:37:38.555017+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:37:38.555017+0000","last_undegraded":"2024-04-18T03:37:38.555017+0000","last_fullsized":"2024-04-18T03:37:38.555017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:26:14.663224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548187+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:37:38.548187+0000","last_peered":"2024-04-18T03:37:38.548187+0000","last_clean":"2024-04-18T03:37:38.548187+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:37:38.548187+0000","last_undegraded":"2024-04-18T03:37:38.548187+0000","last_fullsized":"2024-04-18T03:37:38.548187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311385+0000","last_change":"2024-04-18T03:37:33.923624+0000","last_active":"2024-04-18T03:37:38.311385+0000","last_peered":"2024-04-18T03:37:38.311385+0000","last_clean":"2024-04-18T03:37:38.311385+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:37:38.311385+0000","last_undegraded":"2024-04-18T03:37:38.311385+0000","last_fullsized":"2024-04-18T03:37:38.311385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:30:29.619675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694879+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:37:38.694879+0000","last_peered":"2024-04-18T03:37:38.694879+0000","last_clean":"2024-04-18T03:37:38.694879+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:37:38.694879+0000","last_undegraded":"2024-04-18T03:37:38.694879+0000","last_fullsized":"2024-04-18T03:37:38.694879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:42:56.306731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547148+0000","last_change":"2024-04-18T03:37:34.304075+0000","last_active":"2024-04-18T03:37:38.547148+0000","last_peered":"2024-04-18T03:37:38.547148+0000","last_clean":"2024-04-18T03:37:38.547148+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:37:38.547148+0000","last_undegraded":"2024-04-18T03:37:38.547148+0000","last_fullsized":"2024-04-18T03:37:38.547148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.315734+0000","last_change":"2024-04-18T03:37:33.917032+0000","last_active":"2024-04-18T03:37:38.315734+0000","last_peered":"2024-04-18T03:37:38.315734+0000","last_clean":"2024-04-18T03:37:38.315734+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:37:38.315734+0000","last_undegraded":"2024-04-18T03:37:38.315734+0000","last_fullsized":"2024-04-18T03:37:38.315734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.327254+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:37:38.327254+0000","last_peered":"2024-04-18T03:37:38.327254+0000","last_clean":"2024-04-18T03:37:38.327254+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:37:38.327254+0000","last_undegraded":"2024-04-18T03:37:38.327254+0000","last_fullsized":"2024-04-18T03:37:38.327254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785078+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:37:38.785078+0000","last_peered":"2024-04-18T03:37:38.785078+0000","last_clean":"2024-04-18T03:37:38.785078+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:37:38.785078+0000","last_undegraded":"2024-04-18T03:37:38.785078+0000","last_fullsized":"2024-04-18T03:37:38.785078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.318610+0000","last_change":"2024-04-18T03:37:33.930343+0000","last_active":"2024-04-18T03:37:38.318610+0000","last_peered":"2024-04-18T03:37:38.318610+0000","last_clean":"2024-04-18T03:37:38.318610+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:37:38.318610+0000","last_undegraded":"2024-04-18T03:37:38.318610+0000","last_fullsized":"2024-04-18T03:37:38.318610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.559648+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:37:38.559648+0000","last_peered":"2024-04-18T03:37:38.559648+0000","last_clean":"2024-04-18T03:37:38.559648+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:37:38.559648+0000","last_undegraded":"2024-04-18T03:37:38.559648+0000","last_fullsized":"2024-04-18T03:37:38.559648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:57.028939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547062+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:37:38.547062+0000","last_peered":"2024-04-18T03:37:38.547062+0000","last_clean":"2024-04-18T03:37:38.547062+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:37:38.547062+0000","last_undegraded":"2024-04-18T03:37:38.547062+0000","last_fullsized":"2024-04-18T03:37:38.547062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317588+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:37:38.317588+0000","last_peered":"2024-04-18T03:37:38.317588+0000","last_clean":"2024-04-18T03:37:38.317588+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:37:38.317588+0000","last_undegraded":"2024-04-18T03:37:38.317588+0000","last_fullsized":"2024-04-18T03:37:38.317588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.553566+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:37:38.553566+0000","last_peered":"2024-04-18T03:37:38.553566+0000","last_clean":"2024-04-18T03:37:38.553566+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:37:38.553566+0000","last_undegraded":"2024-04-18T03:37:38.553566+0000","last_fullsized":"2024-04-18T03:37:38.553566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:00:18.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321247+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:37:38.321247+0000","last_peered":"2024-04-18T03:37:38.321247+0000","last_clean":"2024-04-18T03:37:38.321247+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:37:38.321247+0000","last_undegraded":"2024-04-18T03:37:38.321247+0000","last_fullsized":"2024-04-18T03:37:38.321247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321839+0000","last_change":"2024-04-18T03:37:33.927394+0000","last_active":"2024-04-18T03:37:38.321839+0000","last_peered":"2024-04-18T03:37:38.321839+0000","last_clean":"2024-04-18T03:37:38.321839+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:37:38.321839+0000","last_undegraded":"2024-04-18T03:37:38.321839+0000","last_fullsized":"2024-04-18T03:37:38.321839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550202+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:37:38.550202+0000","last_peered":"2024-04-18T03:37:38.550202+0000","last_clean":"2024-04-18T03:37:38.550202+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:37:38.550202+0000","last_undegraded":"2024-04-18T03:37:38.550202+0000","last_fullsized":"2024-04-18T03:37:38.550202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:08.435358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547255+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:37:38.547255+0000","last_peered":"2024-04-18T03:37:38.547255+0000","last_clean":"2024-04-18T03:37:38.547255+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:37:38.547255+0000","last_undegraded":"2024-04-18T03:37:38.547255+0000","last_fullsized":"2024-04-18T03:37:38.547255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:16:02.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:43.600171+0000","last_change":"2024-04-18T03:37:33.929970+0000","last_active":"2024-04-18T03:37:43.600171+0000","last_peered":"2024-04-18T03:37:43.600171+0000","last_clean":"2024-04-18T03:37:43.600171+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:37:43.600171+0000","last_undegraded":"2024-04-18T03:37:43.600171+0000","last_fullsized":"2024-04-18T03:37:43.600171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.472626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341441+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:37:38.341441+0000","last_peered":"2024-04-18T03:37:38.341441+0000","last_clean":"2024-04-18T03:37:38.341441+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:37:38.341441+0000","last_undegraded":"2024-04-18T03:37:38.341441+0000","last_fullsized":"2024-04-18T03:37:38.341441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696422+0000","last_change":"2024-04-18T03:37:34.299294+0000","last_active":"2024-04-18T03:37:38.696422+0000","last_peered":"2024-04-18T03:37:38.696422+0000","last_clean":"2024-04-18T03:37:38.696422+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:37:38.696422+0000","last_undegraded":"2024-04-18T03:37:38.696422+0000","last_fullsized":"2024-04-18T03:37:38.696422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:10.767359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335420+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:37:38.335420+0000","last_peered":"2024-04-18T03:37:38.335420+0000","last_clean":"2024-04-18T03:37:38.335420+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:37:38.335420+0000","last_undegraded":"2024-04-18T03:37:38.335420+0000","last_fullsized":"2024-04-18T03:37:38.335420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:42.808326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695451+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:37:38.695451+0000","last_peered":"2024-04-18T03:37:38.695451+0000","last_clean":"2024-04-18T03:37:38.695451+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:37:38.695451+0000","last_undegraded":"2024-04-18T03:37:38.695451+0000","last_fullsized":"2024-04-18T03:37:38.695451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:40:51.668813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321614+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:37:38.321614+0000","last_peered":"2024-04-18T03:37:38.321614+0000","last_clean":"2024-04-18T03:37:38.321614+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:37:38.321614+0000","last_undegraded":"2024-04-18T03:37:38.321614+0000","last_fullsized":"2024-04-18T03:37:38.321614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317117+0000","last_change":"2024-04-18T03:37:33.931236+0000","last_active":"2024-04-18T03:37:38.317117+0000","last_peered":"2024-04-18T03:37:38.317117+0000","last_clean":"2024-04-18T03:37:38.317117+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:37:38.317117+0000","last_undegraded":"2024-04-18T03:37:38.317117+0000","last_fullsized":"2024-04-18T03:37:38.317117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337871+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:37:38.337871+0000","last_peered":"2024-04-18T03:37:38.337871+0000","last_clean":"2024-04-18T03:37:38.337871+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:37:38.337871+0000","last_undegraded":"2024-04-18T03:37:38.337871+0000","last_fullsized":"2024-04-18T03:37:38.337871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:23.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317036+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:37:38.317036+0000","last_peered":"2024-04-18T03:37:38.317036+0000","last_clean":"2024-04-18T03:37:38.317036+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:37:38.317036+0000","last_undegraded":"2024-04-18T03:37:38.317036+0000","last_fullsized":"2024-04-18T03:37:38.317036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320820+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:37:38.320820+0000","last_peered":"2024-04-18T03:37:38.320820+0000","last_clean":"2024-04-18T03:37:38.320820+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:37:38.320820+0000","last_undegraded":"2024-04-18T03:37:38.320820+0000","last_fullsized":"2024-04-18T03:37:38.320820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.560800+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:37:38.560800+0000","last_peered":"2024-04-18T03:37:38.560800+0000","last_clean":"2024-04-18T03:37:38.560800+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:37:38.560800+0000","last_undegraded":"2024-04-18T03:37:38.560800+0000","last_fullsized":"2024-04-18T03:37:38.560800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:29:14.484508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.561200+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:37:38.561200+0000","last_peered":"2024-04-18T03:37:38.561200+0000","last_clean":"2024-04-18T03:37:38.561200+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:37:38.561200+0000","last_undegraded":"2024-04-18T03:37:38.561200+0000","last_fullsized":"2024-04-18T03:37:38.561200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331388+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:37:38.331388+0000","last_peered":"2024-04-18T03:37:38.331388+0000","last_clean":"2024-04-18T03:37:38.331388+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:37:38.331388+0000","last_undegraded":"2024-04-18T03:37:38.331388+0000","last_fullsized":"2024-04-18T03:37:38.331388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317703+0000","last_change":"2024-04-18T03:37:33.925286+0000","last_active":"2024-04-18T03:37:38.317703+0000","last_peered":"2024-04-18T03:37:38.317703+0000","last_clean":"2024-04-18T03:37:38.317703+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:37:38.317703+0000","last_undegraded":"2024-04-18T03:37:38.317703+0000","last_fullsized":"2024-04-18T03:37:38.317703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785340+0000","last_change":"2024-04-18T03:37:38.330622+0000","last_active":"2024-04-18T03:37:38.785340+0000","last_peered":"2024-04-18T03:37:38.785340+0000","last_clean":"2024-04-18T03:37:38.785340+0000","last_became_active":"2024-04-18T03:37:38.330285+0000","last_became_peered":"2024-04-18T03:37:38.330285+0000","last_unstale":"2024-04-18T03:37:38.785340+0000","last_undegraded":"2024-04-18T03:37:38.785340+0000","last_fullsized":"2024-04-18T03:37:38.785340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310661+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:37:38.310661+0000","last_peered":"2024-04-18T03:37:38.310661+0000","last_clean":"2024-04-18T03:37:38.310661+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:37:38.310661+0000","last_undegraded":"2024-04-18T03:37:38.310661+0000","last_fullsized":"2024-04-18T03:37:38.310661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:14:23.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.312412+0000","last_change":"2024-04-18T03:37:33.932436+0000","last_active":"2024-04-18T03:37:38.312412+0000","last_peered":"2024-04-18T03:37:38.312412+0000","last_clean":"2024-04-18T03:37:38.312412+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:37:38.312412+0000","last_undegraded":"2024-04-18T03:37:38.312412+0000","last_fullsized":"2024-04-18T03:37:38.312412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:11.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319430+0000","last_change":"2024-04-18T03:37:33.929695+0000","last_active":"2024-04-18T03:37:38.319430+0000","last_peered":"2024-04-18T03:37:38.319430+0000","last_clean":"2024-04-18T03:37:38.319430+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:37:38.319430+0000","last_undegraded":"2024-04-18T03:37:38.319430+0000","last_fullsized":"2024-04-18T03:37:38.319430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:29.848633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321745+0000","last_change":"2024-04-18T03:37:34.306548+0000","last_active":"2024-04-18T03:37:38.321745+0000","last_peered":"2024-04-18T03:37:38.321745+0000","last_clean":"2024-04-18T03:37:38.321745+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:37:38.321745+0000","last_undegraded":"2024-04-18T03:37:38.321745+0000","last_fullsized":"2024-04-18T03:37:38.321745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337444+0000","last_change":"2024-04-18T03:37:38.336681+0000","last_active":"2024-04-18T03:37:38.337444+0000","last_peered":"2024-04-18T03:37:38.337444+0000","last_clean":"2024-04-18T03:37:38.337444+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:37:38.337444+0000","last_undegraded":"2024-04-18T03:37:38.337444+0000","last_fullsized":"2024-04-18T03:37:38.337444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:16.022475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311123+0000","last_change":"2024-04-18T03:37:33.923165+0000","last_active":"2024-04-18T03:37:38.311123+0000","last_peered":"2024-04-18T03:37:38.311123+0000","last_clean":"2024-04-18T03:37:38.311123+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:37:38.311123+0000","last_undegraded":"2024-04-18T03:37:38.311123+0000","last_fullsized":"2024-04-18T03:37:38.311123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695662+0000","last_change":"2024-04-18T03:37:34.289192+0000","last_active":"2024-04-18T03:37:38.695662+0000","last_peered":"2024-04-18T03:37:38.695662+0000","last_clean":"2024-04-18T03:37:38.695662+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:37:38.695662+0000","last_undegraded":"2024-04-18T03:37:38.695662+0000","last_fullsized":"2024-04-18T03:37:38.695662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:35.397966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337952+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:37:38.337952+0000","last_peered":"2024-04-18T03:37:38.337952+0000","last_clean":"2024-04-18T03:37:38.337952+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:37:38.337952+0000","last_undegraded":"2024-04-18T03:37:38.337952+0000","last_fullsized":"2024-04-18T03:37:38.337952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:57.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785043+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:37:38.785043+0000","last_peered":"2024-04-18T03:37:38.785043+0000","last_clean":"2024-04-18T03:37:38.785043+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:37:38.785043+0000","last_undegraded":"2024-04-18T03:37:38.785043+0000","last_fullsized":"2024-04-18T03:37:38.785043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317963+0000","last_change":"2024-04-18T03:37:34.295362+0000","last_active":"2024-04-18T03:37:38.317963+0000","last_peered":"2024-04-18T03:37:38.317963+0000","last_clean":"2024-04-18T03:37:38.317963+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:37:38.317963+0000","last_undegraded":"2024-04-18T03:37:38.317963+0000","last_fullsized":"2024-04-18T03:37:38.317963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:13.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317562+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:37:38.317562+0000","last_peered":"2024-04-18T03:37:38.317562+0000","last_clean":"2024-04-18T03:37:38.317562+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:37:38.317562+0000","last_undegraded":"2024-04-18T03:37:38.317562+0000","last_fullsized":"2024-04-18T03:37:38.317562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321663+0000","last_change":"2024-04-18T03:37:34.305580+0000","last_active":"2024-04-18T03:37:38.321663+0000","last_peered":"2024-04-18T03:37:38.321663+0000","last_clean":"2024-04-18T03:37:38.321663+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:37:38.321663+0000","last_undegraded":"2024-04-18T03:37:38.321663+0000","last_fullsized":"2024-04-18T03:37:38.321663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310887+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:37:38.310887+0000","last_peered":"2024-04-18T03:37:38.310887+0000","last_clean":"2024-04-18T03:37:38.310887+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:37:38.310887+0000","last_undegraded":"2024-04-18T03:37:38.310887+0000","last_fullsized":"2024-04-18T03:37:38.310887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335308+0000","last_change":"2024-04-18T03:37:34.298453+0000","last_active":"2024-04-18T03:37:38.335308+0000","last_peered":"2024-04-18T03:37:38.335308+0000","last_clean":"2024-04-18T03:37:38.335308+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:37:38.335308+0000","last_undegraded":"2024-04-18T03:37:38.335308+0000","last_fullsized":"2024-04-18T03:37:38.335308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785319+0000","last_change":"2024-04-18T03:37:34.302543+0000","last_active":"2024-04-18T03:37:38.785319+0000","last_peered":"2024-04-18T03:37:38.785319+0000","last_clean":"2024-04-18T03:37:38.785319+0000","last_became_active":"2024-04-18T03:37:34.302123+0000","last_became_peered":"2024-04-18T03:37:34.302123+0000","last_unstale":"2024-04-18T03:37:38.785319+0000","last_undegraded":"2024-04-18T03:37:38.785319+0000","last_fullsized":"2024-04-18T03:37:38.785319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314210+0000","last_change":"2024-04-18T03:37:34.310319+0000","last_active":"2024-04-18T03:37:38.314210+0000","last_peered":"2024-04-18T03:37:38.314210+0000","last_clean":"2024-04-18T03:37:38.314210+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:37:38.314210+0000","last_undegraded":"2024-04-18T03:37:38.314210+0000","last_fullsized":"2024-04-18T03:37:38.314210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:44.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317614+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:37:38.317614+0000","last_peered":"2024-04-18T03:37:38.317614+0000","last_clean":"2024-04-18T03:37:38.317614+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:37:38.317614+0000","last_undegraded":"2024-04-18T03:37:38.317614+0000","last_fullsized":"2024-04-18T03:37:38.317614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.312313+0000","last_change":"2024-04-18T03:37:34.310229+0000","last_active":"2024-04-18T03:37:38.312313+0000","last_peered":"2024-04-18T03:37:38.312313+0000","last_clean":"2024-04-18T03:37:38.312313+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:37:38.312313+0000","last_undegraded":"2024-04-18T03:37:38.312313+0000","last_fullsized":"2024-04-18T03:37:38.312313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317416+0000","last_change":"2024-04-18T03:37:34.305045+0000","last_active":"2024-04-18T03:37:38.317416+0000","last_peered":"2024-04-18T03:37:38.317416+0000","last_clean":"2024-04-18T03:37:38.317416+0000","last_became_active":"2024-04-18T03:37:34.304455+0000","last_became_peered":"2024-04-18T03:37:34.304455+0000","last_unstale":"2024-04-18T03:37:38.317416+0000","last_undegraded":"2024-04-18T03:37:38.317416+0000","last_fullsized":"2024-04-18T03:37:38.317416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321540+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:37:38.321540+0000","last_peered":"2024-04-18T03:37:38.321540+0000","last_clean":"2024-04-18T03:37:38.321540+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:37:38.321540+0000","last_undegraded":"2024-04-18T03:37:38.321540+0000","last_fullsized":"2024-04-18T03:37:38.321540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785199+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:37:38.785199+0000","last_peered":"2024-04-18T03:37:38.785199+0000","last_clean":"2024-04-18T03:37:38.785199+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:37:38.785199+0000","last_undegraded":"2024-04-18T03:37:38.785199+0000","last_fullsized":"2024-04-18T03:37:38.785199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548268+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:37:38.548268+0000","last_peered":"2024-04-18T03:37:38.548268+0000","last_clean":"2024-04-18T03:37:38.548268+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:37:38.548268+0000","last_undegraded":"2024-04-18T03:37:38.548268+0000","last_fullsized":"2024-04-18T03:37:38.548268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319293+0000","last_change":"2024-04-18T03:37:34.313079+0000","last_active":"2024-04-18T03:37:38.319293+0000","last_peered":"2024-04-18T03:37:38.319293+0000","last_clean":"2024-04-18T03:37:38.319293+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:37:38.319293+0000","last_undegraded":"2024-04-18T03:37:38.319293+0000","last_fullsized":"2024-04-18T03:37:38.319293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:50.485855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317325+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:37:38.317325+0000","last_peered":"2024-04-18T03:37:38.317325+0000","last_clean":"2024-04-18T03:37:38.317325+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:37:38.317325+0000","last_undegraded":"2024-04-18T03:37:38.317325+0000","last_fullsized":"2024-04-18T03:37:38.317325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317809+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:37:38.317809+0000","last_peered":"2024-04-18T03:37:38.317809+0000","last_clean":"2024-04-18T03:37:38.317809+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:37:38.317809+0000","last_undegraded":"2024-04-18T03:37:38.317809+0000","last_fullsized":"2024-04-18T03:37:38.317809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331097+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:37:38.331097+0000","last_peered":"2024-04-18T03:37:38.331097+0000","last_clean":"2024-04-18T03:37:38.331097+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:37:38.331097+0000","last_undegraded":"2024-04-18T03:37:38.331097+0000","last_fullsized":"2024-04-18T03:37:38.331097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321157+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:37:38.321157+0000","last_peered":"2024-04-18T03:37:38.321157+0000","last_clean":"2024-04-18T03:37:38.321157+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:37:38.321157+0000","last_undegraded":"2024-04-18T03:37:38.321157+0000","last_fullsized":"2024-04-18T03:37:38.321157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310074+0000","last_change":"2024-04-18T03:37:34.314282+0000","last_active":"2024-04-18T03:37:38.310074+0000","last_peered":"2024-04-18T03:37:38.310074+0000","last_clean":"2024-04-18T03:37:38.310074+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:37:38.310074+0000","last_undegraded":"2024-04-18T03:37:38.310074+0000","last_fullsized":"2024-04-18T03:37:38.310074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696418+0000","last_change":"2024-04-18T03:37:34.299168+0000","last_active":"2024-04-18T03:37:38.696418+0000","last_peered":"2024-04-18T03:37:38.696418+0000","last_clean":"2024-04-18T03:37:38.696418+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:37:38.696418+0000","last_undegraded":"2024-04-18T03:37:38.696418+0000","last_fullsized":"2024-04-18T03:37:38.696418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:43.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785277+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:37:38.785277+0000","last_peered":"2024-04-18T03:37:38.785277+0000","last_clean":"2024-04-18T03:37:38.785277+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:37:38.785277+0000","last_undegraded":"2024-04-18T03:37:38.785277+0000","last_fullsized":"2024-04-18T03:37:38.785277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785299+0000","last_change":"2024-04-18T03:37:34.302785+0000","last_active":"2024-04-18T03:37:38.785299+0000","last_peered":"2024-04-18T03:37:38.785299+0000","last_clean":"2024-04-18T03:37:38.785299+0000","last_became_active":"2024-04-18T03:37:34.302502+0000","last_became_peered":"2024-04-18T03:37:34.302502+0000","last_unstale":"2024-04-18T03:37:38.785299+0000","last_undegraded":"2024-04-18T03:37:38.785299+0000","last_fullsized":"2024-04-18T03:37:38.785299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548581+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:37:38.548581+0000","last_peered":"2024-04-18T03:37:38.548581+0000","last_clean":"2024-04-18T03:37:38.548581+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:37:38.548581+0000","last_undegraded":"2024-04-18T03:37:38.548581+0000","last_fullsized":"2024-04-18T03:37:38.548581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.309559+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:37:38.309559+0000","last_peered":"2024-04-18T03:37:38.309559+0000","last_clean":"2024-04-18T03:37:38.309559+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:37:38.309559+0000","last_undegraded":"2024-04-18T03:37:38.309559+0000","last_fullsized":"2024-04-18T03:37:38.309559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548317+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:37:38.548317+0000","last_peered":"2024-04-18T03:37:38.548317+0000","last_clean":"2024-04-18T03:37:38.548317+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:37:38.548317+0000","last_undegraded":"2024-04-18T03:37:38.548317+0000","last_fullsized":"2024-04-18T03:37:38.548317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317480+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:37:38.317480+0000","last_peered":"2024-04-18T03:37:38.317480+0000","last_clean":"2024-04-18T03:37:38.317480+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:37:38.317480+0000","last_undegraded":"2024-04-18T03:37:38.317480+0000","last_fullsized":"2024-04-18T03:37:38.317480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546732+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:37:38.546732+0000","last_peered":"2024-04-18T03:37:38.546732+0000","last_clean":"2024-04-18T03:37:38.546732+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:37:38.546732+0000","last_undegraded":"2024-04-18T03:37:38.546732+0000","last_fullsized":"2024-04-18T03:37:38.546732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317122+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:37:38.317122+0000","last_peered":"2024-04-18T03:37:38.317122+0000","last_clean":"2024-04-18T03:37:38.317122+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:37:38.317122+0000","last_undegraded":"2024-04-18T03:37:38.317122+0000","last_fullsized":"2024-04-18T03:37:38.317122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321085+0000","last_change":"2024-04-18T03:37:34.300927+0000","last_active":"2024-04-18T03:37:38.321085+0000","last_peered":"2024-04-18T03:37:38.321085+0000","last_clean":"2024-04-18T03:37:38.321085+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:37:38.321085+0000","last_undegraded":"2024-04-18T03:37:38.321085+0000","last_fullsized":"2024-04-18T03:37:38.321085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335417+0000","last_change":"2024-04-18T03:37:34.289446+0000","last_active":"2024-04-18T03:37:38.335417+0000","last_peered":"2024-04-18T03:37:38.335417+0000","last_clean":"2024-04-18T03:37:38.335417+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:37:38.335417+0000","last_undegraded":"2024-04-18T03:37:38.335417+0000","last_fullsized":"2024-04-18T03:37:38.335417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548415+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:37:38.548415+0000","last_peered":"2024-04-18T03:37:38.548415+0000","last_clean":"2024-04-18T03:37:38.548415+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:37:38.548415+0000","last_undegraded":"2024-04-18T03:37:38.548415+0000","last_fullsized":"2024-04-18T03:37:38.548415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:49.338554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":101805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":693243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":102383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":270336,"data_stored":106089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":102293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":266240,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":860160,"data_stored":691632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:37:55.507 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:37:55.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.607+0000 7f02323da700 1 Processor -- start 2024-04-18T03:37:55.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.607+0000 7f02323da700 1 -- start start 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 0x7f022c070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c0af900 con 0x7f022c1596c0 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c0afb50 con 0x7f022c15dab0 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c0afe30 con 0x7f022c159aa0 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f022c1596c0 0x7f022c15d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36718/0 (socket says 172.21.15.157:36718) 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 -- 172.21.15.157:0/3164512492 learned_addr learned my addr 172.21.15.157:0/3164512492 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0230bd7700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 0x7f022c070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615725242 0 0) 0x7f022c0af900 con 0x7f022c1596c0 2024-04-18T03:37:55.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02180035d0 con 0x7f022c1596c0 2024-04-18T03:37:55.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3019768505 0 0) 0x7f02180035d0 con 0x7f022c1596c0 2024-04-18T03:37:55.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 msgr2=0x7f022c070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:55.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 0x7f022c070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 >> v1:172.21.15.175:6789/0 conn(0x7f022c15dab0 legacy=0x7f022c0ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0acb90 con 0x7f022c1596c0 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7f0228001670 con 0x7f022c1596c0 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0230bd7700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 0x7f022c070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 >> v1:172.21.15.157:6789/0 conn(0x7f022c1596c0 legacy=0x7f022c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0218003a50 0x7f0218003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 0x7f0218004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0218004db0 0x7f0218005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c0afe30 con 0x7f0218003a50 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0218010040 con 0x7f0218004db0 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0218010180 con 0x7f022c159aa0 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0218003a50 0x7f0218003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0230bd7700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 0x7f0218004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0231bd9700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0218004db0 0x7f0218005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 -- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 msgr2=0x7f0218004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 0x7f0218004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 -- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0218004db0 msgr2=0x7f0218005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0218004db0 0x7f0218005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 -- 172.21.15.157:0/3164512492 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02180035d0 con 0x7f0218003a50 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0230bd7700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c159aa0 0x7f0218004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02313d8700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0218003a50 0x7f0218003e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f022800c320 tx=0x7f02180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb9278820c0a820 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228007c30 con 0x7f0218003a50 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800ce20 con 0x7f0218003a50 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0223fff700 1 -- 172.21.15.157:0/3164512492 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228005bc0 con 0x7f0218003a50 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 -- 172.21.15.157:0/3164512492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0218003a50 msgr2=0x7f0218003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 --2- 172.21.15.157:0/3164512492 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0218003a50 0x7f0218003e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f022800c320 tx=0x7f02180058a0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f0231bd9700 1 -- 172.21.15.157:0/3164512492 reap_dead start 2024-04-18T03:37:55.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 -- 172.21.15.157:0/3164512492 shutdown_connections 2024-04-18T03:37:55.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 -- 172.21.15.157:0/3164512492 >> 172.21.15.157:0/3164512492 conn(0x7f022c098a50 msgr2=0x7f022c0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.611+0000 7f02323da700 1 -- 172.21.15.157:0/3164512492 shutdown_connections 2024-04-18T03:37:55.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 -- 172.21.15.157:0/3164512492 wait complete. 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 Processor -- start 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 -- start start 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c148e30 0x7f022c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f022c070fc0 0x7f022c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f022c0b4620 0x7f022c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c15a4a0 con 0x7f022c070fc0 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c0b4aa0 con 0x7f022c0b4620 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c15a2a0 con 0x7f022c148e30 2024-04-18T03:37:55.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f022c070fc0 0x7f022c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f022c070fc0 0x7f022c0b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56962/0 (socket says 172.21.15.157:56962) 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 -- 172.21.15.157:0/3857329379 learned_addr learned my addr 172.21.15.157:0/3857329379 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02313d8700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c148e30 0x7f022c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0231bd9700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f022c0b4620 0x7f022c156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 -- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c148e30 msgr2=0x7f022c070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c148e30 0x7f022c070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 -- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f022c0b4620 msgr2=0x7f022c156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f022c0b4620 0x7f022c156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 -- 172.21.15.157:0/3857329379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c1e3d30 con 0x7f022c070fc0 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0231bd9700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f022c0b4620 0x7f022c156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0230bd7700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f022c070fc0 0x7f022c0b40e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f021c00f740 tx=0x7f021c00fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0221ffb700 1 -- 172.21.15.157:0/3857329379 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c004220 con 0x7f022c070fc0 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0221ffb700 1 -- 172.21.15.157:0/3857329379 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c004380 con 0x7f022c070fc0 2024-04-18T03:37:55.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c0715f0 con 0x7f022c070fc0 2024-04-18T03:37:55.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.615+0000 7f0221ffb700 1 -- 172.21.15.157:0/3857329379 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c0036c0 con 0x7f022c070fc0 2024-04-18T03:37:55.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.619+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c071bb0 con 0x7f022c070fc0 2024-04-18T03:37:55.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.619+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c04e650 con 0x7f022c070fc0 2024-04-18T03:37:55.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.619+0000 7f0221ffb700 1 -- 172.21.15.157:0/3857329379 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f021c003820 con 0x7f022c070fc0 2024-04-18T03:37:55.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.619+0000 7f0221ffb700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0210066730 0x7f0210068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.619+0000 7f0221ffb700 1 -- 172.21.15.157:0/3857329379 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f021c083f30 con 0x7f022c070fc0 2024-04-18T03:37:55.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.619+0000 7f02313d8700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0210066730 0x7f0210068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.623+0000 7f02313d8700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0210066730 0x7f0210068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f022c0723e0 tx=0x7f0228006040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.627+0000 7f0221ffb700 1 -- 172.21.15.157:0/3857329379 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f021c050fb0 con 0x7f022c070fc0 2024-04-18T03:37:55.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.779+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f022c0b0110 con 0x7f0210066730 2024-04-18T03:37:55.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.799+0000 7f0221ffb700 1 -- 172.21.15.157:0/3857329379 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345213 (secure 0 0 0) 0x7f022800cc80 con 0x7f0210066730 2024-04-18T03:37:55.806 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0210066730 msgr2=0x7f0210068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0210066730 0x7f0210068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f022c0723e0 tx=0x7f0228006040 comp rx=0 tx=0).stop 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f022c070fc0 msgr2=0x7f022c0b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f022c070fc0 0x7f022c0b40e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f021c00f740 tx=0x7f021c00fa50 comp rx=0 tx=0).stop 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 shutdown_connections 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0210066730 0x7f0210068bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f022c0b4620 0x7f022c156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f022c070fc0 0x7f022c0b40e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 --2- 172.21.15.157:0/3857329379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f022c148e30 0x7f022c070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 >> 172.21.15.157:0/3857329379 conn(0x7f022c098a50 msgr2=0x7f022c06ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 shutdown_connections 2024-04-18T03:37:55.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.803+0000 7f02323da700 1 -- 172.21.15.157:0/3857329379 wait complete. 2024-04-18T03:37:55.810 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:37:55.823 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-18T03:37:55.771616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235812,"kb_used_data":3232,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738908,"statfs":{"total":773094113280,"available":772852641792,"internally_reserved":0,"allocated":3309568,"data_stored":2005987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005558"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321795+0000","last_change":"2024-04-18T03:37:33.922528+0000","last_active":"2024-04-18T03:37:38.321795+0000","last_peered":"2024-04-18T03:37:38.321795+0000","last_clean":"2024-04-18T03:37:38.321795+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:37:38.321795+0000","last_undegraded":"2024-04-18T03:37:38.321795+0000","last_fullsized":"2024-04-18T03:37:38.321795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:05:10.328715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314103+0000","last_change":"2024-04-18T03:37:34.316836+0000","last_active":"2024-04-18T03:37:38.314103+0000","last_peered":"2024-04-18T03:37:38.314103+0000","last_clean":"2024-04-18T03:37:38.314103+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:37:38.314103+0000","last_undegraded":"2024-04-18T03:37:38.314103+0000","last_fullsized":"2024-04-18T03:37:38.314103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.561206+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:37:38.561206+0000","last_peered":"2024-04-18T03:37:38.561206+0000","last_clean":"2024-04-18T03:37:38.561206+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:37:38.561206+0000","last_undegraded":"2024-04-18T03:37:38.561206+0000","last_fullsized":"2024-04-18T03:37:38.561206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:51:07.334398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314521+0000","last_change":"2024-04-18T03:37:33.925462+0000","last_active":"2024-04-18T03:37:38.314521+0000","last_peered":"2024-04-18T03:37:38.314521+0000","last_clean":"2024-04-18T03:37:38.314521+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:37:38.314521+0000","last_undegraded":"2024-04-18T03:37:38.314521+0000","last_fullsized":"2024-04-18T03:37:38.314521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:23.795590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321515+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:37:38.321515+0000","last_peered":"2024-04-18T03:37:38.321515+0000","last_clean":"2024-04-18T03:37:38.321515+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:37:38.321515+0000","last_undegraded":"2024-04-18T03:37:38.321515+0000","last_fullsized":"2024-04-18T03:37:38.321515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694983+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:37:38.694983+0000","last_peered":"2024-04-18T03:37:38.694983+0000","last_clean":"2024-04-18T03:37:38.694983+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:37:38.694983+0000","last_undegraded":"2024-04-18T03:37:38.694983+0000","last_fullsized":"2024-04-18T03:37:38.694983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548268+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:37:38.548268+0000","last_peered":"2024-04-18T03:37:38.548268+0000","last_clean":"2024-04-18T03:37:38.548268+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:37:38.548268+0000","last_undegraded":"2024-04-18T03:37:38.548268+0000","last_fullsized":"2024-04-18T03:37:38.548268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317644+0000","last_change":"2024-04-18T03:37:34.306151+0000","last_active":"2024-04-18T03:37:38.317644+0000","last_peered":"2024-04-18T03:37:38.317644+0000","last_clean":"2024-04-18T03:37:38.317644+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:37:38.317644+0000","last_undegraded":"2024-04-18T03:37:38.317644+0000","last_fullsized":"2024-04-18T03:37:38.317644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695123+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:37:38.695123+0000","last_peered":"2024-04-18T03:37:38.695123+0000","last_clean":"2024-04-18T03:37:38.695123+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:37:38.695123+0000","last_undegraded":"2024-04-18T03:37:38.695123+0000","last_fullsized":"2024-04-18T03:37:38.695123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550252+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:37:38.550252+0000","last_peered":"2024-04-18T03:37:38.550252+0000","last_clean":"2024-04-18T03:37:38.550252+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:37:38.550252+0000","last_undegraded":"2024-04-18T03:37:38.550252+0000","last_fullsized":"2024-04-18T03:37:38.550252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:12.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317258+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:37:38.317258+0000","last_peered":"2024-04-18T03:37:38.317258+0000","last_clean":"2024-04-18T03:37:38.317258+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:37:38.317258+0000","last_undegraded":"2024-04-18T03:37:38.317258+0000","last_fullsized":"2024-04-18T03:37:38.317258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695246+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:37:38.695246+0000","last_peered":"2024-04-18T03:37:38.695246+0000","last_clean":"2024-04-18T03:37:38.695246+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:37:38.695246+0000","last_undegraded":"2024-04-18T03:37:38.695246+0000","last_fullsized":"2024-04-18T03:37:38.695246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:29:44.713922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785151+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:37:38.785151+0000","last_peered":"2024-04-18T03:37:38.785151+0000","last_clean":"2024-04-18T03:37:38.785151+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:37:38.785151+0000","last_undegraded":"2024-04-18T03:37:38.785151+0000","last_fullsized":"2024-04-18T03:37:38.785151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547248+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:37:38.547248+0000","last_peered":"2024-04-18T03:37:38.547248+0000","last_clean":"2024-04-18T03:37:38.547248+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:37:38.547248+0000","last_undegraded":"2024-04-18T03:37:38.547248+0000","last_fullsized":"2024-04-18T03:37:38.547248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:08.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696507+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:37:38.696507+0000","last_peered":"2024-04-18T03:37:38.696507+0000","last_clean":"2024-04-18T03:37:38.696507+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:37:38.696507+0000","last_undegraded":"2024-04-18T03:37:38.696507+0000","last_fullsized":"2024-04-18T03:37:38.696507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:09:17.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311083+0000","last_change":"2024-04-18T03:37:34.308785+0000","last_active":"2024-04-18T03:37:38.311083+0000","last_peered":"2024-04-18T03:37:38.311083+0000","last_clean":"2024-04-18T03:37:38.311083+0000","last_became_active":"2024-04-18T03:37:34.308536+0000","last_became_peered":"2024-04-18T03:37:34.308536+0000","last_unstale":"2024-04-18T03:37:38.311083+0000","last_undegraded":"2024-04-18T03:37:38.311083+0000","last_fullsized":"2024-04-18T03:37:38.311083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331345+0000","last_change":"2024-04-18T03:37:33.928257+0000","last_active":"2024-04-18T03:37:38.331345+0000","last_peered":"2024-04-18T03:37:38.331345+0000","last_clean":"2024-04-18T03:37:38.331345+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:37:38.331345+0000","last_undegraded":"2024-04-18T03:37:38.331345+0000","last_fullsized":"2024-04-18T03:37:38.331345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696116+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:37:38.696116+0000","last_peered":"2024-04-18T03:37:38.696116+0000","last_clean":"2024-04-18T03:37:38.696116+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:37:38.696116+0000","last_undegraded":"2024-04-18T03:37:38.696116+0000","last_fullsized":"2024-04-18T03:37:38.696116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310799+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:37:38.310799+0000","last_peered":"2024-04-18T03:37:38.310799+0000","last_clean":"2024-04-18T03:37:38.310799+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:37:38.310799+0000","last_undegraded":"2024-04-18T03:37:38.310799+0000","last_fullsized":"2024-04-18T03:37:38.310799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:15:10.489560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331472+0000","last_change":"2024-04-18T03:37:33.921368+0000","last_active":"2024-04-18T03:37:38.331472+0000","last_peered":"2024-04-18T03:37:38.331472+0000","last_clean":"2024-04-18T03:37:38.331472+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:37:38.331472+0000","last_undegraded":"2024-04-18T03:37:38.331472+0000","last_fullsized":"2024-04-18T03:37:38.331472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.557731+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:37:38.557731+0000","last_peered":"2024-04-18T03:37:38.557731+0000","last_clean":"2024-04-18T03:37:38.557731+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:37:38.557731+0000","last_undegraded":"2024-04-18T03:37:38.557731+0000","last_fullsized":"2024-04-18T03:37:38.557731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:26.586052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695700+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:37:38.695700+0000","last_peered":"2024-04-18T03:37:38.695700+0000","last_clean":"2024-04-18T03:37:38.695700+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:37:38.695700+0000","last_undegraded":"2024-04-18T03:37:38.695700+0000","last_fullsized":"2024-04-18T03:37:38.695700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:55.630435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546525+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:37:38.546525+0000","last_peered":"2024-04-18T03:37:38.546525+0000","last_clean":"2024-04-18T03:37:38.546525+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:37:38.546525+0000","last_undegraded":"2024-04-18T03:37:38.546525+0000","last_fullsized":"2024-04-18T03:37:38.546525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:07:09.652439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696398+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:37:38.696398+0000","last_peered":"2024-04-18T03:37:38.696398+0000","last_clean":"2024-04-18T03:37:38.696398+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:37:38.696398+0000","last_undegraded":"2024-04-18T03:37:38.696398+0000","last_fullsized":"2024-04-18T03:37:38.696398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.322177+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:37:38.322177+0000","last_peered":"2024-04-18T03:37:38.322177+0000","last_clean":"2024-04-18T03:37:38.322177+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:37:38.322177+0000","last_undegraded":"2024-04-18T03:37:38.322177+0000","last_fullsized":"2024-04-18T03:37:38.322177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320990+0000","last_change":"2024-04-18T03:37:33.929905+0000","last_active":"2024-04-18T03:37:38.320990+0000","last_peered":"2024-04-18T03:37:38.320990+0000","last_clean":"2024-04-18T03:37:38.320990+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:37:38.320990+0000","last_undegraded":"2024-04-18T03:37:38.320990+0000","last_fullsized":"2024-04-18T03:37:38.320990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694891+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:37:38.694891+0000","last_peered":"2024-04-18T03:37:38.694891+0000","last_clean":"2024-04-18T03:37:38.694891+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:37:38.694891+0000","last_undegraded":"2024-04-18T03:37:38.694891+0000","last_fullsized":"2024-04-18T03:37:38.694891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314450+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:37:38.314450+0000","last_peered":"2024-04-18T03:37:38.314450+0000","last_clean":"2024-04-18T03:37:38.314450+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:37:38.314450+0000","last_undegraded":"2024-04-18T03:37:38.314450+0000","last_fullsized":"2024-04-18T03:37:38.314450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:16.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335509+0000","last_change":"2024-04-18T03:37:33.932828+0000","last_active":"2024-04-18T03:37:38.335509+0000","last_peered":"2024-04-18T03:37:38.335509+0000","last_clean":"2024-04-18T03:37:38.335509+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:37:38.335509+0000","last_undegraded":"2024-04-18T03:37:38.335509+0000","last_fullsized":"2024-04-18T03:37:38.335509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:54.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.556815+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:37:38.556815+0000","last_peered":"2024-04-18T03:37:38.556815+0000","last_clean":"2024-04-18T03:37:38.556815+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:37:38.556815+0000","last_undegraded":"2024-04-18T03:37:38.556815+0000","last_fullsized":"2024-04-18T03:37:38.556815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:45.707050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331249+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:37:38.331249+0000","last_peered":"2024-04-18T03:37:38.331249+0000","last_clean":"2024-04-18T03:37:38.331249+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:37:38.331249+0000","last_undegraded":"2024-04-18T03:37:38.331249+0000","last_fullsized":"2024-04-18T03:37:38.331249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548397+0000","last_change":"2024-04-18T03:37:33.924320+0000","last_active":"2024-04-18T03:37:38.548397+0000","last_peered":"2024-04-18T03:37:38.548397+0000","last_clean":"2024-04-18T03:37:38.548397+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:37:38.548397+0000","last_undegraded":"2024-04-18T03:37:38.548397+0000","last_fullsized":"2024-04-18T03:37:38.548397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.552431+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:37:38.552431+0000","last_peered":"2024-04-18T03:37:38.552431+0000","last_clean":"2024-04-18T03:37:38.552431+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:37:38.552431+0000","last_undegraded":"2024-04-18T03:37:38.552431+0000","last_fullsized":"2024-04-18T03:37:38.552431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317341+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:37:38.317341+0000","last_peered":"2024-04-18T03:37:38.317341+0000","last_clean":"2024-04-18T03:37:38.317341+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:37:38.317341+0000","last_undegraded":"2024-04-18T03:37:38.317341+0000","last_fullsized":"2024-04-18T03:37:38.317341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331339+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:37:38.331339+0000","last_peered":"2024-04-18T03:37:38.331339+0000","last_clean":"2024-04-18T03:37:38.331339+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:37:38.331339+0000","last_undegraded":"2024-04-18T03:37:38.331339+0000","last_fullsized":"2024-04-18T03:37:38.331339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:09.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.342038+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:37:38.342038+0000","last_peered":"2024-04-18T03:37:38.342038+0000","last_clean":"2024-04-18T03:37:38.342038+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:37:38.342038+0000","last_undegraded":"2024-04-18T03:37:38.342038+0000","last_fullsized":"2024-04-18T03:37:38.342038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695911+0000","last_change":"2024-04-18T03:37:34.308669+0000","last_active":"2024-04-18T03:37:38.695911+0000","last_peered":"2024-04-18T03:37:38.695911+0000","last_clean":"2024-04-18T03:37:38.695911+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:37:38.695911+0000","last_undegraded":"2024-04-18T03:37:38.695911+0000","last_fullsized":"2024-04-18T03:37:38.695911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:07.525115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317671+0000","last_change":"2024-04-18T03:37:33.921017+0000","last_active":"2024-04-18T03:37:38.317671+0000","last_peered":"2024-04-18T03:37:38.317671+0000","last_clean":"2024-04-18T03:37:38.317671+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:37:38.317671+0000","last_undegraded":"2024-04-18T03:37:38.317671+0000","last_fullsized":"2024-04-18T03:37:38.317671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341916+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:37:38.341916+0000","last_peered":"2024-04-18T03:37:38.341916+0000","last_clean":"2024-04-18T03:37:38.341916+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:37:38.341916+0000","last_undegraded":"2024-04-18T03:37:38.341916+0000","last_fullsized":"2024-04-18T03:37:38.341916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.330075+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:37:38.330075+0000","last_peered":"2024-04-18T03:37:38.330075+0000","last_clean":"2024-04-18T03:37:38.330075+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:37:38.330075+0000","last_undegraded":"2024-04-18T03:37:38.330075+0000","last_fullsized":"2024-04-18T03:37:38.330075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.318063+0000","last_change":"2024-04-18T03:37:33.916761+0000","last_active":"2024-04-18T03:37:38.318063+0000","last_peered":"2024-04-18T03:37:38.318063+0000","last_clean":"2024-04-18T03:37:38.318063+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:37:38.318063+0000","last_undegraded":"2024-04-18T03:37:38.318063+0000","last_fullsized":"2024-04-18T03:37:38.318063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341986+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:37:38.341986+0000","last_peered":"2024-04-18T03:37:38.341986+0000","last_clean":"2024-04-18T03:37:38.341986+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:37:38.341986+0000","last_undegraded":"2024-04-18T03:37:38.341986+0000","last_fullsized":"2024-04-18T03:37:38.341986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320713+0000","last_change":"2024-04-18T03:37:34.301044+0000","last_active":"2024-04-18T03:37:38.320713+0000","last_peered":"2024-04-18T03:37:38.320713+0000","last_clean":"2024-04-18T03:37:38.320713+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:37:38.320713+0000","last_undegraded":"2024-04-18T03:37:38.320713+0000","last_fullsized":"2024-04-18T03:37:38.320713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546634+0000","last_change":"2024-04-18T03:37:33.922934+0000","last_active":"2024-04-18T03:37:38.546634+0000","last_peered":"2024-04-18T03:37:38.546634+0000","last_clean":"2024-04-18T03:37:38.546634+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:37:38.546634+0000","last_undegraded":"2024-04-18T03:37:38.546634+0000","last_fullsized":"2024-04-18T03:37:38.546634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:21.818428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550643+0000","last_change":"2024-04-18T03:37:38.549484+0000","last_active":"2024-04-18T03:37:38.550643+0000","last_peered":"2024-04-18T03:37:38.550643+0000","last_clean":"2024-04-18T03:37:38.550643+0000","last_became_active":"2024-04-18T03:37:38.549067+0000","last_became_peered":"2024-04-18T03:37:38.549067+0000","last_unstale":"2024-04-18T03:37:38.550643+0000","last_undegraded":"2024-04-18T03:37:38.550643+0000","last_fullsized":"2024-04-18T03:37:38.550643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310097+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:37:38.310097+0000","last_peered":"2024-04-18T03:37:38.310097+0000","last_clean":"2024-04-18T03:37:38.310097+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:37:38.310097+0000","last_undegraded":"2024-04-18T03:37:38.310097+0000","last_fullsized":"2024-04-18T03:37:38.310097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317479+0000","last_change":"2024-04-18T03:37:33.919255+0000","last_active":"2024-04-18T03:37:38.317479+0000","last_peered":"2024-04-18T03:37:38.317479+0000","last_clean":"2024-04-18T03:37:38.317479+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:37:38.317479+0000","last_undegraded":"2024-04-18T03:37:38.317479+0000","last_fullsized":"2024-04-18T03:37:38.317479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546780+0000","last_change":"2024-04-18T03:37:28.881821+0000","last_active":"2024-04-18T03:37:38.546780+0000","last_peered":"2024-04-18T03:37:38.546780+0000","last_clean":"2024-04-18T03:37:38.546780+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:37:38.546780+0000","last_undegraded":"2024-04-18T03:37:38.546780+0000","last_fullsized":"2024-04-18T03:37:38.546780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_clean_scrub_stamp":"2024-04-18T03:37:27.828246+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:15.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785244+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:37:38.785244+0000","last_peered":"2024-04-18T03:37:38.785244+0000","last_clean":"2024-04-18T03:37:38.785244+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:37:38.785244+0000","last_undegraded":"2024-04-18T03:37:38.785244+0000","last_fullsized":"2024-04-18T03:37:38.785244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547381+0000","last_change":"2024-04-18T03:37:34.308036+0000","last_active":"2024-04-18T03:37:38.547381+0000","last_peered":"2024-04-18T03:37:38.547381+0000","last_clean":"2024-04-18T03:37:38.547381+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:37:38.547381+0000","last_undegraded":"2024-04-18T03:37:38.547381+0000","last_fullsized":"2024-04-18T03:37:38.547381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320397+0000","last_change":"2024-04-18T03:37:33.922748+0000","last_active":"2024-04-18T03:37:38.320397+0000","last_peered":"2024-04-18T03:37:38.320397+0000","last_clean":"2024-04-18T03:37:38.320397+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:37:38.320397+0000","last_undegraded":"2024-04-18T03:37:38.320397+0000","last_fullsized":"2024-04-18T03:37:38.320397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785119+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:37:38.785119+0000","last_peered":"2024-04-18T03:37:38.785119+0000","last_clean":"2024-04-18T03:37:38.785119+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:37:38.785119+0000","last_undegraded":"2024-04-18T03:37:38.785119+0000","last_fullsized":"2024-04-18T03:37:38.785119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:02.179174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317509+0000","last_change":"2024-04-18T03:37:34.300176+0000","last_active":"2024-04-18T03:37:38.317509+0000","last_peered":"2024-04-18T03:37:38.317509+0000","last_clean":"2024-04-18T03:37:38.317509+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:37:38.317509+0000","last_undegraded":"2024-04-18T03:37:38.317509+0000","last_fullsized":"2024-04-18T03:37:38.317509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335512+0000","last_change":"2024-04-18T03:37:33.916221+0000","last_active":"2024-04-18T03:37:38.335512+0000","last_peered":"2024-04-18T03:37:38.335512+0000","last_clean":"2024-04-18T03:37:38.335512+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:37:38.335512+0000","last_undegraded":"2024-04-18T03:37:38.335512+0000","last_fullsized":"2024-04-18T03:37:38.335512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:06.510816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.340541+0000","last_change":"2024-04-18T03:37:38.339879+0000","last_active":"2024-04-18T03:37:38.340541+0000","last_peered":"2024-04-18T03:37:38.340541+0000","last_clean":"2024-04-18T03:37:38.340541+0000","last_became_active":"2024-04-18T03:37:38.339495+0000","last_became_peered":"2024-04-18T03:37:38.339495+0000","last_unstale":"2024-04-18T03:37:38.340541+0000","last_undegraded":"2024-04-18T03:37:38.340541+0000","last_fullsized":"2024-04-18T03:37:38.340541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548693+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:37:38.548693+0000","last_peered":"2024-04-18T03:37:38.548693+0000","last_clean":"2024-04-18T03:37:38.548693+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:37:38.548693+0000","last_undegraded":"2024-04-18T03:37:38.548693+0000","last_fullsized":"2024-04-18T03:37:38.548693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319392+0000","last_change":"2024-04-18T03:37:33.923743+0000","last_active":"2024-04-18T03:37:38.319392+0000","last_peered":"2024-04-18T03:37:38.319392+0000","last_clean":"2024-04-18T03:37:38.319392+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:37:38.319392+0000","last_undegraded":"2024-04-18T03:37:38.319392+0000","last_fullsized":"2024-04-18T03:37:38.319392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.555017+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:37:38.555017+0000","last_peered":"2024-04-18T03:37:38.555017+0000","last_clean":"2024-04-18T03:37:38.555017+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:37:38.555017+0000","last_undegraded":"2024-04-18T03:37:38.555017+0000","last_fullsized":"2024-04-18T03:37:38.555017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:26:14.663224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548187+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:37:38.548187+0000","last_peered":"2024-04-18T03:37:38.548187+0000","last_clean":"2024-04-18T03:37:38.548187+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:37:38.548187+0000","last_undegraded":"2024-04-18T03:37:38.548187+0000","last_fullsized":"2024-04-18T03:37:38.548187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311385+0000","last_change":"2024-04-18T03:37:33.923624+0000","last_active":"2024-04-18T03:37:38.311385+0000","last_peered":"2024-04-18T03:37:38.311385+0000","last_clean":"2024-04-18T03:37:38.311385+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:37:38.311385+0000","last_undegraded":"2024-04-18T03:37:38.311385+0000","last_fullsized":"2024-04-18T03:37:38.311385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:30:29.619675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.694879+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:37:38.694879+0000","last_peered":"2024-04-18T03:37:38.694879+0000","last_clean":"2024-04-18T03:37:38.694879+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:37:38.694879+0000","last_undegraded":"2024-04-18T03:37:38.694879+0000","last_fullsized":"2024-04-18T03:37:38.694879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:42:56.306731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547148+0000","last_change":"2024-04-18T03:37:34.304075+0000","last_active":"2024-04-18T03:37:38.547148+0000","last_peered":"2024-04-18T03:37:38.547148+0000","last_clean":"2024-04-18T03:37:38.547148+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:37:38.547148+0000","last_undegraded":"2024-04-18T03:37:38.547148+0000","last_fullsized":"2024-04-18T03:37:38.547148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.315734+0000","last_change":"2024-04-18T03:37:33.917032+0000","last_active":"2024-04-18T03:37:38.315734+0000","last_peered":"2024-04-18T03:37:38.315734+0000","last_clean":"2024-04-18T03:37:38.315734+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:37:38.315734+0000","last_undegraded":"2024-04-18T03:37:38.315734+0000","last_fullsized":"2024-04-18T03:37:38.315734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.327254+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:37:38.327254+0000","last_peered":"2024-04-18T03:37:38.327254+0000","last_clean":"2024-04-18T03:37:38.327254+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:37:38.327254+0000","last_undegraded":"2024-04-18T03:37:38.327254+0000","last_fullsized":"2024-04-18T03:37:38.327254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785078+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:37:38.785078+0000","last_peered":"2024-04-18T03:37:38.785078+0000","last_clean":"2024-04-18T03:37:38.785078+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:37:38.785078+0000","last_undegraded":"2024-04-18T03:37:38.785078+0000","last_fullsized":"2024-04-18T03:37:38.785078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.318610+0000","last_change":"2024-04-18T03:37:33.930343+0000","last_active":"2024-04-18T03:37:38.318610+0000","last_peered":"2024-04-18T03:37:38.318610+0000","last_clean":"2024-04-18T03:37:38.318610+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:37:38.318610+0000","last_undegraded":"2024-04-18T03:37:38.318610+0000","last_fullsized":"2024-04-18T03:37:38.318610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.559648+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:37:38.559648+0000","last_peered":"2024-04-18T03:37:38.559648+0000","last_clean":"2024-04-18T03:37:38.559648+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:37:38.559648+0000","last_undegraded":"2024-04-18T03:37:38.559648+0000","last_fullsized":"2024-04-18T03:37:38.559648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:57.028939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547062+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:37:38.547062+0000","last_peered":"2024-04-18T03:37:38.547062+0000","last_clean":"2024-04-18T03:37:38.547062+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:37:38.547062+0000","last_undegraded":"2024-04-18T03:37:38.547062+0000","last_fullsized":"2024-04-18T03:37:38.547062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317588+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:37:38.317588+0000","last_peered":"2024-04-18T03:37:38.317588+0000","last_clean":"2024-04-18T03:37:38.317588+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:37:38.317588+0000","last_undegraded":"2024-04-18T03:37:38.317588+0000","last_fullsized":"2024-04-18T03:37:38.317588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.553566+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:37:38.553566+0000","last_peered":"2024-04-18T03:37:38.553566+0000","last_clean":"2024-04-18T03:37:38.553566+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:37:38.553566+0000","last_undegraded":"2024-04-18T03:37:38.553566+0000","last_fullsized":"2024-04-18T03:37:38.553566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:00:18.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321247+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:37:38.321247+0000","last_peered":"2024-04-18T03:37:38.321247+0000","last_clean":"2024-04-18T03:37:38.321247+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:37:38.321247+0000","last_undegraded":"2024-04-18T03:37:38.321247+0000","last_fullsized":"2024-04-18T03:37:38.321247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321839+0000","last_change":"2024-04-18T03:37:33.927394+0000","last_active":"2024-04-18T03:37:38.321839+0000","last_peered":"2024-04-18T03:37:38.321839+0000","last_clean":"2024-04-18T03:37:38.321839+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:37:38.321839+0000","last_undegraded":"2024-04-18T03:37:38.321839+0000","last_fullsized":"2024-04-18T03:37:38.321839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.550202+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:37:38.550202+0000","last_peered":"2024-04-18T03:37:38.550202+0000","last_clean":"2024-04-18T03:37:38.550202+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:37:38.550202+0000","last_undegraded":"2024-04-18T03:37:38.550202+0000","last_fullsized":"2024-04-18T03:37:38.550202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:08.435358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.547255+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:37:38.547255+0000","last_peered":"2024-04-18T03:37:38.547255+0000","last_clean":"2024-04-18T03:37:38.547255+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:37:38.547255+0000","last_undegraded":"2024-04-18T03:37:38.547255+0000","last_fullsized":"2024-04-18T03:37:38.547255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:16:02.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:43.600171+0000","last_change":"2024-04-18T03:37:33.929970+0000","last_active":"2024-04-18T03:37:43.600171+0000","last_peered":"2024-04-18T03:37:43.600171+0000","last_clean":"2024-04-18T03:37:43.600171+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:37:43.600171+0000","last_undegraded":"2024-04-18T03:37:43.600171+0000","last_fullsized":"2024-04-18T03:37:43.600171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.472626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.341441+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:37:38.341441+0000","last_peered":"2024-04-18T03:37:38.341441+0000","last_clean":"2024-04-18T03:37:38.341441+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:37:38.341441+0000","last_undegraded":"2024-04-18T03:37:38.341441+0000","last_fullsized":"2024-04-18T03:37:38.341441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696422+0000","last_change":"2024-04-18T03:37:34.299294+0000","last_active":"2024-04-18T03:37:38.696422+0000","last_peered":"2024-04-18T03:37:38.696422+0000","last_clean":"2024-04-18T03:37:38.696422+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:37:38.696422+0000","last_undegraded":"2024-04-18T03:37:38.696422+0000","last_fullsized":"2024-04-18T03:37:38.696422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:10.767359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335420+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:37:38.335420+0000","last_peered":"2024-04-18T03:37:38.335420+0000","last_clean":"2024-04-18T03:37:38.335420+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:37:38.335420+0000","last_undegraded":"2024-04-18T03:37:38.335420+0000","last_fullsized":"2024-04-18T03:37:38.335420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:42.808326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695451+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:37:38.695451+0000","last_peered":"2024-04-18T03:37:38.695451+0000","last_clean":"2024-04-18T03:37:38.695451+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:37:38.695451+0000","last_undegraded":"2024-04-18T03:37:38.695451+0000","last_fullsized":"2024-04-18T03:37:38.695451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:40:51.668813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321614+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:37:38.321614+0000","last_peered":"2024-04-18T03:37:38.321614+0000","last_clean":"2024-04-18T03:37:38.321614+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:37:38.321614+0000","last_undegraded":"2024-04-18T03:37:38.321614+0000","last_fullsized":"2024-04-18T03:37:38.321614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317117+0000","last_change":"2024-04-18T03:37:33.931236+0000","last_active":"2024-04-18T03:37:38.317117+0000","last_peered":"2024-04-18T03:37:38.317117+0000","last_clean":"2024-04-18T03:37:38.317117+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:37:38.317117+0000","last_undegraded":"2024-04-18T03:37:38.317117+0000","last_fullsized":"2024-04-18T03:37:38.317117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337871+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:37:38.337871+0000","last_peered":"2024-04-18T03:37:38.337871+0000","last_clean":"2024-04-18T03:37:38.337871+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:37:38.337871+0000","last_undegraded":"2024-04-18T03:37:38.337871+0000","last_fullsized":"2024-04-18T03:37:38.337871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:23.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317036+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:37:38.317036+0000","last_peered":"2024-04-18T03:37:38.317036+0000","last_clean":"2024-04-18T03:37:38.317036+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:37:38.317036+0000","last_undegraded":"2024-04-18T03:37:38.317036+0000","last_fullsized":"2024-04-18T03:37:38.317036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.320820+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:37:38.320820+0000","last_peered":"2024-04-18T03:37:38.320820+0000","last_clean":"2024-04-18T03:37:38.320820+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:37:38.320820+0000","last_undegraded":"2024-04-18T03:37:38.320820+0000","last_fullsized":"2024-04-18T03:37:38.320820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.560800+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:37:38.560800+0000","last_peered":"2024-04-18T03:37:38.560800+0000","last_clean":"2024-04-18T03:37:38.560800+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:37:38.560800+0000","last_undegraded":"2024-04-18T03:37:38.560800+0000","last_fullsized":"2024-04-18T03:37:38.560800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:29:14.484508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.561200+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:37:38.561200+0000","last_peered":"2024-04-18T03:37:38.561200+0000","last_clean":"2024-04-18T03:37:38.561200+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:37:38.561200+0000","last_undegraded":"2024-04-18T03:37:38.561200+0000","last_fullsized":"2024-04-18T03:37:38.561200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331388+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:37:38.331388+0000","last_peered":"2024-04-18T03:37:38.331388+0000","last_clean":"2024-04-18T03:37:38.331388+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:37:38.331388+0000","last_undegraded":"2024-04-18T03:37:38.331388+0000","last_fullsized":"2024-04-18T03:37:38.331388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317703+0000","last_change":"2024-04-18T03:37:33.925286+0000","last_active":"2024-04-18T03:37:38.317703+0000","last_peered":"2024-04-18T03:37:38.317703+0000","last_clean":"2024-04-18T03:37:38.317703+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:37:38.317703+0000","last_undegraded":"2024-04-18T03:37:38.317703+0000","last_fullsized":"2024-04-18T03:37:38.317703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785340+0000","last_change":"2024-04-18T03:37:38.330622+0000","last_active":"2024-04-18T03:37:38.785340+0000","last_peered":"2024-04-18T03:37:38.785340+0000","last_clean":"2024-04-18T03:37:38.785340+0000","last_became_active":"2024-04-18T03:37:38.330285+0000","last_became_peered":"2024-04-18T03:37:38.330285+0000","last_unstale":"2024-04-18T03:37:38.785340+0000","last_undegraded":"2024-04-18T03:37:38.785340+0000","last_fullsized":"2024-04-18T03:37:38.785340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310661+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:37:38.310661+0000","last_peered":"2024-04-18T03:37:38.310661+0000","last_clean":"2024-04-18T03:37:38.310661+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:37:38.310661+0000","last_undegraded":"2024-04-18T03:37:38.310661+0000","last_fullsized":"2024-04-18T03:37:38.310661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:14:23.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.312412+0000","last_change":"2024-04-18T03:37:33.932436+0000","last_active":"2024-04-18T03:37:38.312412+0000","last_peered":"2024-04-18T03:37:38.312412+0000","last_clean":"2024-04-18T03:37:38.312412+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:37:38.312412+0000","last_undegraded":"2024-04-18T03:37:38.312412+0000","last_fullsized":"2024-04-18T03:37:38.312412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:11.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319430+0000","last_change":"2024-04-18T03:37:33.929695+0000","last_active":"2024-04-18T03:37:38.319430+0000","last_peered":"2024-04-18T03:37:38.319430+0000","last_clean":"2024-04-18T03:37:38.319430+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:37:38.319430+0000","last_undegraded":"2024-04-18T03:37:38.319430+0000","last_fullsized":"2024-04-18T03:37:38.319430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:29.848633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321745+0000","last_change":"2024-04-18T03:37:34.306548+0000","last_active":"2024-04-18T03:37:38.321745+0000","last_peered":"2024-04-18T03:37:38.321745+0000","last_clean":"2024-04-18T03:37:38.321745+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:37:38.321745+0000","last_undegraded":"2024-04-18T03:37:38.321745+0000","last_fullsized":"2024-04-18T03:37:38.321745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337444+0000","last_change":"2024-04-18T03:37:38.336681+0000","last_active":"2024-04-18T03:37:38.337444+0000","last_peered":"2024-04-18T03:37:38.337444+0000","last_clean":"2024-04-18T03:37:38.337444+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:37:38.337444+0000","last_undegraded":"2024-04-18T03:37:38.337444+0000","last_fullsized":"2024-04-18T03:37:38.337444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:16.022475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.311123+0000","last_change":"2024-04-18T03:37:33.923165+0000","last_active":"2024-04-18T03:37:38.311123+0000","last_peered":"2024-04-18T03:37:38.311123+0000","last_clean":"2024-04-18T03:37:38.311123+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:37:38.311123+0000","last_undegraded":"2024-04-18T03:37:38.311123+0000","last_fullsized":"2024-04-18T03:37:38.311123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.695662+0000","last_change":"2024-04-18T03:37:34.289192+0000","last_active":"2024-04-18T03:37:38.695662+0000","last_peered":"2024-04-18T03:37:38.695662+0000","last_clean":"2024-04-18T03:37:38.695662+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:37:38.695662+0000","last_undegraded":"2024-04-18T03:37:38.695662+0000","last_fullsized":"2024-04-18T03:37:38.695662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:35.397966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.337952+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:37:38.337952+0000","last_peered":"2024-04-18T03:37:38.337952+0000","last_clean":"2024-04-18T03:37:38.337952+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:37:38.337952+0000","last_undegraded":"2024-04-18T03:37:38.337952+0000","last_fullsized":"2024-04-18T03:37:38.337952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:57.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785043+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:37:38.785043+0000","last_peered":"2024-04-18T03:37:38.785043+0000","last_clean":"2024-04-18T03:37:38.785043+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:37:38.785043+0000","last_undegraded":"2024-04-18T03:37:38.785043+0000","last_fullsized":"2024-04-18T03:37:38.785043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317963+0000","last_change":"2024-04-18T03:37:34.295362+0000","last_active":"2024-04-18T03:37:38.317963+0000","last_peered":"2024-04-18T03:37:38.317963+0000","last_clean":"2024-04-18T03:37:38.317963+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:37:38.317963+0000","last_undegraded":"2024-04-18T03:37:38.317963+0000","last_fullsized":"2024-04-18T03:37:38.317963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:13.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317562+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:37:38.317562+0000","last_peered":"2024-04-18T03:37:38.317562+0000","last_clean":"2024-04-18T03:37:38.317562+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:37:38.317562+0000","last_undegraded":"2024-04-18T03:37:38.317562+0000","last_fullsized":"2024-04-18T03:37:38.317562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321663+0000","last_change":"2024-04-18T03:37:34.305580+0000","last_active":"2024-04-18T03:37:38.321663+0000","last_peered":"2024-04-18T03:37:38.321663+0000","last_clean":"2024-04-18T03:37:38.321663+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:37:38.321663+0000","last_undegraded":"2024-04-18T03:37:38.321663+0000","last_fullsized":"2024-04-18T03:37:38.321663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310887+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:37:38.310887+0000","last_peered":"2024-04-18T03:37:38.310887+0000","last_clean":"2024-04-18T03:37:38.310887+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:37:38.310887+0000","last_undegraded":"2024-04-18T03:37:38.310887+0000","last_fullsized":"2024-04-18T03:37:38.310887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335308+0000","last_change":"2024-04-18T03:37:34.298453+0000","last_active":"2024-04-18T03:37:38.335308+0000","last_peered":"2024-04-18T03:37:38.335308+0000","last_clean":"2024-04-18T03:37:38.335308+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:37:38.335308+0000","last_undegraded":"2024-04-18T03:37:38.335308+0000","last_fullsized":"2024-04-18T03:37:38.335308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785319+0000","last_change":"2024-04-18T03:37:34.302543+0000","last_active":"2024-04-18T03:37:38.785319+0000","last_peered":"2024-04-18T03:37:38.785319+0000","last_clean":"2024-04-18T03:37:38.785319+0000","last_became_active":"2024-04-18T03:37:34.302123+0000","last_became_peered":"2024-04-18T03:37:34.302123+0000","last_unstale":"2024-04-18T03:37:38.785319+0000","last_undegraded":"2024-04-18T03:37:38.785319+0000","last_fullsized":"2024-04-18T03:37:38.785319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.314210+0000","last_change":"2024-04-18T03:37:34.310319+0000","last_active":"2024-04-18T03:37:38.314210+0000","last_peered":"2024-04-18T03:37:38.314210+0000","last_clean":"2024-04-18T03:37:38.314210+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:37:38.314210+0000","last_undegraded":"2024-04-18T03:37:38.314210+0000","last_fullsized":"2024-04-18T03:37:38.314210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:44.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317614+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:37:38.317614+0000","last_peered":"2024-04-18T03:37:38.317614+0000","last_clean":"2024-04-18T03:37:38.317614+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:37:38.317614+0000","last_undegraded":"2024-04-18T03:37:38.317614+0000","last_fullsized":"2024-04-18T03:37:38.317614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.312313+0000","last_change":"2024-04-18T03:37:34.310229+0000","last_active":"2024-04-18T03:37:38.312313+0000","last_peered":"2024-04-18T03:37:38.312313+0000","last_clean":"2024-04-18T03:37:38.312313+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:37:38.312313+0000","last_undegraded":"2024-04-18T03:37:38.312313+0000","last_fullsized":"2024-04-18T03:37:38.312313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317416+0000","last_change":"2024-04-18T03:37:34.305045+0000","last_active":"2024-04-18T03:37:38.317416+0000","last_peered":"2024-04-18T03:37:38.317416+0000","last_clean":"2024-04-18T03:37:38.317416+0000","last_became_active":"2024-04-18T03:37:34.304455+0000","last_became_peered":"2024-04-18T03:37:34.304455+0000","last_unstale":"2024-04-18T03:37:38.317416+0000","last_undegraded":"2024-04-18T03:37:38.317416+0000","last_fullsized":"2024-04-18T03:37:38.317416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321540+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:37:38.321540+0000","last_peered":"2024-04-18T03:37:38.321540+0000","last_clean":"2024-04-18T03:37:38.321540+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:37:38.321540+0000","last_undegraded":"2024-04-18T03:37:38.321540+0000","last_fullsized":"2024-04-18T03:37:38.321540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785199+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:37:38.785199+0000","last_peered":"2024-04-18T03:37:38.785199+0000","last_clean":"2024-04-18T03:37:38.785199+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:37:38.785199+0000","last_undegraded":"2024-04-18T03:37:38.785199+0000","last_fullsized":"2024-04-18T03:37:38.785199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548268+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:37:38.548268+0000","last_peered":"2024-04-18T03:37:38.548268+0000","last_clean":"2024-04-18T03:37:38.548268+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:37:38.548268+0000","last_undegraded":"2024-04-18T03:37:38.548268+0000","last_fullsized":"2024-04-18T03:37:38.548268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.319293+0000","last_change":"2024-04-18T03:37:34.313079+0000","last_active":"2024-04-18T03:37:38.319293+0000","last_peered":"2024-04-18T03:37:38.319293+0000","last_clean":"2024-04-18T03:37:38.319293+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:37:38.319293+0000","last_undegraded":"2024-04-18T03:37:38.319293+0000","last_fullsized":"2024-04-18T03:37:38.319293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:50.485855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317325+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:37:38.317325+0000","last_peered":"2024-04-18T03:37:38.317325+0000","last_clean":"2024-04-18T03:37:38.317325+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:37:38.317325+0000","last_undegraded":"2024-04-18T03:37:38.317325+0000","last_fullsized":"2024-04-18T03:37:38.317325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317809+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:37:38.317809+0000","last_peered":"2024-04-18T03:37:38.317809+0000","last_clean":"2024-04-18T03:37:38.317809+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:37:38.317809+0000","last_undegraded":"2024-04-18T03:37:38.317809+0000","last_fullsized":"2024-04-18T03:37:38.317809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.331097+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:37:38.331097+0000","last_peered":"2024-04-18T03:37:38.331097+0000","last_clean":"2024-04-18T03:37:38.331097+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:37:38.331097+0000","last_undegraded":"2024-04-18T03:37:38.331097+0000","last_fullsized":"2024-04-18T03:37:38.331097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321157+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:37:38.321157+0000","last_peered":"2024-04-18T03:37:38.321157+0000","last_clean":"2024-04-18T03:37:38.321157+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:37:38.321157+0000","last_undegraded":"2024-04-18T03:37:38.321157+0000","last_fullsized":"2024-04-18T03:37:38.321157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.310074+0000","last_change":"2024-04-18T03:37:34.314282+0000","last_active":"2024-04-18T03:37:38.310074+0000","last_peered":"2024-04-18T03:37:38.310074+0000","last_clean":"2024-04-18T03:37:38.310074+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:37:38.310074+0000","last_undegraded":"2024-04-18T03:37:38.310074+0000","last_fullsized":"2024-04-18T03:37:38.310074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.696418+0000","last_change":"2024-04-18T03:37:34.299168+0000","last_active":"2024-04-18T03:37:38.696418+0000","last_peered":"2024-04-18T03:37:38.696418+0000","last_clean":"2024-04-18T03:37:38.696418+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:37:38.696418+0000","last_undegraded":"2024-04-18T03:37:38.696418+0000","last_fullsized":"2024-04-18T03:37:38.696418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:43.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785277+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:37:38.785277+0000","last_peered":"2024-04-18T03:37:38.785277+0000","last_clean":"2024-04-18T03:37:38.785277+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:37:38.785277+0000","last_undegraded":"2024-04-18T03:37:38.785277+0000","last_fullsized":"2024-04-18T03:37:38.785277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.785299+0000","last_change":"2024-04-18T03:37:34.302785+0000","last_active":"2024-04-18T03:37:38.785299+0000","last_peered":"2024-04-18T03:37:38.785299+0000","last_clean":"2024-04-18T03:37:38.785299+0000","last_became_active":"2024-04-18T03:37:34.302502+0000","last_became_peered":"2024-04-18T03:37:34.302502+0000","last_unstale":"2024-04-18T03:37:38.785299+0000","last_undegraded":"2024-04-18T03:37:38.785299+0000","last_fullsized":"2024-04-18T03:37:38.785299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548581+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:37:38.548581+0000","last_peered":"2024-04-18T03:37:38.548581+0000","last_clean":"2024-04-18T03:37:38.548581+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:37:38.548581+0000","last_undegraded":"2024-04-18T03:37:38.548581+0000","last_fullsized":"2024-04-18T03:37:38.548581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.309559+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:37:38.309559+0000","last_peered":"2024-04-18T03:37:38.309559+0000","last_clean":"2024-04-18T03:37:38.309559+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:37:38.309559+0000","last_undegraded":"2024-04-18T03:37:38.309559+0000","last_fullsized":"2024-04-18T03:37:38.309559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548317+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:37:38.548317+0000","last_peered":"2024-04-18T03:37:38.548317+0000","last_clean":"2024-04-18T03:37:38.548317+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:37:38.548317+0000","last_undegraded":"2024-04-18T03:37:38.548317+0000","last_fullsized":"2024-04-18T03:37:38.548317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317480+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:37:38.317480+0000","last_peered":"2024-04-18T03:37:38.317480+0000","last_clean":"2024-04-18T03:37:38.317480+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:37:38.317480+0000","last_undegraded":"2024-04-18T03:37:38.317480+0000","last_fullsized":"2024-04-18T03:37:38.317480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.546732+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:37:38.546732+0000","last_peered":"2024-04-18T03:37:38.546732+0000","last_clean":"2024-04-18T03:37:38.546732+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:37:38.546732+0000","last_undegraded":"2024-04-18T03:37:38.546732+0000","last_fullsized":"2024-04-18T03:37:38.546732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.317122+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:37:38.317122+0000","last_peered":"2024-04-18T03:37:38.317122+0000","last_clean":"2024-04-18T03:37:38.317122+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:37:38.317122+0000","last_undegraded":"2024-04-18T03:37:38.317122+0000","last_fullsized":"2024-04-18T03:37:38.317122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.321085+0000","last_change":"2024-04-18T03:37:34.300927+0000","last_active":"2024-04-18T03:37:38.321085+0000","last_peered":"2024-04-18T03:37:38.321085+0000","last_clean":"2024-04-18T03:37:38.321085+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:37:38.321085+0000","last_undegraded":"2024-04-18T03:37:38.321085+0000","last_fullsized":"2024-04-18T03:37:38.321085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.335417+0000","last_change":"2024-04-18T03:37:34.289446+0000","last_active":"2024-04-18T03:37:38.335417+0000","last_peered":"2024-04-18T03:37:38.335417+0000","last_clean":"2024-04-18T03:37:38.335417+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:37:38.335417+0000","last_undegraded":"2024-04-18T03:37:38.335417+0000","last_fullsized":"2024-04-18T03:37:38.335417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-18T03:37:38.548415+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:37:38.548415+0000","last_peered":"2024-04-18T03:37:38.548415+0000","last_clean":"2024-04-18T03:37:38.548415+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:37:38.548415+0000","last_undegraded":"2024-04-18T03:37:38.548415+0000","last_fullsized":"2024-04-18T03:37:38.548415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:49.338554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":101805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":693243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":102383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":270336,"data_stored":106089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":102293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":266240,"data_stored":102453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":860160,"data_stored":691632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:37:55.829 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T03:37:55.829 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T03:37:55.829 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T03:37:55.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T03:37:55.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cbfff700 1 Processor -- start 2024-04-18T03:37:55.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cbfff700 1 -- start start 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cbfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59cc1597f0 0x7f59cc0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cbfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f59cc0cdab0 0x7f59cc0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cbfff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59cc0cbbd0 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cbfff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc0701a0 con 0x7f59cc0cdab0 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cbfff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc0cc530 con 0x7f59cc1597f0 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f59cc0cdab0 0x7f59cc0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f59cc0cdab0 0x7f59cc0cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56978/0 (socket says 172.21.15.157:56978) 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59cb7fe700 1 -- 172.21.15.157:0/1655806220 learned_addr learned my addr 172.21.15.157:0/1655806220 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:55.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.931+0000 7f59caffd700 1 --2- 172.21.15.157:0/1655806220 >> v2:172.21.15.175:3300/0 conn(0x7f59cc1597f0 0x7f59cc0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cb7fe700 1 -- 172.21.15.157:0/1655806220 >> v2:172.21.15.175:3300/0 conn(0x7f59cc1597f0 msgr2=0x7f59cc0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cb7fe700 1 --2- 172.21.15.157:0/1655806220 >> v2:172.21.15.175:3300/0 conn(0x7f59cc1597f0 0x7f59cc0cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cb7fe700 1 -- 172.21.15.157:0/1655806220 >> v1:172.21.15.175:6789/0 conn(0x7f59cc0cc0a0 legacy=0x7f59cc159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cb7fe700 1 -- 172.21.15.157:0/1655806220 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc070440 con 0x7f59cc0cdab0 2024-04-18T03:37:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cb7fe700 1 --2- 172.21.15.157:0/1655806220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cdab0 0x7f59cc0cdf40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f59cc071c40 tx=0x7f59c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3815a30f4b6a03 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59c9ffb700 1 -- 172.21.15.157:0/1655806220 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400e070 con 0x7f59cc0cdab0 2024-04-18T03:37:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59c9ffb700 1 -- 172.21.15.157:0/1655806220 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c400b9c0 con 0x7f59cc0cdab0 2024-04-18T03:37:55.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59c9ffb700 1 -- 172.21.15.157:0/1655806220 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400bd70 con 0x7f59cc0cdab0 2024-04-18T03:37:55.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 -- 172.21.15.157:0/1655806220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cdab0 msgr2=0x7f59cc0cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 --2- 172.21.15.157:0/1655806220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cdab0 0x7f59cc0cdf40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f59cc071c40 tx=0x7f59c400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:55.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 -- 172.21.15.157:0/1655806220 shutdown_connections 2024-04-18T03:37:55.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 --2- 172.21.15.157:0/1655806220 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cdab0 0x7f59cc0cdf40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 --2- 172.21.15.157:0/1655806220 >> v2:172.21.15.175:3300/0 conn(0x7f59cc1597f0 0x7f59cc0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 -- 172.21.15.157:0/1655806220 >> 172.21.15.157:0/1655806220 conn(0x7f59cc0b1330 msgr2=0x7f59cc06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:55.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 -- 172.21.15.157:0/1655806220 shutdown_connections 2024-04-18T03:37:55.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 -- 172.21.15.157:0/1655806220 wait complete. 2024-04-18T03:37:55.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 Processor -- start 2024-04-18T03:37:55.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.935+0000 7f59cbfff700 1 -- start start 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cc0a0 0x7f59cc0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59cc0cdab0 0x7f59cc1f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59cc1597f0 0x7f59cc1f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cbfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc1531e0 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cbfff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc1525d0 con 0x7f59cc1597f0 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cbfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc1528b0 con 0x7f59cc0cdab0 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cc0a0 0x7f59cc0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cc0a0 0x7f59cc0aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56984/0 (socket says 172.21.15.157:56984) 2024-04-18T03:37:55.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 -- 172.21.15.157:0/3816433993 learned_addr learned my addr 172.21.15.157:0/3816433993 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59ca7fc700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59cc0cdab0 0x7f59cc1f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cb7fe700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59cc1597f0 0x7f59cc1f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 -- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59cc0cdab0 msgr2=0x7f59cc1f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59cc0cdab0 0x7f59cc1f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 -- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59cc1597f0 msgr2=0x7f59cc1f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59cc1597f0 0x7f59cc1f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 -- 172.21.15.157:0/3816433993 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4009b30 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cb7fe700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59cc1597f0 0x7f59cc1f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59caffd700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cc0a0 0x7f59cc0aea40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00e760 tx=0x7f59bc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59b37fe700 1 -- 172.21.15.157:0/3816433993 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc013610 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59b37fe700 1 -- 172.21.15.157:0/3816433993 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc013770 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc152b90 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59b37fe700 1 -- 172.21.15.157:0/3816433993 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc013ae0 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.939+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc14d340 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.943+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc04e650 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.943+0000 7f59b37fe700 1 -- 172.21.15.157:0/3816433993 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59bc013c40 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.943+0000 7f59b37fe700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f59b8066730 0x7f59b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:55.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.943+0000 7f59b37fe700 1 -- 172.21.15.157:0/3816433993 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59bc084040 con 0x7f59cc0cc0a0 2024-04-18T03:37:55.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.943+0000 7f59ca7fc700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f59b8066730 0x7f59b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:55.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.943+0000 7f59ca7fc700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f59b8066730 0x7f59b8068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0b0420 tx=0x7f59c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:55.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:55.947+0000 7f59b37fe700 1 -- 172.21.15.157:0/3816433993 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f59bc0510c0 con 0x7f59cc0cc0a0 2024-04-18T03:37:56.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.139+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f59cc072f10 con 0x7f59cc0cc0a0 2024-04-18T03:37:56.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.139+0000 7f59b37fe700 1 -- 172.21.15.157:0/3816433993 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f59bc021040 con 0x7f59cc0cc0a0 2024-04-18T03:37:56.141 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:56.141 INFO:teuthology.orchestra.run.smithi157.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T03:37:56.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f59b8066730 msgr2=0x7f59b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f59b8066730 0x7f59b8068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0b0420 tx=0x7f59c0009040 comp rx=0 tx=0).stop 2024-04-18T03:37:56.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cc0a0 msgr2=0x7f59cc0aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cc0a0 0x7f59cc0aea40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00e760 tx=0x7f59bc00ea70 comp rx=0 tx=0).stop 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 shutdown_connections 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f59b8066730 0x7f59b8068bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59cc1597f0 0x7f59cc1f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59cc0cdab0 0x7f59cc1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 --2- 172.21.15.157:0/3816433993 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59cc0cc0a0 0x7f59cc0aea40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 >> 172.21.15.157:0/3816433993 conn(0x7f59cc0b1330 msgr2=0x7f59cc159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 shutdown_connections 2024-04-18T03:37:56.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.143+0000 7f59cbfff700 1 -- 172.21.15.157:0/3816433993 wait complete. 2024-04-18T03:37:56.161 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T03:37:56.161 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:56.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2ef91700 1 Processor -- start 2024-04-18T03:37:56.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2ef91700 1 -- start start 2024-04-18T03:37:56.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2ef91700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fde2806e810 0x7fde28141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2ef91700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde28142300 con 0x7fde2815b590 2024-04-18T03:37:56.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2ef91700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde281425e0 con 0x7fde281445a0 2024-04-18T03:37:56.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2ef91700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde28142f80 con 0x7fde2806e810 2024-04-18T03:37:56.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2d78e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fde2815b590 0x7fde2806ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36732/0 (socket says 172.21.15.157:36732) 2024-04-18T03:37:56.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2d78e700 1 -- 172.21.15.157:0/1836483449 learned_addr learned my addr 172.21.15.157:0/1836483449 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:56.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.263+0000 7fde2df8f700 1 --2- 172.21.15.157:0/1836483449 >> v2:172.21.15.157:3300/0 conn(0x7fde2806e810 0x7fde28141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2cf8d700 1 -- 172.21.15.157:0/1836483449 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325738536 0 0) 0x7fde28142300 con 0x7fde2815b590 2024-04-18T03:37:56.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2cf8d700 1 -- 172.21.15.157:0/1836483449 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde140035d0 con 0x7fde2815b590 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2df8f700 1 -- 172.21.15.157:0/1836483449 >> v1:172.21.15.175:6789/0 conn(0x7fde281445a0 legacy=0x7fde281433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2df8f700 1 -- 172.21.15.157:0/1836483449 >> v1:172.21.15.157:6789/0 conn(0x7fde2815b590 legacy=0x7fde2806ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2df8f700 1 -- 172.21.15.157:0/1836483449 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde281428c0 con 0x7fde2806e810 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2df8f700 1 --2- 172.21.15.157:0/1836483449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde28141c00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fde24009850 tx=0x7fde24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f2cb73824e53c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2cf8d700 1 -- 172.21.15.157:0/1836483449 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde24011830 con 0x7fde2806e810 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2cf8d700 1 -- 172.21.15.157:0/1836483449 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde24011990 con 0x7fde2806e810 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2cf8d700 1 -- 172.21.15.157:0/1836483449 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde24011d00 con 0x7fde2806e810 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 -- 172.21.15.157:0/1836483449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 msgr2=0x7fde28141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 --2- 172.21.15.157:0/1836483449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde28141c00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fde24009850 tx=0x7fde24009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 -- 172.21.15.157:0/1836483449 shutdown_connections 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 --2- 172.21.15.157:0/1836483449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde28141c00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 -- 172.21.15.157:0/1836483449 >> 172.21.15.157:0/1836483449 conn(0x7fde280b1330 msgr2=0x7fde2806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 -- 172.21.15.157:0/1836483449 shutdown_connections 2024-04-18T03:37:56.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 -- 172.21.15.157:0/1836483449 wait complete. 2024-04-18T03:37:56.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 Processor -- start 2024-04-18T03:37:56.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.267+0000 7fde2ef91700 1 -- start start 2024-04-18T03:37:56.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde2813bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde281445a0 0x7fde2813dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2815b590 0x7fde28158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2813cb20 con 0x7fde2806e810 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde281e31f0 con 0x7fde281445a0 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2813e510 con 0x7fde2815b590 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde2813bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde2813bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:56988/0 (socket says 172.21.15.157:56988) 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 -- 172.21.15.157:0/4124617954 learned_addr learned my addr 172.21.15.157:0/4124617954 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2e790700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2815b590 0x7fde28158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2d78e700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde281445a0 0x7fde2813dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 -- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2815b590 msgr2=0x7fde28158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2815b590 0x7fde28158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 -- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde281445a0 msgr2=0x7fde2813dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde281445a0 0x7fde2813dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 -- 172.21.15.157:0/4124617954 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240094b0 con 0x7fde2806e810 2024-04-18T03:37:56.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2d78e700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde281445a0 0x7fde2813dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:56.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2df8f700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde2813bbf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde24009ba0 tx=0x7fde24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde1e7fc700 1 -- 172.21.15.157:0/4124617954 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde240036c0 con 0x7fde2806e810 2024-04-18T03:37:56.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde1e7fc700 1 -- 172.21.15.157:0/4124617954 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2401f070 con 0x7fde2806e810 2024-04-18T03:37:56.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde1e7fc700 1 -- 172.21.15.157:0/4124617954 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde24003a80 con 0x7fde2806e810 2024-04-18T03:37:56.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2813c280 con 0x7fde2806e810 2024-04-18T03:37:56.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2813c840 con 0x7fde2806e810 2024-04-18T03:37:56.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde280676b0 con 0x7fde2806e810 2024-04-18T03:37:56.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde1e7fc700 1 -- 172.21.15.157:0/4124617954 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fde24003be0 con 0x7fde2806e810 2024-04-18T03:37:56.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde1e7fc700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fde0c066730 0x7fde0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.271+0000 7fde1e7fc700 1 -- 172.21.15.157:0/4124617954 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde24021070 con 0x7fde2806e810 2024-04-18T03:37:56.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.275+0000 7fde2d78e700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fde0c066730 0x7fde0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.275+0000 7fde2d78e700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fde0c066730 0x7fde0c068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde281e5e30 tx=0x7fde18009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.279+0000 7fde1e7fc700 1 -- 172.21.15.157:0/4124617954 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fde24052e20 con 0x7fde2806e810 2024-04-18T03:37:56.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.439+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde2804e650 con 0x7fde2806e810 2024-04-18T03:37:56.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.439+0000 7fde1e7fc700 1 -- 172.21.15.157:0/4124617954 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fde2402b090 con 0x7fde2806e810 2024-04-18T03:37:56.444 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:56.444 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:56.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fde0c066730 msgr2=0x7fde0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fde0c066730 0x7fde0c068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde281e5e30 tx=0x7fde18009040 comp rx=0 tx=0).stop 2024-04-18T03:37:56.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 msgr2=0x7fde2813bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde2813bbf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde24009ba0 tx=0x7fde24004770 comp rx=0 tx=0).stop 2024-04-18T03:37:56.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 shutdown_connections 2024-04-18T03:37:56.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fde0c066730 0x7fde0c068bf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde281445a0 0x7fde2813dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2815b590 0x7fde28158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 --2- 172.21.15.157:0/4124617954 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde2806e810 0x7fde2813bbf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 >> 172.21.15.157:0/4124617954 conn(0x7fde280b1330 msgr2=0x7fde2815d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:56.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 shutdown_connections 2024-04-18T03:37:56.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.443+0000 7fde2ef91700 1 -- 172.21.15.157:0/4124617954 wait complete. 2024-04-18T03:37:56.458 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:37:56.459 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:37:56.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.567+0000 7f2187fff700 1 Processor -- start 2024-04-18T03:37:56.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.567+0000 7f2187fff700 1 -- start start 2024-04-18T03:37:56.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.567+0000 7f2187fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f218806e070 0x7f218806e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.567+0000 7f2187fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21880b5f90 0x7f21880b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.567+0000 7f2187fff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218815e3c0 con 0x7f21881427f0 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.567+0000 7f2187fff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218815d5c0 con 0x7f21880b5f90 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.567+0000 7f2187fff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2188143720 con 0x7f218806e070 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21877fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21880b5f90 0x7f21880b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21867fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f21881427f0 0x7f2188143010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36744/0 (socket says 172.21.15.157:36744) 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21877fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f21880b5f90 0x7f21880b6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57000/0 (socket says 172.21.15.157:57000) 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21867fc700 1 -- 172.21.15.157:0/3319406499 learned_addr learned my addr 172.21.15.157:0/3319406499 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2186ffd700 1 --2- 172.21.15.157:0/3319406499 >> v2:172.21.15.175:3300/0 conn(0x7f218806e070 0x7f218806e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21877fe700 1 -- 172.21.15.157:0/3319406499 >> v2:172.21.15.175:3300/0 conn(0x7f218806e070 msgr2=0x7f218806e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21877fe700 1 --2- 172.21.15.157:0/3319406499 >> v2:172.21.15.175:3300/0 conn(0x7f218806e070 0x7f218806e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21877fe700 1 -- 172.21.15.157:0/3319406499 >> v1:172.21.15.157:6789/0 conn(0x7f21881427f0 legacy=0x7f2188143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21877fe700 1 -- 172.21.15.157:0/3319406499 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218806e990 con 0x7f21880b5f90 2024-04-18T03:37:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f21877fe700 1 --2- 172.21.15.157:0/3319406499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f21880b6400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2188071a50 tx=0x7f218000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53b10825c88f86f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2185ffb700 1 -- 172.21.15.157:0/3319406499 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218000e070 con 0x7f21880b5f90 2024-04-18T03:37:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2185ffb700 1 -- 172.21.15.157:0/3319406499 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218000bbd0 con 0x7f21880b5f90 2024-04-18T03:37:56.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2185ffb700 1 -- 172.21.15.157:0/3319406499 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180012430 con 0x7f21880b5f90 2024-04-18T03:37:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2187fff700 1 -- 172.21.15.157:0/3319406499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 msgr2=0x7f21880b6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2187fff700 1 --2- 172.21.15.157:0/3319406499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f21880b6400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2188071a50 tx=0x7f218000b330 comp rx=0 tx=0).stop 2024-04-18T03:37:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2187fff700 1 -- 172.21.15.157:0/3319406499 shutdown_connections 2024-04-18T03:37:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2187fff700 1 --2- 172.21.15.157:0/3319406499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f21880b6400 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2187fff700 1 --2- 172.21.15.157:0/3319406499 >> v2:172.21.15.175:3300/0 conn(0x7f218806e070 0x7f218806e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2187fff700 1 -- 172.21.15.157:0/3319406499 >> 172.21.15.157:0/3319406499 conn(0x7f21880d3240 msgr2=0x7f21880d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2187fff700 1 -- 172.21.15.157:0/3319406499 shutdown_connections 2024-04-18T03:37:56.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.571+0000 7f2187fff700 1 -- 172.21.15.157:0/3319406499 wait complete. 2024-04-18T03:37:56.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2187fff700 1 Processor -- start 2024-04-18T03:37:56.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2187fff700 1 -- start start 2024-04-18T03:37:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2187fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f218806e070 0x7f218815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2187fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f2188156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2187fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21881427f0 0x7f218813dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2187fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188156fc0 con 0x7f21880b5f90 2024-04-18T03:37:56.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2187fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218815d140 con 0x7f21881427f0 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2187fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218815cb80 con 0x7f218806e070 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f21867fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f2188156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f21867fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f2188156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57010/0 (socket says 172.21.15.157:57010) 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f21867fc700 1 -- 172.21.15.157:0/2423090984 learned_addr learned my addr 172.21.15.157:0/2423090984 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f2186ffd700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f218806e070 0x7f218815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.575+0000 7f21877fe700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21881427f0 0x7f218813dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f21867fc700 1 -- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f218806e070 msgr2=0x7f218815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f21867fc700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f218806e070 0x7f218815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f21867fc700 1 -- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21881427f0 msgr2=0x7f218813dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f21867fc700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21881427f0 0x7f218813dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f21867fc700 1 -- 172.21.15.157:0/2423090984 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180009a70 con 0x7f21880b5f90 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f21867fc700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f2188156a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f217800c700 tx=0x7f217800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f217f7fe700 1 -- 172.21.15.157:0/2423090984 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178005d90 con 0x7f21880b5f90 2024-04-18T03:37:56.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f217f7fe700 1 -- 172.21.15.157:0/2423090984 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21780070d0 con 0x7f21880b5f90 2024-04-18T03:37:56.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218815ce60 con 0x7f21880b5f90 2024-04-18T03:37:56.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f217f7fe700 1 -- 172.21.15.157:0/2423090984 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178007440 con 0x7f21880b5f90 2024-04-18T03:37:56.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218815b590 con 0x7f21880b5f90 2024-04-18T03:37:56.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218804e650 con 0x7f21880b5f90 2024-04-18T03:37:56.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f217f7fe700 1 -- 172.21.15.157:0/2423090984 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21780075a0 con 0x7f21880b5f90 2024-04-18T03:37:56.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f217f7fe700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2168066730 0x7f2168068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f217f7fe700 1 -- 172.21.15.157:0/2423090984 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2178083730 con 0x7f21880b5f90 2024-04-18T03:37:56.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.579+0000 7f2186ffd700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2168066730 0x7f2168068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.583+0000 7f2186ffd700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2168066730 0x7f2168068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2170007a60 tx=0x7f2170008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.587+0000 7f217f7fe700 1 -- 172.21.15.157:0/2423090984 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f21780508f0 con 0x7f21880b5f90 2024-04-18T03:37:56.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f218806f380 con 0x7f21880b5f90 2024-04-18T03:37:56.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f217f7fe700 1 -- 172.21.15.157:0/2423090984 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2178053f10 con 0x7f21880b5f90 2024-04-18T03:37:56.746 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:37:56.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2168066730 msgr2=0x7f2168068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2168066730 0x7f2168068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2170007a60 tx=0x7f2170008040 comp rx=0 tx=0).stop 2024-04-18T03:37:56.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 msgr2=0x7f2188156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f2188156a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f217800c700 tx=0x7f217800ca10 comp rx=0 tx=0).stop 2024-04-18T03:37:56.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 shutdown_connections 2024-04-18T03:37:56.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2168066730 0x7f2168068bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21881427f0 0x7f218813dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21880b5f90 0x7f2188156a80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 --2- 172.21.15.157:0/2423090984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f218806e070 0x7f218815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 >> 172.21.15.157:0/2423090984 conn(0x7f21880d3240 msgr2=0x7f21880d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:56.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 shutdown_connections 2024-04-18T03:37:56.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.743+0000 7f2187fff700 1 -- 172.21.15.157:0/2423090984 wait complete. 2024-04-18T03:37:56.760 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:37:56.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c3416700 1 Processor -- start 2024-04-18T03:37:56.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c3416700 1 -- start start 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c3416700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4bc071080 0x7fb4bc071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c3416700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb4bc0d12b0 0x7fb4bc0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c3416700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0719a0 con 0x7fb4bc161660 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c3416700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc06a770 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c3416700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc06aa50 con 0x7fb4bc071080 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c2c15700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb4bc0d12b0 0x7fb4bc0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c2c15700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb4bc0d12b0 0x7fb4bc0d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57022/0 (socket says 172.21.15.157:57022) 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c2c15700 1 -- 172.21.15.157:0/1907444240 learned_addr learned my addr 172.21.15.157:0/1907444240 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c2c15700 1 -- 172.21.15.157:0/1907444240 >> v2:172.21.15.175:3300/0 conn(0x7fb4bc071080 msgr2=0x7fb4bc071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:56.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c2c15700 1 --2- 172.21.15.157:0/1907444240 >> v2:172.21.15.175:3300/0 conn(0x7fb4bc071080 0x7fb4bc071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c2c15700 1 -- 172.21.15.157:0/1907444240 >> v1:172.21.15.175:6789/0 conn(0x7fb4bc161660 legacy=0x7fb4bc06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:56.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.871+0000 7fb4c2c15700 1 -- 172.21.15.157:0/1907444240 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc06ad30 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c2c15700 1 --2- 172.21.15.157:0/1907444240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc0d1740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0cff60 tx=0x7fb4b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322fd0c579a8205e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c1412700 1 -- 172.21.15.157:0/1907444240 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400e070 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c1412700 1 -- 172.21.15.157:0/1907444240 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b4003a40 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c1412700 1 -- 172.21.15.157:0/1907444240 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4003df0 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c3416700 1 -- 172.21.15.157:0/1907444240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 msgr2=0x7fb4bc0d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c3416700 1 --2- 172.21.15.157:0/1907444240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc0d1740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0cff60 tx=0x7fb4b400b330 comp rx=0 tx=0).stop 2024-04-18T03:37:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c3416700 1 -- 172.21.15.157:0/1907444240 shutdown_connections 2024-04-18T03:37:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c3416700 1 --2- 172.21.15.157:0/1907444240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc0d1740 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c3416700 1 --2- 172.21.15.157:0/1907444240 >> v2:172.21.15.175:3300/0 conn(0x7fb4bc071080 0x7fb4bc071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c3416700 1 -- 172.21.15.157:0/1907444240 >> 172.21.15.157:0/1907444240 conn(0x7fb4bc06e020 msgr2=0x7fb4bc06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c3416700 1 -- 172.21.15.157:0/1907444240 shutdown_connections 2024-04-18T03:37:56.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.875+0000 7fb4c3416700 1 -- 172.21.15.157:0/1907444240 wait complete. 2024-04-18T03:37:56.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c3416700 1 Processor -- start 2024-04-18T03:37:56.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c3416700 1 -- start start 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c3416700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc071080 0x7fb4bc139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c3416700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc13a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c3416700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4bc161660 0x7fb4bc159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c3416700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc13b2b0 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c3416700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc13b590 con 0x7fb4bc071080 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c3416700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc13b870 con 0x7fb4bc161660 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc13a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc13a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57034/0 (socket says 172.21.15.157:57034) 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 -- 172.21.15.157:0/3254861356 learned_addr learned my addr 172.21.15.157:0/3254861356 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c2414700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc071080 0x7fb4bc139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c2c15700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4bc161660 0x7fb4bc159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 -- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4bc161660 msgr2=0x7fb4bc159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4bc161660 0x7fb4bc159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 -- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc071080 msgr2=0x7fb4bc139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc071080 0x7fb4bc139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 -- 172.21.15.157:0/3254861356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b4009b30 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c2414700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc071080 0x7fb4bc139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4c1c13700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc13a7f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800b4a0 tx=0x7fb4b800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.879+0000 7fb4b2ffd700 1 -- 172.21.15.157:0/3254861356 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8011830 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4b2ffd700 1 -- 172.21.15.157:0/3254861356 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b8011990 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc13bb50 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4b2ffd700 1 -- 172.21.15.157:0/3254861356 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8011d40 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc0b4420 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc13c070 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4b2ffd700 1 -- 172.21.15.157:0/3254861356 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4b801a400 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4b2ffd700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb4a0066730 0x7fb4a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:56.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4b2ffd700 1 -- 172.21.15.157:0/3254861356 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb4b80841d0 con 0x7fb4bc0d12b0 2024-04-18T03:37:56.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.883+0000 7fb4c2414700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb4a0066730 0x7fb4a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:56.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.887+0000 7fb4c2414700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb4a0066730 0x7fb4a0068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0099f0 tx=0x7fb4ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:56.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:56.891+0000 7fb4b2ffd700 1 -- 172.21.15.157:0/3254861356 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb4bc13c070 con 0x7fb4bc0d12b0 2024-04-18T03:37:57.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.043+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4bc13c070 con 0x7fb4bc0d12b0 2024-04-18T03:37:57.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.043+0000 7fb4b2ffd700 1 -- 172.21.15.157:0/3254861356 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4bc13c070 con 0x7fb4bc0d12b0 2024-04-18T03:37:57.048 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb4a0066730 msgr2=0x7fb4a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb4a0066730 0x7fb4a0068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0099f0 tx=0x7fb4ac008040 comp rx=0 tx=0).stop 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 msgr2=0x7fb4bc13a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc13a7f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800b4a0 tx=0x7fb4b800b860 comp rx=0 tx=0).stop 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 shutdown_connections 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb4a0066730 0x7fb4a0068bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4bc161660 0x7fb4bc159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb4bc0d12b0 0x7fb4bc13a7f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 --2- 172.21.15.157:0/3254861356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc071080 0x7fb4bc139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 >> 172.21.15.157:0/3254861356 conn(0x7fb4bc06e020 msgr2=0x7fb4bc0cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 shutdown_connections 2024-04-18T03:37:57.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.047+0000 7fb4c3416700 1 -- 172.21.15.157:0/3254861356 wait complete. 2024-04-18T03:37:57.062 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:37:57.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.175+0000 7fbf31047700 1 Processor -- start 2024-04-18T03:37:57.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.175+0000 7fbf31047700 1 -- start start 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf2c143500 0x7fbf2c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c0b2690 con 0x7fbf2c06e810 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c0ad530 con 0x7fbf2c143500 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c15dcb0 con 0x7fbf2c0ab8c0 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2b7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2bfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf2c143500 0x7fbf2c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf30846700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbf2c06e810 0x7fbf2c0ad9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:56550/0 (socket says 172.21.15.157:56550) 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf30846700 1 -- 172.21.15.157:0/1106139627 learned_addr learned my addr 172.21.15.157:0/1106139627 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:57.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2b7fe700 1 --2- 172.21.15.157:0/1106139627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c0abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60996/0 (socket says 172.21.15.157:60996) 2024-04-18T03:37:57.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2affd700 1 -- 172.21.15.157:0/1106139627 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459973650 0 0) 0x7fbf2c0b2690 con 0x7fbf2c06e810 2024-04-18T03:37:57.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2affd700 1 -- 172.21.15.157:0/1106139627 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf140035d0 con 0x7fbf2c06e810 2024-04-18T03:37:57.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2b7fe700 1 -- 172.21.15.157:0/1106139627 >> v2:172.21.15.175:3300/0 conn(0x7fbf2c143500 msgr2=0x7fbf2c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:57.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2b7fe700 1 --2- 172.21.15.157:0/1106139627 >> v2:172.21.15.175:3300/0 conn(0x7fbf2c143500 0x7fbf2c0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2b7fe700 1 -- 172.21.15.157:0/1106139627 >> v1:172.21.15.175:6789/0 conn(0x7fbf2c06e810 legacy=0x7fbf2c0ad9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2b7fe700 1 -- 172.21.15.157:0/1106139627 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c15df90 con 0x7fbf2c0ab8c0 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2bfff700 1 --2- 172.21.15.157:0/1106139627 >> v2:172.21.15.175:3300/0 conn(0x7fbf2c143500 0x7fbf2c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2b7fe700 1 --2- 172.21.15.157:0/1106139627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c0abd40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009850 tx=0x7fbf1c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44e03be8277a564f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2affd700 1 -- 172.21.15.157:0/1106139627 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c011830 con 0x7fbf2c0ab8c0 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2affd700 1 -- 172.21.15.157:0/1106139627 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c011990 con 0x7fbf2c0ab8c0 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf2affd700 1 -- 172.21.15.157:0/1106139627 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c011d00 con 0x7fbf2c0ab8c0 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 -- 172.21.15.157:0/1106139627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 msgr2=0x7fbf2c0abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 --2- 172.21.15.157:0/1106139627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c0abd40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009850 tx=0x7fbf1c009b60 comp rx=0 tx=0).stop 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 -- 172.21.15.157:0/1106139627 shutdown_connections 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 --2- 172.21.15.157:0/1106139627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c0abd40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 --2- 172.21.15.157:0/1106139627 >> v2:172.21.15.175:3300/0 conn(0x7fbf2c143500 0x7fbf2c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 -- 172.21.15.157:0/1106139627 >> 172.21.15.157:0/1106139627 conn(0x7fbf2c0b12d0 msgr2=0x7fbf2c06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 -- 172.21.15.157:0/1106139627 shutdown_connections 2024-04-18T03:37:57.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.179+0000 7fbf31047700 1 -- 172.21.15.157:0/1106139627 wait complete. 2024-04-18T03:37:57.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf31047700 1 Processor -- start 2024-04-18T03:37:57.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf31047700 1 -- start start 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf31047700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf2c06e810 0x7fbf2c13b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf31047700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c1f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf31047700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c143500 0x7fbf2c070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf31047700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0ada90 con 0x7fbf2c06e810 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf31047700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0add70 con 0x7fbf2c143500 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf31047700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0ae050 con 0x7fbf2c0ab8c0 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf2c06e810 0x7fbf2c13b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf2c06e810 0x7fbf2c13b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57040/0 (socket says 172.21.15.157:57040) 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 -- 172.21.15.157:0/4118764206 learned_addr learned my addr 172.21.15.157:0/4118764206 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2b7fe700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c1f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf30846700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c143500 0x7fbf2c070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 -- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 msgr2=0x7fbf2c1f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c1f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 -- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c143500 msgr2=0x7fbf2c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c143500 0x7fbf2c070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 -- 172.21.15.157:0/4118764206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf200094b0 con 0x7fbf2c06e810 2024-04-18T03:37:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf30846700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c143500 0x7fbf2c070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:57.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf2bfff700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf2c06e810 0x7fbf2c13b610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000ebe0 tx=0x7fbf2000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.183+0000 7fbf28ff9700 1 -- 172.21.15.157:0/4118764206 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2000c850 con 0x7fbf2c06e810 2024-04-18T03:37:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.187+0000 7fbf28ff9700 1 -- 172.21.15.157:0/4118764206 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2000c9b0 con 0x7fbf2c06e810 2024-04-18T03:37:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.187+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c0094b0 con 0x7fbf2c06e810 2024-04-18T03:37:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.187+0000 7fbf28ff9700 1 -- 172.21.15.157:0/4118764206 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2000cd40 con 0x7fbf2c06e810 2024-04-18T03:37:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.187+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c0ae610 con 0x7fbf2c06e810 2024-04-18T03:37:57.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.187+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c04e650 con 0x7fbf2c06e810 2024-04-18T03:37:57.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.187+0000 7fbf28ff9700 1 -- 172.21.15.157:0/4118764206 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf20013470 con 0x7fbf2c06e810 2024-04-18T03:37:57.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.187+0000 7fbf28ff9700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbf18066760 0x7fbf18068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.191+0000 7fbf28ff9700 1 -- 172.21.15.157:0/4118764206 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf200845b0 con 0x7fbf2c06e810 2024-04-18T03:37:57.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.191+0000 7fbf2b7fe700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbf18066760 0x7fbf18068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.191+0000 7fbf2b7fe700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbf18066760 0x7fbf18068c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009850 tx=0x7fbf1c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.195+0000 7fbf28ff9700 1 -- 172.21.15.157:0/4118764206 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbf20051510 con 0x7fbf2c06e810 2024-04-18T03:37:57.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.347+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf2c0717f0 con 0x7fbf2c06e810 2024-04-18T03:37:57.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf28ff9700 1 -- 172.21.15.157:0/4118764206 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf2000cea0 con 0x7fbf2c06e810 2024-04-18T03:37:57.353 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:37:57.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbf18066760 msgr2=0x7fbf18068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbf18066760 0x7fbf18068c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009850 tx=0x7fbf1c008030 comp rx=0 tx=0).stop 2024-04-18T03:37:57.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf2c06e810 msgr2=0x7fbf2c13b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf2c06e810 0x7fbf2c13b610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000ebe0 tx=0x7fbf2000eef0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 shutdown_connections 2024-04-18T03:37:57.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbf18066760 0x7fbf18068c20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf2c143500 0x7fbf2c070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf2c0ab8c0 0x7fbf2c1f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 --2- 172.21.15.157:0/4118764206 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf2c06e810 0x7fbf2c13b610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 >> 172.21.15.157:0/4118764206 conn(0x7fbf2c0b12d0 msgr2=0x7fbf2c0ac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:57.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 shutdown_connections 2024-04-18T03:37:57.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.351+0000 7fbf31047700 1 -- 172.21.15.157:0/4118764206 wait complete. 2024-04-18T03:37:57.366 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:37:57.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b06fc8700 1 Processor -- start 2024-04-18T03:37:57.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b06fc8700 1 -- start start 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b06fc8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6b001414e0 0x7f6b000717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b06fc8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b0006e810 0x7f6b0006ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b06fc8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b00142f80 con 0x7f6b00141c00 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b06fc8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0006f170 con 0x7f6b0006e810 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b06fc8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b001418c0 con 0x7f6b001414e0 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b067c7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b0006e810 0x7f6b0006ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b067c7700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6b0006e810 0x7f6b0006ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57042/0 (socket says 172.21.15.157:57042) 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b067c7700 1 -- 172.21.15.157:0/1809723529 learned_addr learned my addr 172.21.15.157:0/1809723529 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b057c5700 1 --1- 172.21.15.157:0/1809723529 >> v1:172.21.15.157:6789/0 conn(0x7f6b00141c00 0x7f6b0015b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36760/0 (socket says 172.21.15.157:36760) 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b05fc6700 1 --2- 172.21.15.157:0/1809723529 >> v2:172.21.15.175:3300/0 conn(0x7f6b001414e0 0x7f6b000717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b067c7700 1 -- 172.21.15.157:0/1809723529 >> v2:172.21.15.175:3300/0 conn(0x7f6b001414e0 msgr2=0x7f6b000717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b067c7700 1 --2- 172.21.15.157:0/1809723529 >> v2:172.21.15.175:3300/0 conn(0x7f6b001414e0 0x7f6b000717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b067c7700 1 -- 172.21.15.157:0/1809723529 >> v1:172.21.15.157:6789/0 conn(0x7f6b00141c00 legacy=0x7f6b0015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b067c7700 1 -- 172.21.15.157:0/1809723529 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00142370 con 0x7f6b0006e810 2024-04-18T03:37:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b067c7700 1 --2- 172.21.15.157:0/1809723529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b0006ec30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b000b4160 tx=0x7f6af800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feea2e01053fe88d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b04fc4700 1 -- 172.21.15.157:0/1809723529 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800e070 con 0x7f6b0006e810 2024-04-18T03:37:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b04fc4700 1 -- 172.21.15.157:0/1809723529 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af800b9c0 con 0x7f6b0006e810 2024-04-18T03:37:57.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.479+0000 7f6b04fc4700 1 -- 172.21.15.157:0/1809723529 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800bd50 con 0x7f6b0006e810 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- 172.21.15.157:0/1809723529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 msgr2=0x7f6b0006ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/1809723529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b0006ec30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b000b4160 tx=0x7f6af800b330 comp rx=0 tx=0).stop 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- 172.21.15.157:0/1809723529 shutdown_connections 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/1809723529 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b0006ec30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/1809723529 >> v2:172.21.15.175:3300/0 conn(0x7f6b001414e0 0x7f6b000717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- 172.21.15.157:0/1809723529 >> 172.21.15.157:0/1809723529 conn(0x7f6b000b12d0 msgr2=0x7f6b0006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- 172.21.15.157:0/1809723529 shutdown_connections 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- 172.21.15.157:0/1809723529 wait complete. 2024-04-18T03:37:57.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 Processor -- start 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- start start 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b000ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b001414e0 0x7f6b0015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b00141c00 0x7f6b000adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0015aab0 con 0x7f6b0006e810 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000ac110 con 0x7f6b00141c00 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000ac3f0 con 0x7f6b001414e0 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b000ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b000ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57052/0 (socket says 172.21.15.157:57052) 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 -- 172.21.15.157:0/3656664106 learned_addr learned my addr 172.21.15.157:0/3656664106 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:57.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b067c7700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b00141c00 0x7f6b000adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b057c5700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b001414e0 0x7f6b0015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 -- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b001414e0 msgr2=0x7f6b0015a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b001414e0 0x7f6b0015a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 -- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b00141c00 msgr2=0x7f6b000adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b00141c00 0x7f6b000adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 -- 172.21.15.157:0/3656664106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af8009b30 con 0x7f6b0006e810 2024-04-18T03:37:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b05fc6700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b000ad1b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00d800 tx=0x7f6afc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6af67fc700 1 -- 172.21.15.157:0/3656664106 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0125f0 con 0x7f6b0006e810 2024-04-18T03:37:57.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b000ac6d0 con 0x7f6b0006e810 2024-04-18T03:37:57.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6af67fc700 1 -- 172.21.15.157:0/3656664106 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc012750 con 0x7f6b0006e810 2024-04-18T03:37:57.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.483+0000 7f6af67fc700 1 -- 172.21.15.157:0/3656664106 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc012ac0 con 0x7f6b0006e810 2024-04-18T03:37:57.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.487+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b000acc90 con 0x7f6b0006e810 2024-04-18T03:37:57.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.487+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0004e650 con 0x7f6b0006e810 2024-04-18T03:37:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.487+0000 7f6af67fc700 1 -- 172.21.15.157:0/3656664106 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6afc012c20 con 0x7f6b0006e810 2024-04-18T03:37:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.487+0000 7f6af67fc700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ae4066730 0x7f6ae4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.487+0000 7f6af67fc700 1 -- 172.21.15.157:0/3656664106 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6afc0844a0 con 0x7f6b0006e810 2024-04-18T03:37:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.487+0000 7f6b057c5700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ae4066730 0x7f6ae4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.487+0000 7f6b057c5700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ae4066730 0x7f6ae4068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b0004eec0 tx=0x7f6af0007ef0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.495+0000 7f6af67fc700 1 -- 172.21.15.157:0/3656664106 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6afc0514a0 con 0x7f6b0006e810 2024-04-18T03:37:57.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.647+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6b000cdc30 con 0x7f6b0006e810 2024-04-18T03:37:57.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6af67fc700 1 -- 172.21.15.157:0/3656664106 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6afc054ac0 con 0x7f6b0006e810 2024-04-18T03:37:57.652 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:37:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ae4066730 msgr2=0x7f6ae4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ae4066730 0x7f6ae4068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b0004eec0 tx=0x7f6af0007ef0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 msgr2=0x7f6b000ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b000ad1b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00d800 tx=0x7f6afc00db10 comp rx=0 tx=0).stop 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 shutdown_connections 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ae4066730 0x7f6ae4068bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b00141c00 0x7f6b000adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b001414e0 0x7f6b0015a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 --2- 172.21.15.157:0/3656664106 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6b0006e810 0x7f6b000ad1b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 >> 172.21.15.157:0/3656664106 conn(0x7f6b000b12d0 msgr2=0x7f6b0015b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 shutdown_connections 2024-04-18T03:37:57.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.651+0000 7f6b06fc8700 1 -- 172.21.15.157:0/3656664106 wait complete. 2024-04-18T03:37:57.671 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:37:57.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.771+0000 7fdffb59e700 1 Processor -- start 2024-04-18T03:37:57.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.771+0000 7fdffb59e700 1 -- start start 2024-04-18T03:37:57.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdffc14a360 0x7fdffc161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdffc06ef20 0x7fdffc0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc0b1c20 con 0x7fdffc0cdd20 2024-04-18T03:37:57.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc0b25c0 con 0x7fdffc06ef20 2024-04-18T03:37:57.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc0b1f00 con 0x7fdffc14a360 2024-04-18T03:37:57.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdffc06ef20 0x7fdffc0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdffc06ef20 0x7fdffc0ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57056/0 (socket says 172.21.15.157:57056) 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffad9d700 1 -- 172.21.15.157:0/530302513 learned_addr learned my addr 172.21.15.157:0/530302513 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffa59c700 1 --2- 172.21.15.157:0/530302513 >> v2:172.21.15.175:3300/0 conn(0x7fdffc14a360 0x7fdffc161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffad9d700 1 -- 172.21.15.157:0/530302513 >> v2:172.21.15.175:3300/0 conn(0x7fdffc14a360 msgr2=0x7fdffc161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffad9d700 1 --2- 172.21.15.157:0/530302513 >> v2:172.21.15.175:3300/0 conn(0x7fdffc14a360 0x7fdffc161ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffad9d700 1 -- 172.21.15.157:0/530302513 >> v1:172.21.15.175:6789/0 conn(0x7fdffc0cdd20 legacy=0x7fdffc06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffad9d700 1 -- 172.21.15.157:0/530302513 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0b21e0 con 0x7fdffc06ef20 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffad9d700 1 --2- 172.21.15.157:0/530302513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc0ce1b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdffc06bb60 tx=0x7fdfec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3799eadbd67fff server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdff959a700 1 -- 172.21.15.157:0/530302513 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec00b8a0 con 0x7fdffc06ef20 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdff959a700 1 -- 172.21.15.157:0/530302513 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec00ba00 con 0x7fdffc06ef20 2024-04-18T03:37:57.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdff959a700 1 -- 172.21.15.157:0/530302513 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec00bd90 con 0x7fdffc06ef20 2024-04-18T03:37:57.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 -- 172.21.15.157:0/530302513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 msgr2=0x7fdffc0ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 --2- 172.21.15.157:0/530302513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc0ce1b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdffc06bb60 tx=0x7fdfec009bf0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 -- 172.21.15.157:0/530302513 shutdown_connections 2024-04-18T03:37:57.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 --2- 172.21.15.157:0/530302513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc0ce1b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 --2- 172.21.15.157:0/530302513 >> v2:172.21.15.175:3300/0 conn(0x7fdffc14a360 0x7fdffc161ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 -- 172.21.15.157:0/530302513 >> 172.21.15.157:0/530302513 conn(0x7fdffc0b1330 msgr2=0x7fdffc06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:57.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 -- 172.21.15.157:0/530302513 shutdown_connections 2024-04-18T03:37:57.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.775+0000 7fdffb59e700 1 -- 172.21.15.157:0/530302513 wait complete. 2024-04-18T03:37:57.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 Processor -- start 2024-04-18T03:37:57.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 -- start start 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc0cdd20 0x7fdffc0a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdffc14a360 0x7fdffc146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc144510 con 0x7fdffc06ef20 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0a84b0 con 0x7fdffc0cdd20 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc1452a0 con 0x7fdffc14a360 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57062/0 (socket says 172.21.15.157:57062) 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 -- 172.21.15.157:0/1374706458 learned_addr learned my addr 172.21.15.157:0/1374706458 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:57.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdff9d9b700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc0cdd20 0x7fdffc0a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffad9d700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdffc14a360 0x7fdffc146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 -- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdffc14a360 msgr2=0x7fdffc146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdffc14a360 0x7fdffc146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 -- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc0cdd20 msgr2=0x7fdffc0a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc0cdd20 0x7fdffc0a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 -- 172.21.15.157:0/1374706458 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec009570 con 0x7fdffc06ef20 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffa59c700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc143fd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400d800 tx=0x7fdfe400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdff2ffd700 1 -- 172.21.15.157:0/1374706458 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40125f0 con 0x7fdffc06ef20 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc1621a0 con 0x7fdffc06ef20 2024-04-18T03:37:57.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc144ce0 con 0x7fdffc06ef20 2024-04-18T03:37:57.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdff2ffd700 1 -- 172.21.15.157:0/1374706458 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4012750 con 0x7fdffc06ef20 2024-04-18T03:37:57.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.779+0000 7fdff2ffd700 1 -- 172.21.15.157:0/1374706458 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4012ac0 con 0x7fdffc06ef20 2024-04-18T03:37:57.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.783+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc04e650 con 0x7fdffc06ef20 2024-04-18T03:37:57.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.783+0000 7fdff2ffd700 1 -- 172.21.15.157:0/1374706458 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfe4012c20 con 0x7fdffc06ef20 2024-04-18T03:37:57.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.783+0000 7fdff2ffd700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdfe0066730 0x7fdfe0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:57.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.783+0000 7fdff2ffd700 1 -- 172.21.15.157:0/1374706458 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdfe40845c0 con 0x7fdffc06ef20 2024-04-18T03:37:57.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.783+0000 7fdff9d9b700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdfe0066730 0x7fdfe0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:57.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.787+0000 7fdff9d9b700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdfe0066730 0x7fdfe0068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdffc070ec0 tx=0x7fdff4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:57.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.791+0000 7fdff2ffd700 1 -- 172.21.15.157:0/1374706458 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdfe4051650 con 0x7fdffc06ef20 2024-04-18T03:37:57.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.983+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdffc161340 con 0x7fdffc06ef20 2024-04-18T03:37:57.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.983+0000 7fdff2ffd700 1 -- 172.21.15.157:0/1374706458 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4742 (secure 0 0 0) 0x7fdfe4012ed0 con 0x7fdffc06ef20 2024-04-18T03:37:57.987 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:57.987 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T03:37:34.273529+0000","modified":"2024-04-18T03:37:50.365620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdfe0066730 msgr2=0x7fdfe0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdfe0066730 0x7fdfe0068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdffc070ec0 tx=0x7fdff4009040 comp rx=0 tx=0).stop 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 msgr2=0x7fdffc143fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc143fd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400d800 tx=0x7fdfe400db10 comp rx=0 tx=0).stop 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 shutdown_connections 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdfe0066730 0x7fdfe0068bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdffc0cdd20 0x7fdffc0a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdffc14a360 0x7fdffc146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 --2- 172.21.15.157:0/1374706458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdffc06ef20 0x7fdffc143fd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:57.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 >> 172.21.15.157:0/1374706458 conn(0x7fdffc0b1330 msgr2=0x7fdffc0b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:57.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 shutdown_connections 2024-04-18T03:37:57.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:57.987+0000 7fdffb59e700 1 -- 172.21.15.157:0/1374706458 wait complete. 2024-04-18T03:37:57.990 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 9 2024-04-18T03:37:58.000 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:37:58.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.103+0000 7fe215dde700 1 Processor -- start 2024-04-18T03:37:58.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.103+0000 7fe215dde700 1 -- start start 2024-04-18T03:37:58.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100adf00 0x7fe210071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2100716c0 0x7fe21015a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21015bf10 con 0x7fe21015aac0 2024-04-18T03:37:58.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21015b5c0 con 0x7fe2100716c0 2024-04-18T03:37:58.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe210071b40 con 0x7fe2100adf00 2024-04-18T03:37:58.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2100716c0 0x7fe21015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2100716c0 0x7fe21015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57068/0 (socket says 172.21.15.157:57068) 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20ffff700 1 -- 172.21.15.157:0/1462213671 learned_addr learned my addr 172.21.15.157:0/1462213671 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe214ddc700 1 --2- 172.21.15.157:0/1462213671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100adf00 0x7fe210071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20ffff700 1 -- 172.21.15.157:0/1462213671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100adf00 msgr2=0x7fe210071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20ffff700 1 --2- 172.21.15.157:0/1462213671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100adf00 0x7fe210071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20ffff700 1 -- 172.21.15.157:0/1462213671 >> v1:172.21.15.175:6789/0 conn(0x7fe21015aac0 legacy=0x7fe21015db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20ffff700 1 -- 172.21.15.157:0/1462213671 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100ae2e0 con 0x7fe2100716c0 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe214ddc700 1 --2- 172.21.15.157:0/1462213671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100adf00 0x7fe210071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20ffff700 1 --2- 172.21.15.157:0/1462213671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2100716c0 0x7fe21015a580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009e50 tx=0x7fe1f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425bcce7a864fc15 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20f7fe700 1 -- 172.21.15.157:0/1462213671 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f800e070 con 0x7fe2100716c0 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20f7fe700 1 -- 172.21.15.157:0/1462213671 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8003a40 con 0x7fe2100716c0 2024-04-18T03:37:58.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe20f7fe700 1 -- 172.21.15.157:0/1462213671 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8003df0 con 0x7fe2100716c0 2024-04-18T03:37:58.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 -- 172.21.15.157:0/1462213671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2100716c0 msgr2=0x7fe21015a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 --2- 172.21.15.157:0/1462213671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2100716c0 0x7fe21015a580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009e50 tx=0x7fe1f800b330 comp rx=0 tx=0).stop 2024-04-18T03:37:58.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 -- 172.21.15.157:0/1462213671 shutdown_connections 2024-04-18T03:37:58.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 --2- 172.21.15.157:0/1462213671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2100716c0 0x7fe21015a580 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 --2- 172.21.15.157:0/1462213671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100adf00 0x7fe210071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 -- 172.21.15.157:0/1462213671 >> 172.21.15.157:0/1462213671 conn(0x7fe2100b1330 msgr2=0x7fe21006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:58.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 -- 172.21.15.157:0/1462213671 shutdown_connections 2024-04-18T03:37:58.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.107+0000 7fe215dde700 1 -- 172.21.15.157:0/1462213671 wait complete. 2024-04-18T03:37:58.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.111+0000 7fe215dde700 1 Processor -- start 2024-04-18T03:37:58.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.111+0000 7fe215dde700 1 -- start start 2024-04-18T03:37:58.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.111+0000 7fe215dde700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100716c0 0x7fe21014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe215dde700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2100adf00 0x7fe21015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe215dde700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe21015aac0 0x7fe210147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe215dde700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21014df10 con 0x7fe21015aac0 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe215dde700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21014e1f0 con 0x7fe2100adf00 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe215dde700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21014e4d0 con 0x7fe2100716c0 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe21015aac0 0x7fe210147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe21015aac0 0x7fe210147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57070/0 (socket says 172.21.15.157:57070) 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 -- 172.21.15.157:0/3135981938 learned_addr learned my addr 172.21.15.157:0/3135981938 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe20ffff700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2100adf00 0x7fe21015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe214ddc700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100716c0 0x7fe21014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 -- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100716c0 msgr2=0x7fe21014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100716c0 0x7fe21014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 -- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2100adf00 msgr2=0x7fe21015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2100adf00 0x7fe21015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 -- 172.21.15.157:0/3135981938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8009b30 con 0x7fe21015aac0 2024-04-18T03:37:58.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe2155dd700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe21015aac0 0x7fe210147370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe20800c470 tx=0x7fe20800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe20d7fa700 1 -- 172.21.15.157:0/3135981938 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208011790 con 0x7fe21015aac0 2024-04-18T03:37:58.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe20d7fa700 1 -- 172.21.15.157:0/3135981938 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2080118f0 con 0x7fe21015aac0 2024-04-18T03:37:58.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21014e7b0 con 0x7fe21015aac0 2024-04-18T03:37:58.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe20d7fa700 1 -- 172.21.15.157:0/3135981938 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208011ca0 con 0x7fe21015aac0 2024-04-18T03:37:58.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21014b3a0 con 0x7fe21015aac0 2024-04-18T03:37:58.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2100cd370 con 0x7fe21015aac0 2024-04-18T03:37:58.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.115+0000 7fe20d7fa700 1 -- 172.21.15.157:0/3135981938 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe20801c460 con 0x7fe21015aac0 2024-04-18T03:37:58.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.119+0000 7fe20d7fa700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe1f0066730 0x7fe1f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.119+0000 7fe20d7fa700 1 -- 172.21.15.157:0/3135981938 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe208084120 con 0x7fe21015aac0 2024-04-18T03:37:58.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.119+0000 7fe214ddc700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe1f0066730 0x7fe1f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.119+0000 7fe214ddc700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe1f0066730 0x7fe1f0068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe20000ab60 tx=0x7fe200008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.127+0000 7fe20d7fa700 1 -- 172.21.15.157:0/3135981938 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe208051190 con 0x7fe21015aac0 2024-04-18T03:37:58.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.295+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe21004e650 con 0x7fe21015aac0 2024-04-18T03:37:58.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.299+0000 7fe20d7fa700 1 -- 172.21.15.157:0/3135981938 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fe2080547b0 con 0x7fe21015aac0 2024-04-18T03:37:58.303 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:58.303 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe1f0066730 msgr2=0x7fe1f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe1f0066730 0x7fe1f0068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe20000ab60 tx=0x7fe200008040 comp rx=0 tx=0).stop 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe21015aac0 msgr2=0x7fe210147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe21015aac0 0x7fe210147370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe20800c470 tx=0x7fe20800c780 comp rx=0 tx=0).stop 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 shutdown_connections 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe1f0066730 0x7fe1f0068bf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2100adf00 0x7fe21015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe21015aac0 0x7fe210147370 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 --2- 172.21.15.157:0/3135981938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2100716c0 0x7fe21014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 >> 172.21.15.157:0/3135981938 conn(0x7fe2100b1330 msgr2=0x7fe210159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 shutdown_connections 2024-04-18T03:37:58.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.303+0000 7fe215dde700 1 -- 172.21.15.157:0/3135981938 wait complete. 2024-04-18T03:37:58.320 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:37:58.321 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:37:58.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f89209ff700 1 Processor -- start 2024-04-18T03:37:58.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f89209ff700 1 -- start start 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f89209ff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c146170 0x7f891c146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f89209ff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f891c0b7600 0x7f891c06b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f89209ff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c146a90 con 0x7f891c06b850 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f89209ff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891c06bcc0 con 0x7f891c0b7600 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f89209ff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0d2980 con 0x7f891c146170 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f8919d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f891c0b7600 0x7f891c06b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f8919d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f891c0b7600 0x7f891c06b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57082/0 (socket says 172.21.15.157:57082) 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f8919d9b700 1 -- 172.21.15.157:0/1909618021 learned_addr learned my addr 172.21.15.157:0/1909618021 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f891a59c700 1 --2- 172.21.15.157:0/1909618021 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c146170 0x7f891c146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f8919d9b700 1 -- 172.21.15.157:0/1909618021 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c146170 msgr2=0x7f891c146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f8919d9b700 1 --2- 172.21.15.157:0/1909618021 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c146170 0x7f891c146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f8919d9b700 1 -- 172.21.15.157:0/1909618021 >> v1:172.21.15.157:6789/0 conn(0x7f891c06b850 legacy=0x7f891c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.431+0000 7f8919d9b700 1 -- 172.21.15.157:0/1909618021 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c0d2c60 con 0x7f891c0b7600 2024-04-18T03:37:58.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f8919d9b700 1 --2- 172.21.15.157:0/1909618021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c0b7600 0x7f891c06b310 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8910009910 tx=0x7f8910009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f2afb6be13d43a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891959a700 1 -- 172.21.15.157:0/1909618021 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910011830 con 0x7f891c0b7600 2024-04-18T03:37:58.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891959a700 1 -- 172.21.15.157:0/1909618021 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8910011990 con 0x7f891c0b7600 2024-04-18T03:37:58.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891959a700 1 -- 172.21.15.157:0/1909618021 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910011d40 con 0x7f891c0b7600 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- 172.21.15.157:0/1909618021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c0b7600 msgr2=0x7f891c06b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 --2- 172.21.15.157:0/1909618021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c0b7600 0x7f891c06b310 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8910009910 tx=0x7f8910009c20 comp rx=0 tx=0).stop 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- 172.21.15.157:0/1909618021 shutdown_connections 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 --2- 172.21.15.157:0/1909618021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c0b7600 0x7f891c06b310 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 --2- 172.21.15.157:0/1909618021 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c146170 0x7f891c146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- 172.21.15.157:0/1909618021 >> 172.21.15.157:0/1909618021 conn(0x7f891c0b4e00 msgr2=0x7f891c0b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- 172.21.15.157:0/1909618021 shutdown_connections 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- 172.21.15.157:0/1909618021 wait complete. 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 Processor -- start 2024-04-18T03:37:58.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- start start 2024-04-18T03:37:58.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c06b850 0x7f891c0c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c0b7600 0x7f891c0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c146170 0x7f891c1379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c131c70 con 0x7f891c06b850 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c131f10 con 0x7f891c146170 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f89209ff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c1321f0 con 0x7f891c0b7600 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c06b850 0x7f891c0c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c06b850 0x7f891c0c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57094/0 (socket says 172.21.15.157:57094) 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 -- 172.21.15.157:0/3780281533 learned_addr learned my addr 172.21.15.157:0/3780281533 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f8919d9b700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c0b7600 0x7f891c0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891ad9d700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c146170 0x7f891c1379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 -- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c0b7600 msgr2=0x7f891c0cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c0b7600 0x7f891c0cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 -- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c146170 msgr2=0x7f891c1379b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c146170 0x7f891c1379b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 -- 172.21.15.157:0/3780281533 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910009570 con 0x7f891c06b850 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f8919d9b700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c0b7600 0x7f891c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.435+0000 7f891a59c700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c06b850 0x7f891c0c9ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f890c00e840 tx=0x7f890c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.439+0000 7f890affd700 1 -- 172.21.15.157:0/3780281533 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0095a0 con 0x7f891c06b850 2024-04-18T03:37:58.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.439+0000 7f890affd700 1 -- 172.21.15.157:0/3780281533 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c00c690 con 0x7f891c06b850 2024-04-18T03:37:58.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.439+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c1324d0 con 0x7f891c06b850 2024-04-18T03:37:58.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.439+0000 7f890affd700 1 -- 172.21.15.157:0/3780281533 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c00ca00 con 0x7f891c06b850 2024-04-18T03:37:58.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.439+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c0cf480 con 0x7f891c06b850 2024-04-18T03:37:58.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.439+0000 7f890affd700 1 -- 172.21.15.157:0/3780281533 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f890c00cb60 con 0x7f891c06b850 2024-04-18T03:37:58.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.439+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891c04e6c0 con 0x7f891c06b850 2024-04-18T03:37:58.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.439+0000 7f890affd700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f88fc066760 0x7f88fc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.443+0000 7f890affd700 1 -- 172.21.15.157:0/3780281533 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f890c0844a0 con 0x7f891c06b850 2024-04-18T03:37:58.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.443+0000 7f8919d9b700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f88fc066760 0x7f88fc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.443+0000 7f8919d9b700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f88fc066760 0x7f88fc068c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8910009910 tx=0x7f8910008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.447+0000 7f890affd700 1 -- 172.21.15.157:0/3780281533 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f890c051480 con 0x7f891c06b850 2024-04-18T03:37:58.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f891c161420 con 0x7f891c06b850 2024-04-18T03:37:58.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f890affd700 1 -- 172.21.15.157:0/3780281533 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f890c054aa0 con 0x7f891c06b850 2024-04-18T03:37:58.621 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f88fc066760 msgr2=0x7f88fc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f88fc066760 0x7f88fc068c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8910009910 tx=0x7f8910008030 comp rx=0 tx=0).stop 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c06b850 msgr2=0x7f891c0c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c06b850 0x7f891c0c9ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f890c00e840 tx=0x7f890c00ec00 comp rx=0 tx=0).stop 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 shutdown_connections 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f88fc066760 0x7f88fc068c20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f891c146170 0x7f891c1379b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f891c0b7600 0x7f891c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 --2- 172.21.15.157:0/3780281533 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f891c06b850 0x7f891c0c9ab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 >> 172.21.15.157:0/3780281533 conn(0x7f891c0b4e00 msgr2=0x7f891c0d17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:58.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 shutdown_connections 2024-04-18T03:37:58.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.619+0000 7f89209ff700 1 -- 172.21.15.157:0/3780281533 wait complete. 2024-04-18T03:37:58.637 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:37:58.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.747+0000 7f8bbcb14700 1 Processor -- start 2024-04-18T03:37:58.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.747+0000 7f8bbcb14700 1 -- start start 2024-04-18T03:37:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.747+0000 7f8bbcb14700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb8159560 0x7f8bb80cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8bb80cb540 0x7f8bb80cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb815d3d0 con 0x7f8bb80cdff0 2024-04-18T03:37:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb815e190 con 0x7f8bb80cb540 2024-04-18T03:37:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb815d6b0 con 0x7f8bb8159560 2024-04-18T03:37:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb6ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8bb80cb540 0x7f8bb80cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb6ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8bb80cb540 0x7f8bb80cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57106/0 (socket says 172.21.15.157:57106) 2024-04-18T03:37:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb6ffd700 1 -- 172.21.15.157:0/3805940438 learned_addr learned my addr 172.21.15.157:0/3805940438 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb77fe700 1 --2- 172.21.15.157:0/3805940438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb8159560 0x7f8bb80cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb6ffd700 1 -- 172.21.15.157:0/3805940438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb8159560 msgr2=0x7f8bb80cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb6ffd700 1 --2- 172.21.15.157:0/3805940438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb8159560 0x7f8bb80cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb6ffd700 1 -- 172.21.15.157:0/3805940438 >> v1:172.21.15.175:6789/0 conn(0x7f8bb80cdff0 legacy=0x7f8bb80b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb6ffd700 1 -- 172.21.15.157:0/3805940438 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb815d990 con 0x7f8bb80cb540 2024-04-18T03:37:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb6ffd700 1 --2- 172.21.15.157:0/3805940438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb80cb540 0x7f8bb80cdab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009e50 tx=0x7f8ba800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c7ea5d2eb8a308 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb67fc700 1 -- 172.21.15.157:0/3805940438 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800e070 con 0x7f8bb80cb540 2024-04-18T03:37:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb67fc700 1 -- 172.21.15.157:0/3805940438 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba800b910 con 0x7f8bb80cb540 2024-04-18T03:37:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bb67fc700 1 -- 172.21.15.157:0/3805940438 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800bcc0 con 0x7f8bb80cb540 2024-04-18T03:37:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 -- 172.21.15.157:0/3805940438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb80cb540 msgr2=0x7f8bb80cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/3805940438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb80cb540 0x7f8bb80cdab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009e50 tx=0x7f8ba800b330 comp rx=0 tx=0).stop 2024-04-18T03:37:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 -- 172.21.15.157:0/3805940438 shutdown_connections 2024-04-18T03:37:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/3805940438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb80cb540 0x7f8bb80cdab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/3805940438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb8159560 0x7f8bb80cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 -- 172.21.15.157:0/3805940438 >> 172.21.15.157:0/3805940438 conn(0x7f8bb80b12d0 msgr2=0x7f8bb806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:58.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 -- 172.21.15.157:0/3805940438 shutdown_connections 2024-04-18T03:37:58.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.751+0000 7f8bbcb14700 1 -- 172.21.15.157:0/3805940438 wait complete. 2024-04-18T03:37:58.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 Processor -- start 2024-04-18T03:37:58.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 -- start start 2024-04-18T03:37:58.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb80cb540 0x7f8bb8147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb80cdff0 0x7f8bb8144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8159560 0x7f8bb806e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8145710 con 0x7f8bb8159560 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb815b540 con 0x7f8bb80cdff0 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb806eec0 con 0x7f8bb80cb540 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8159560 0x7f8bb806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8159560 0x7f8bb806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57118/0 (socket says 172.21.15.157:57118) 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 -- 172.21.15.157:0/384723092 learned_addr learned my addr 172.21.15.157:0/384723092 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb77fe700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb80cb540 0x7f8bb8147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb6ffd700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb80cdff0 0x7f8bb8144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 -- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb80cb540 msgr2=0x7f8bb8147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb80cb540 0x7f8bb8147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 -- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb80cdff0 msgr2=0x7f8bb8144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb80cdff0 0x7f8bb8144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 -- 172.21.15.157:0/384723092 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8009b30 con 0x7f8bb8159560 2024-04-18T03:37:58.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bb7fff700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8159560 0x7f8bb806e980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000c490 tx=0x7f8bb000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8b9ffff700 1 -- 172.21.15.157:0/384723092 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00052d0 con 0x7f8bb8159560 2024-04-18T03:37:58.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8b9ffff700 1 -- 172.21.15.157:0/384723092 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb0005430 con 0x7f8bb8159560 2024-04-18T03:37:58.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8b9ffff700 1 -- 172.21.15.157:0/384723092 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00055a0 con 0x7f8bb8159560 2024-04-18T03:37:58.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb8147c80 con 0x7f8bb8159560 2024-04-18T03:37:58.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.755+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb8148240 con 0x7f8bb8159560 2024-04-18T03:37:58.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.759+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb8145880 con 0x7f8bb8159560 2024-04-18T03:37:58.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.759+0000 7f8b9ffff700 1 -- 172.21.15.157:0/384723092 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8bb00038e0 con 0x7f8bb8159560 2024-04-18T03:37:58.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.759+0000 7f8b9ffff700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8ba4066730 0x7f8ba4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:58.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.759+0000 7f8b9ffff700 1 -- 172.21.15.157:0/384723092 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8bb0083810 con 0x7f8bb8159560 2024-04-18T03:37:58.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.759+0000 7f8bb77fe700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8ba4066730 0x7f8ba4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:58.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.759+0000 7f8bb77fe700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8ba4066730 0x7f8ba4068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009ae0 tx=0x7f8bac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:58.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.767+0000 7f8b9ffff700 1 -- 172.21.15.157:0/384723092 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8bb8145880 con 0x7f8bb8159560 2024-04-18T03:37:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.931+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bb8145850 con 0x7f8bb8159560 2024-04-18T03:37:58.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.931+0000 7f8b9ffff700 1 -- 172.21.15.157:0/384723092 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8bb0050890 con 0x7f8bb8159560 2024-04-18T03:37:58.936 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:37:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8ba4066730 msgr2=0x7f8ba4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8ba4066730 0x7f8ba4068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009ae0 tx=0x7f8bac008040 comp rx=0 tx=0).stop 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8159560 msgr2=0x7f8bb806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8159560 0x7f8bb806e980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000c490 tx=0x7f8bb000c850 comp rx=0 tx=0).stop 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 shutdown_connections 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8ba4066730 0x7f8ba4068bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb80cdff0 0x7f8bb8144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bb8159560 0x7f8bb806e980 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 --2- 172.21.15.157:0/384723092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bb80cb540 0x7f8bb8147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 >> 172.21.15.157:0/384723092 conn(0x7f8bb80b12d0 msgr2=0x7f8bb8158820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 shutdown_connections 2024-04-18T03:37:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:58.935+0000 7f8bbcb14700 1 -- 172.21.15.157:0/384723092 wait complete. 2024-04-18T03:37:58.951 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:37:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.067+0000 7fab8f4e8700 1 Processor -- start 2024-04-18T03:37:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.067+0000 7fab8f4e8700 1 -- start start 2024-04-18T03:37:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab880b1c80 0x7fab88071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab880b0c80 con 0x7fab880aeea0 2024-04-18T03:37:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab880b17a0 con 0x7fab880b1c80 2024-04-18T03:37:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8815c2f0 con 0x7fab880aeac0 2024-04-18T03:37:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8da85700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fab880aeea0 0x7fab880b4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36778/0 (socket says 172.21.15.157:36778) 2024-04-18T03:37:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8da85700 1 -- 172.21.15.157:0/3099799052 learned_addr learned my addr 172.21.15.157:0/3099799052 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8d284700 1 --2- 172.21.15.157:0/3099799052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8ca83700 1 --2- 172.21.15.157:0/3099799052 >> v2:172.21.15.175:3300/0 conn(0x7fab880b1c80 0x7fab88071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab7ffff700 1 -- 172.21.15.157:0/3099799052 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843063391 0 0) 0x7fab880b0c80 con 0x7fab880aeea0 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab7ffff700 1 -- 172.21.15.157:0/3099799052 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab740035d0 con 0x7fab880aeea0 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8d284700 1 -- 172.21.15.157:0/3099799052 >> v2:172.21.15.175:3300/0 conn(0x7fab880b1c80 msgr2=0x7fab88071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8d284700 1 --2- 172.21.15.157:0/3099799052 >> v2:172.21.15.175:3300/0 conn(0x7fab880b1c80 0x7fab88071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8d284700 1 -- 172.21.15.157:0/3099799052 >> v1:172.21.15.157:6789/0 conn(0x7fab880aeea0 legacy=0x7fab880b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8d284700 1 -- 172.21.15.157:0/3099799052 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8815d320 con 0x7fab880aeac0 2024-04-18T03:37:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8ca83700 1 --2- 172.21.15.157:0/3099799052 >> v2:172.21.15.175:3300/0 conn(0x7fab880b1c80 0x7fab88071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:37:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8d284700 1 --2- 172.21.15.157:0/3099799052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880709b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab8400a9f0 tx=0x7fab8400ad00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadcdfaeca52a693 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab7ffff700 1 -- 172.21.15.157:0/3099799052 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400cb70 con 0x7fab880aeac0 2024-04-18T03:37:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab7ffff700 1 -- 172.21.15.157:0/3099799052 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400ae90 con 0x7fab880aeac0 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab7ffff700 1 -- 172.21.15.157:0/3099799052 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84018400 con 0x7fab880aeac0 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 -- 172.21.15.157:0/3099799052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 msgr2=0x7fab880709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/3099799052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880709b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fab8400a9f0 tx=0x7fab8400ad00 comp rx=0 tx=0).stop 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 -- 172.21.15.157:0/3099799052 shutdown_connections 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/3099799052 >> v2:172.21.15.175:3300/0 conn(0x7fab880b1c80 0x7fab88071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/3099799052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880709b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 -- 172.21.15.157:0/3099799052 >> 172.21.15.157:0/3099799052 conn(0x7fab88098a50 msgr2=0x7fab880b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 -- 172.21.15.157:0/3099799052 shutdown_connections 2024-04-18T03:37:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.071+0000 7fab8f4e8700 1 -- 172.21.15.157:0/3099799052 wait complete. 2024-04-18T03:37:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8f4e8700 1 Processor -- start 2024-04-18T03:37:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8f4e8700 1 -- start start 2024-04-18T03:37:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8f4e8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8f4e8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880aeea0 0x7fab88099350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8f4e8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8814b780 0x7fab8809aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8f4e8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab88099a10 con 0x7fab880aeea0 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8f4e8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab88099cf0 con 0x7fab8814b780 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8f4e8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab88099fd0 con 0x7fab880aeac0 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8ca83700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880aeea0 0x7fab88099350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8ca83700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880aeea0 0x7fab88099350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57122/0 (socket says 172.21.15.157:57122) 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.075+0000 7fab8ca83700 1 -- 172.21.15.157:0/4016364234 learned_addr learned my addr 172.21.15.157:0/4016364234 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8d284700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8da85700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8814b780 0x7fab8809aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8ca83700 1 -- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 msgr2=0x7fab880c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8ca83700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8ca83700 1 -- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8814b780 msgr2=0x7fab8809aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8ca83700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8814b780 0x7fab8809aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8ca83700 1 -- 172.21.15.157:0/4016364234 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab780094b0 con 0x7fab880aeea0 2024-04-18T03:37:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8ca83700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880aeea0 0x7fab88099350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab7800e990 tx=0x7fab7800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab7dffb700 1 -- 172.21.15.157:0/4016364234 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7800c690 con 0x7fab880aeea0 2024-04-18T03:37:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab7dffb700 1 -- 172.21.15.157:0/4016364234 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7800c7f0 con 0x7fab880aeea0 2024-04-18T03:37:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab7dffb700 1 -- 172.21.15.157:0/4016364234 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7800cb60 con 0x7fab880aeea0 2024-04-18T03:37:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8400a650 con 0x7fab880aeea0 2024-04-18T03:37:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8809a590 con 0x7fab880aeea0 2024-04-18T03:37:59.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8804e6c0 con 0x7fab880aeea0 2024-04-18T03:37:59.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.079+0000 7fab7dffb700 1 -- 172.21.15.157:0/4016364234 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab7800ccc0 con 0x7fab880aeea0 2024-04-18T03:37:59.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.083+0000 7fab7dffb700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab6c066730 0x7fab6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.083+0000 7fab7dffb700 1 -- 172.21.15.157:0/4016364234 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab780843a0 con 0x7fab880aeea0 2024-04-18T03:37:59.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.083+0000 7fab8d284700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab6c066730 0x7fab6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.083+0000 7fab8d284700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab6c066730 0x7fab6c068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fab84000c00 tx=0x7fab8401b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.087+0000 7fab7dffb700 1 -- 172.21.15.157:0/4016364234 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fab78051420 con 0x7fab880aeea0 2024-04-18T03:37:59.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.259+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab880b3920 con 0x7fab880aeea0 2024-04-18T03:37:59.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.259+0000 7fab7dffb700 1 -- 172.21.15.157:0/4016364234 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab78054a40 con 0x7fab880aeea0 2024-04-18T03:37:59.263 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:37:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab6c066730 msgr2=0x7fab6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab6c066730 0x7fab6c068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fab84000c00 tx=0x7fab8401b040 comp rx=0 tx=0).stop 2024-04-18T03:37:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880aeea0 msgr2=0x7fab88099350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880aeea0 0x7fab88099350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab7800e990 tx=0x7fab7800eca0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 shutdown_connections 2024-04-18T03:37:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fab6c066730 0x7fab6c068bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab8814b780 0x7fab8809aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab880aeea0 0x7fab88099350 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 --2- 172.21.15.157:0/4016364234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab880aeac0 0x7fab880c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 >> 172.21.15.157:0/4016364234 conn(0x7fab88098a50 msgr2=0x7fab8806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 shutdown_connections 2024-04-18T03:37:59.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.263+0000 7fab8f4e8700 1 -- 172.21.15.157:0/4016364234 wait complete. 2024-04-18T03:37:59.278 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:37:59.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8359e700 1 Processor -- start 2024-04-18T03:37:59.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8359e700 1 -- start start 2024-04-18T03:37:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8406b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec840716d0 0x7fec8406b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8359e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec84070630 con 0x7fec840b7460 2024-04-18T03:37:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec84070910 con 0x7fec840716d0 2024-04-18T03:37:59.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec84070bf0 con 0x7fec8415ce50 2024-04-18T03:37:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8406b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec81d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec840716d0 0x7fec8406b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec81d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec840716d0 0x7fec8406b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:59322/0 (socket says 172.21.15.157:59322) 2024-04-18T03:37:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec81d9b700 1 -- 172.21.15.157:0/870206393 learned_addr learned my addr 172.21.15.157:0/870206393 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.391+0000 7fec8259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8406b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:32870/0 (socket says 172.21.15.157:32870) 2024-04-18T03:37:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec81d9b700 1 -- 172.21.15.157:0/870206393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 msgr2=0x7fec8406b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec81d9b700 1 --2- 172.21.15.157:0/870206393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8406b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec81d9b700 1 -- 172.21.15.157:0/870206393 >> v1:172.21.15.175:6789/0 conn(0x7fec840b7460 legacy=0x7fec84160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec81d9b700 1 -- 172.21.15.157:0/870206393 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84070ed0 con 0x7fec840716d0 2024-04-18T03:37:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8159a700 1 -- 172.21.15.157:0/870206393 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512935614 0 0) 0x7fec84070630 con 0x7fec840b7460 2024-04-18T03:37:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec81d9b700 1 --2- 172.21.15.157:0/870206393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 0x7fec8406b5b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fec74009910 tx=0x7fec74009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c653f8584c71276 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8159a700 1 -- 172.21.15.157:0/870206393 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74011830 con 0x7fec840716d0 2024-04-18T03:37:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8159a700 1 -- 172.21.15.157:0/870206393 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec74011990 con 0x7fec840716d0 2024-04-18T03:37:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8159a700 1 -- 172.21.15.157:0/870206393 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74011d40 con 0x7fec840716d0 2024-04-18T03:37:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8359e700 1 -- 172.21.15.157:0/870206393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 msgr2=0x7fec8406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8359e700 1 --2- 172.21.15.157:0/870206393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 0x7fec8406b5b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fec74009910 tx=0x7fec74009c20 comp rx=0 tx=0).stop 2024-04-18T03:37:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8359e700 1 -- 172.21.15.157:0/870206393 shutdown_connections 2024-04-18T03:37:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8359e700 1 --2- 172.21.15.157:0/870206393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 0x7fec8406b5b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8359e700 1 --2- 172.21.15.157:0/870206393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8406b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8359e700 1 -- 172.21.15.157:0/870206393 >> 172.21.15.157:0/870206393 conn(0x7fec840b4d00 msgr2=0x7fec840b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8359e700 1 -- 172.21.15.157:0/870206393 shutdown_connections 2024-04-18T03:37:59.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.395+0000 7fec8359e700 1 -- 172.21.15.157:0/870206393 wait complete. 2024-04-18T03:37:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 Processor -- start 2024-04-18T03:37:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 -- start start 2024-04-18T03:37:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 0x7fec841519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec840b7460 0x7fec84152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84158000 con 0x7fec840b7460 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec841f2860 con 0x7fec840716d0 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec841f2b40 con 0x7fec8415ce50 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec840b7460 0x7fec84152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec840b7460 0x7fec84152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57132/0 (socket says 172.21.15.157:57132) 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 -- 172.21.15.157:0/2535998008 learned_addr learned my addr 172.21.15.157:0/2535998008 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8259c700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 0x7fec841519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec82d9d700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 -- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 msgr2=0x7fec8414db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8414db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 -- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 msgr2=0x7fec841519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 0x7fec841519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 -- 172.21.15.157:0/2535998008 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec74009570 con 0x7fec840b7460 2024-04-18T03:37:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec81d9b700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec840b7460 0x7fec84152090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fec84071c60 tx=0x7fec74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec72ffd700 1 -- 172.21.15.157:0/2535998008 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400b970 con 0x7fec840b7460 2024-04-18T03:37:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec72ffd700 1 -- 172.21.15.157:0/2535998008 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7401f070 con 0x7fec840b7460 2024-04-18T03:37:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec840b6de0 con 0x7fec840b7460 2024-04-18T03:37:59.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec72ffd700 1 -- 172.21.15.157:0/2535998008 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400bcf0 con 0x7fec840b7460 2024-04-18T03:37:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.399+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec841f3100 con 0x7fec840b7460 2024-04-18T03:37:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.403+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec841f29a0 con 0x7fec840b7460 2024-04-18T03:37:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.403+0000 7fec72ffd700 1 -- 172.21.15.157:0/2535998008 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec7401a430 con 0x7fec840b7460 2024-04-18T03:37:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.403+0000 7fec72ffd700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fec64066730 0x7fec64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.403+0000 7fec72ffd700 1 -- 172.21.15.157:0/2535998008 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec74021070 con 0x7fec840b7460 2024-04-18T03:37:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.403+0000 7fec8259c700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fec64066730 0x7fec64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.407+0000 7fec8259c700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fec64066730 0x7fec64068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec78009b50 tx=0x7fec78009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.415+0000 7fec72ffd700 1 -- 172.21.15.157:0/2535998008 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fec841f29a0 con 0x7fec840b7460 2024-04-18T03:37:59.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.583+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec841f29a0 con 0x7fec840b7460 2024-04-18T03:37:59.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.583+0000 7fec72ffd700 1 -- 172.21.15.157:0/2535998008 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec841f29a0 con 0x7fec840b7460 2024-04-18T03:37:59.586 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:37:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fec64066730 msgr2=0x7fec64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fec64066730 0x7fec64068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec78009b50 tx=0x7fec78009240 comp rx=0 tx=0).stop 2024-04-18T03:37:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec840b7460 msgr2=0x7fec84152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec840b7460 0x7fec84152090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fec84071c60 tx=0x7fec74004770 comp rx=0 tx=0).stop 2024-04-18T03:37:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 shutdown_connections 2024-04-18T03:37:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fec64066730 0x7fec64068bf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec8415ce50 0x7fec8414db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fec840b7460 0x7fec84152090 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 --2- 172.21.15.157:0/2535998008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec840716d0 0x7fec841519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 >> 172.21.15.157:0/2535998008 conn(0x7fec840b4d00 msgr2=0x7fec84150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 shutdown_connections 2024-04-18T03:37:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.587+0000 7fec8359e700 1 -- 172.21.15.157:0/2535998008 wait complete. 2024-04-18T03:37:59.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:37:59.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 Processor -- start 2024-04-18T03:37:59.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- start start 2024-04-18T03:37:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2e40cbe10 0x7fe2e406c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe2e406caf0 0x7fe2e40ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e40cc250 con 0x7fe2e415b0c0 2024-04-18T03:37:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e415b4a0 con 0x7fe2e40cbe10 2024-04-18T03:37:59.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e406cf00 con 0x7fe2e406caf0 2024-04-18T03:37:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e1d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2e40cbe10 0x7fe2e406c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e1d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe2e40cbe10 0x7fe2e406c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57138/0 (socket says 172.21.15.157:57138) 2024-04-18T03:37:59.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e1d9b700 1 -- 172.21.15.157:0/2499379718 learned_addr learned my addr 172.21.15.157:0/2499379718 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e2d9d700 1 --2- 172.21.15.157:0/2499379718 >> v2:172.21.15.175:3300/0 conn(0x7fe2e406caf0 0x7fe2e40ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e1d9b700 1 -- 172.21.15.157:0/2499379718 >> v2:172.21.15.175:3300/0 conn(0x7fe2e406caf0 msgr2=0x7fe2e40ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e1d9b700 1 --2- 172.21.15.157:0/2499379718 >> v2:172.21.15.175:3300/0 conn(0x7fe2e406caf0 0x7fe2e40ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e1d9b700 1 -- 172.21.15.157:0/2499379718 >> v1:172.21.15.175:6789/0 conn(0x7fe2e415b0c0 legacy=0x7fe2e4070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e1d9b700 1 -- 172.21.15.157:0/2499379718 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40d04a0 con 0x7fe2e40cbe10 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e2d9d700 1 --2- 172.21.15.157:0/2499379718 >> v2:172.21.15.175:3300/0 conn(0x7fe2e406caf0 0x7fe2e40ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e1d9b700 1 --2- 172.21.15.157:0/2499379718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e40cbe10 0x7fe2e406c5b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe2e408a260 tx=0x7fe2dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3afd77bec1c89f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e159a700 1 -- 172.21.15.157:0/2499379718 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00e070 con 0x7fe2e40cbe10 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e159a700 1 -- 172.21.15.157:0/2499379718 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc003a40 con 0x7fe2e40cbe10 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e159a700 1 -- 172.21.15.157:0/2499379718 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc003df0 con 0x7fe2e40cbe10 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- 172.21.15.157:0/2499379718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e40cbe10 msgr2=0x7fe2e406c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/2499379718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e40cbe10 0x7fe2e406c5b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe2e408a260 tx=0x7fe2dc00b330 comp rx=0 tx=0).stop 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- 172.21.15.157:0/2499379718 shutdown_connections 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/2499379718 >> v2:172.21.15.175:3300/0 conn(0x7fe2e406caf0 0x7fe2e40ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/2499379718 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e40cbe10 0x7fe2e406c5b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- 172.21.15.157:0/2499379718 >> 172.21.15.157:0/2499379718 conn(0x7fe2e40d1000 msgr2=0x7fe2e40d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- 172.21.15.157:0/2499379718 shutdown_connections 2024-04-18T03:37:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.707+0000 7fe2e89b6700 1 -- 172.21.15.157:0/2499379718 wait complete. 2024-04-18T03:37:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.711+0000 7fe2e89b6700 1 Processor -- start 2024-04-18T03:37:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.711+0000 7fe2e89b6700 1 -- start start 2024-04-18T03:37:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2e406caf0 0x7fe2e41f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e40cbe10 0x7fe2e40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e415b0c0 0x7fe2e415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40c97d0 con 0x7fe2e415b0c0 2024-04-18T03:37:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e41f0560 con 0x7fe2e40cbe10 2024-04-18T03:37:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40c8900 con 0x7fe2e406caf0 2024-04-18T03:37:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e415b0c0 0x7fe2e415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e415b0c0 0x7fe2e415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57140/0 (socket says 172.21.15.157:57140) 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 -- 172.21.15.157:0/1279708373 learned_addr learned my addr 172.21.15.157:0/1279708373 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e1d9b700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e40cbe10 0x7fe2e40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e259c700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2e406caf0 0x7fe2e41f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 -- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2e406caf0 msgr2=0x7fe2e41f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2e406caf0 0x7fe2e41f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 -- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e40cbe10 msgr2=0x7fe2e40ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e40cbe10 0x7fe2e40ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 -- 172.21.15.157:0/1279708373 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc009b30 con 0x7fe2e415b0c0 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e2d9d700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e415b0c0 0x7fe2e415d7f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400c7c0 tx=0x7fe2d400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2d2ffd700 1 -- 172.21.15.157:0/1279708373 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4011860 con 0x7fe2e415b0c0 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2d2ffd700 1 -- 172.21.15.157:0/1279708373 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d40119c0 con 0x7fe2e415b0c0 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2d2ffd700 1 -- 172.21.15.157:0/1279708373 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4011d70 con 0x7fe2e415b0c0 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e40c8bc0 con 0x7fe2e415b0c0 2024-04-18T03:37:59.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e40c9180 con 0x7fe2e415b0c0 2024-04-18T03:37:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.715+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e40676b0 con 0x7fe2e415b0c0 2024-04-18T03:37:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.719+0000 7fe2d2ffd700 1 -- 172.21.15.157:0/1279708373 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2d4021350 con 0x7fe2e415b0c0 2024-04-18T03:37:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.719+0000 7fe2d2ffd700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2c4066760 0x7fe2c4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:37:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.719+0000 7fe2d2ffd700 1 -- 172.21.15.157:0/1279708373 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2d40842a0 con 0x7fe2e415b0c0 2024-04-18T03:37:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.719+0000 7fe2e259c700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2c4066760 0x7fe2c4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:37:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.719+0000 7fe2e259c700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2c4066760 0x7fe2c4068c20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009980 tx=0x7fe2d80090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:37:59.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.727+0000 7fe2d2ffd700 1 -- 172.21.15.157:0/1279708373 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe2d4051280 con 0x7fe2e415b0c0 2024-04-18T03:37:59.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.927+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2e404e6c0 con 0x7fe2e415b0c0 2024-04-18T03:37:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.927+0000 7fe2d2ffd700 1 -- 172.21.15.157:0/1279708373 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4742 (secure 0 0 0) 0x7fe2d40548a0 con 0x7fe2e415b0c0 2024-04-18T03:37:59.930 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:37:59.931 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T03:37:34.273529+0000","modified":"2024-04-18T03:37:50.365620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T03:37:59.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2c4066760 msgr2=0x7fe2c4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2c4066760 0x7fe2c4068c20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009980 tx=0x7fe2d80090e0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e415b0c0 msgr2=0x7fe2e415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e415b0c0 0x7fe2e415d7f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400c7c0 tx=0x7fe2d400cad0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 shutdown_connections 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe2c4066760 0x7fe2c4068c20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e40cbe10 0x7fe2e40ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe2e415b0c0 0x7fe2e415d7f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 --2- 172.21.15.157:0/1279708373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe2e406caf0 0x7fe2e41f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 >> 172.21.15.157:0/1279708373 conn(0x7fe2e40d1000 msgr2=0x7fe2e40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 shutdown_connections 2024-04-18T03:37:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:37:59.931+0000 7fe2e89b6700 1 -- 172.21.15.157:0/1279708373 wait complete. 2024-04-18T03:37:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 9 2024-04-18T03:37:59.945 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:38:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd98b700 1 Processor -- start 2024-04-18T03:38:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd98b700 1 -- start start 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd98b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 0x7fbbc80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd98b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbbc80cf2e0 0x7fbbc80cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd98b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbbc806b5e0 0x7fbbc806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd98b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc80cce20 con 0x7fbbc806b5e0 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd98b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc806bf80 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd98b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80ccb80 con 0x7fbbc8142b40 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbbc806b5e0 0x7fbbc806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbbc806b5e0 0x7fbbc806ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57156/0 (socket says 172.21.15.157:57156) 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 -- 172.21.15.157:0/1382366722 learned_addr learned my addr 172.21.15.157:0/1382366722 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcc989700 1 --2- 172.21.15.157:0/1382366722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 0x7fbbc80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbc7fff700 1 --2- 172.21.15.157:0/1382366722 >> v2:172.21.15.175:3300/0 conn(0x7fbbc80cf2e0 0x7fbbc80cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 -- 172.21.15.157:0/1382366722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 msgr2=0x7fbbc80b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 --2- 172.21.15.157:0/1382366722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 0x7fbbc80b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 -- 172.21.15.157:0/1382366722 >> v2:172.21.15.175:3300/0 conn(0x7fbbc80cf2e0 msgr2=0x7fbbc80cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 --2- 172.21.15.157:0/1382366722 >> v2:172.21.15.175:3300/0 conn(0x7fbbc80cf2e0 0x7fbbc80cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 -- 172.21.15.157:0/1382366722 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80ce520 con 0x7fbbc806b5e0 2024-04-18T03:38:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbcd18a700 1 --2- 172.21.15.157:0/1382366722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc806b5e0 0x7fbbc806ba40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8066aa0 tx=0x7fbbc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ddd7c8a58fc2a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.071+0000 7fbbc77fe700 1 -- 172.21.15.157:0/1382366722 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000e070 con 0x7fbbc806b5e0 2024-04-18T03:38:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbc77fe700 1 -- 172.21.15.157:0/1382366722 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc000b9c0 con 0x7fbbc806b5e0 2024-04-18T03:38:00.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbc77fe700 1 -- 172.21.15.157:0/1382366722 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000bd70 con 0x7fbbc806b5e0 2024-04-18T03:38:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 -- 172.21.15.157:0/1382366722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc806b5e0 msgr2=0x7fbbc806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/1382366722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc806b5e0 0x7fbbc806ba40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8066aa0 tx=0x7fbbc000b330 comp rx=0 tx=0).stop 2024-04-18T03:38:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 -- 172.21.15.157:0/1382366722 shutdown_connections 2024-04-18T03:38:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/1382366722 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc806b5e0 0x7fbbc806ba40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/1382366722 >> v2:172.21.15.175:3300/0 conn(0x7fbbc80cf2e0 0x7fbbc80cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/1382366722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 0x7fbbc80b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 -- 172.21.15.157:0/1382366722 >> 172.21.15.157:0/1382366722 conn(0x7fbbc80b1920 msgr2=0x7fbbc80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 -- 172.21.15.157:0/1382366722 shutdown_connections 2024-04-18T03:38:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 -- 172.21.15.157:0/1382366722 wait complete. 2024-04-18T03:38:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 Processor -- start 2024-04-18T03:38:00.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 -- start start 2024-04-18T03:38:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc806b5e0 0x7fbbc8143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc80cf2e0 0x7fbbc80b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.075+0000 7fbbcd98b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 0x7fbbc80b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbcd98b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80cabb0 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbcd98b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80ca010 con 0x7fbbc806b5e0 2024-04-18T03:38:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbcd98b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80ca280 con 0x7fbbc8142b40 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc80cf2e0 0x7fbbc80b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc80cf2e0 0x7fbbc80b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57162/0 (socket says 172.21.15.157:57162) 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 -- 172.21.15.157:0/3892203967 learned_addr learned my addr 172.21.15.157:0/3892203967 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbcc989700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc806b5e0 0x7fbbc8143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbcd18a700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 0x7fbbc80b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 -- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 msgr2=0x7fbbc80b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 0x7fbbc80b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 -- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc806b5e0 msgr2=0x7fbbc8143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc806b5e0 0x7fbbc8143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 -- 172.21.15.157:0/3892203967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0009b30 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc7fff700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc80cf2e0 0x7fbbc80b35d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400e810 tx=0x7fbbb400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc57fa700 1 -- 172.21.15.157:0/3892203967 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb400c070 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc57fa700 1 -- 172.21.15.157:0/3892203967 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb4013610 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc80ca560 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc57fa700 1 -- 172.21.15.157:0/3892203967 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb40139a0 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc8136a20 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc80cad20 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc57fa700 1 -- 172.21.15.157:0/3892203967 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbbb4013b00 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.079+0000 7fbbc57fa700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbbac066730 0x7fbbac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.083+0000 7fbbc57fa700 1 -- 172.21.15.157:0/3892203967 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbb40840c0 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.083+0000 7fbbcc989700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbbac066730 0x7fbbac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.083+0000 7fbbcc989700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbbac066730 0x7fbbac068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbbc81405d0 tx=0x7fbbbc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.087+0000 7fbbc57fa700 1 -- 172.21.15.157:0/3892203967 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbbb4051140 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.255+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbc804e650 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.255+0000 7fbbc57fa700 1 -- 172.21.15.157:0/3892203967 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fbbb4013db0 con 0x7fbbc80cf2e0 2024-04-18T03:38:00.260 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:38:00.260 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":25,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:37:38.689237+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:38:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbbac066730 msgr2=0x7fbbac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbbac066730 0x7fbbac068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbbc81405d0 tx=0x7fbbbc008040 comp rx=0 tx=0).stop 2024-04-18T03:38:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc80cf2e0 msgr2=0x7fbbc80b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc80cf2e0 0x7fbbc80b35d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400e810 tx=0x7fbbb400eb20 comp rx=0 tx=0).stop 2024-04-18T03:38:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 shutdown_connections 2024-04-18T03:38:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbbac066730 0x7fbbac068bf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc8142b40 0x7fbbc80b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbc80cf2e0 0x7fbbc80b35d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 --2- 172.21.15.157:0/3892203967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc806b5e0 0x7fbbc8143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 >> 172.21.15.157:0/3892203967 conn(0x7fbbc80b1920 msgr2=0x7fbbc8136e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 shutdown_connections 2024-04-18T03:38:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.259+0000 7fbbcd98b700 1 -- 172.21.15.157:0/3892203967 wait complete. 2024-04-18T03:38:00.275 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:38:00.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.375+0000 7fa207fff700 1 Processor -- start 2024-04-18T03:38:00.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.375+0000 7fa207fff700 1 -- start start 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b3c0 0x7fa20815e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa208146aa0 0x7fa208070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20815e670 con 0x7fa20806b7a0 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa208146f30 con 0x7fa208146aa0 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080d2c60 con 0x7fa20806b3c0 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa2067fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa20806b7a0 0x7fa208146390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36780/0 (socket says 172.21.15.157:36780) 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa2067fc700 1 -- 172.21.15.157:0/888405211 learned_addr learned my addr 172.21.15.157:0/888405211 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa2077fe700 1 --2- 172.21.15.157:0/888405211 >> v2:172.21.15.157:3300/0 conn(0x7fa208146aa0 0x7fa208070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa206ffd700 1 --2- 172.21.15.157:0/888405211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b3c0 0x7fa20815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa205ffb700 1 -- 172.21.15.157:0/888405211 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658692883 0 0) 0x7fa20815e670 con 0x7fa20806b7a0 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa205ffb700 1 -- 172.21.15.157:0/888405211 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f00035d0 con 0x7fa20806b7a0 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa2077fe700 1 -- 172.21.15.157:0/888405211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b3c0 msgr2=0x7fa20815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa2077fe700 1 --2- 172.21.15.157:0/888405211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b3c0 0x7fa20815e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa2077fe700 1 -- 172.21.15.157:0/888405211 >> v1:172.21.15.157:6789/0 conn(0x7fa20806b7a0 legacy=0x7fa208146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa205ffb700 1 -- 172.21.15.157:0/888405211 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697510762 0 0) 0x7fa1f00035d0 con 0x7fa20806b7a0 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa2077fe700 1 -- 172.21.15.157:0/888405211 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2080d1be0 con 0x7fa208146aa0 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa2077fe700 1 --2- 172.21.15.157:0/888405211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa208146aa0 0x7fa208070070 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa200009d90 tx=0x7fa20000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa403c7eb58a4c8b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa205ffb700 1 -- 172.21.15.157:0/888405211 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20000e070 con 0x7fa208146aa0 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa205ffb700 1 -- 172.21.15.157:0/888405211 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20000bb20 con 0x7fa208146aa0 2024-04-18T03:38:00.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa205ffb700 1 -- 172.21.15.157:0/888405211 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20000be90 con 0x7fa208146aa0 2024-04-18T03:38:00.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 -- 172.21.15.157:0/888405211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa208146aa0 msgr2=0x7fa208070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 --2- 172.21.15.157:0/888405211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa208146aa0 0x7fa208070070 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa200009d90 tx=0x7fa20000b330 comp rx=0 tx=0).stop 2024-04-18T03:38:00.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 -- 172.21.15.157:0/888405211 shutdown_connections 2024-04-18T03:38:00.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 --2- 172.21.15.157:0/888405211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa208146aa0 0x7fa208070070 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 --2- 172.21.15.157:0/888405211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b3c0 0x7fa20815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 -- 172.21.15.157:0/888405211 >> 172.21.15.157:0/888405211 conn(0x7fa2080d2f20 msgr2=0x7fa2080d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 -- 172.21.15.157:0/888405211 shutdown_connections 2024-04-18T03:38:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.379+0000 7fa207fff700 1 -- 172.21.15.157:0/888405211 wait complete. 2024-04-18T03:38:00.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.383+0000 7fa207fff700 1 Processor -- start 2024-04-18T03:38:00.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.383+0000 7fa207fff700 1 -- start start 2024-04-18T03:38:00.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20806b3c0 0x7fa20815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b7a0 0x7fa2080b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa208146aa0 0x7fa2080b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2081413c0 con 0x7fa20806b3c0 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20813de40 con 0x7fa208146aa0 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2081f6af0 con 0x7fa20806b7a0 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20806b3c0 0x7fa20815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20806b3c0 0x7fa20815c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57176/0 (socket says 172.21.15.157:57176) 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 -- 172.21.15.157:0/351692423 learned_addr learned my addr 172.21.15.157:0/351692423 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa2077fe700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa208146aa0 0x7fa2080b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa2067fc700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b7a0 0x7fa2080b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 -- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b7a0 msgr2=0x7fa2080b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b7a0 0x7fa2080b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 -- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa208146aa0 msgr2=0x7fa2080b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa208146aa0 0x7fa2080b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 -- 172.21.15.157:0/351692423 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200009a70 con 0x7fa20806b3c0 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa2067fc700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b7a0 0x7fa2080b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:38:00.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa206ffd700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20806b3c0 0x7fa20815c980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00e9d0 tx=0x7fa1fc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa1effff700 1 -- 172.21.15.157:0/351692423 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc009720 con 0x7fa20806b3c0 2024-04-18T03:38:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa1effff700 1 -- 172.21.15.157:0/351692423 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00c7f0 con 0x7fa20806b3c0 2024-04-18T03:38:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa1effff700 1 -- 172.21.15.157:0/351692423 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00cb60 con 0x7fa20806b3c0 2024-04-18T03:38:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2081f5d30 con 0x7fa20806b3c0 2024-04-18T03:38:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2081f62f0 con 0x7fa20806b3c0 2024-04-18T03:38:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.387+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2080719d0 con 0x7fa20806b3c0 2024-04-18T03:38:00.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.391+0000 7fa1effff700 1 -- 172.21.15.157:0/351692423 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1fc00ccc0 con 0x7fa20806b3c0 2024-04-18T03:38:00.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.391+0000 7fa1effff700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa1f4066760 0x7fa1f4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:00.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.391+0000 7fa1effff700 1 -- 172.21.15.157:0/351692423 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa1fc084590 con 0x7fa20806b3c0 2024-04-18T03:38:00.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.391+0000 7fa2067fc700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa1f4066760 0x7fa1f4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:00.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.391+0000 7fa2067fc700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa1f4066760 0x7fa1f4068c20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa2080b4c60 tx=0x7fa1f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:00.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.399+0000 7fa1effff700 1 -- 172.21.15.157:0/351692423 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa1fc051570 con 0x7fa20806b3c0 2024-04-18T03:38:00.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.599+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa20804e650 con 0x7fa20806b3c0 2024-04-18T03:38:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa1effff700 1 -- 172.21.15.157:0/351692423 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4742 (secure 0 0 0) 0x7fa1fc054b90 con 0x7fa20806b3c0 2024-04-18T03:38:00.605 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:38:00.606 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T03:37:34.273529+0000","modified":"2024-04-18T03:37:50.365620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T03:38:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa1f4066760 msgr2=0x7fa1f4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa1f4066760 0x7fa1f4068c20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa2080b4c60 tx=0x7fa1f8009040 comp rx=0 tx=0).stop 2024-04-18T03:38:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20806b3c0 msgr2=0x7fa20815c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20806b3c0 0x7fa20815c980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00e9d0 tx=0x7fa1fc00ed90 comp rx=0 tx=0).stop 2024-04-18T03:38:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 shutdown_connections 2024-04-18T03:38:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa1f4066760 0x7fa1f4068c20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa208146aa0 0x7fa2080b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20806b7a0 0x7fa2080b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 --2- 172.21.15.157:0/351692423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20806b3c0 0x7fa20815c980 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 >> 172.21.15.157:0/351692423 conn(0x7fa2080d2f20 msgr2=0x7fa2080712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 shutdown_connections 2024-04-18T03:38:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:00.603+0000 7fa207fff700 1 -- 172.21.15.157:0/351692423 wait complete. 2024-04-18T03:38:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 9 2024-04-18T03:38:01.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T03:37:34.273529+0000', 'modified': '2024-04-18T03:37:50.365620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/1564130449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1564130449}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1564130449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-18T03:38:01.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-18T03:38:01.023 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-18T03:38:01.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 Processor -- start 2024-04-18T03:38:01.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- start start 2024-04-18T03:38:01.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0198143fa0 0x7f019815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01980ce260 0x7f0198071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019806b220 con 0x7f01980ce6c0 2024-04-18T03:38:01.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019806a650 con 0x7f01980ce260 2024-04-18T03:38:01.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019806a8f0 con 0x7f0198143fa0 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f0196ffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01980ce260 0x7f0198071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f0197fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f01980ce6c0 0x7f019806b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:36784/0 (socket says 172.21.15.157:36784) 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f0197fff700 1 -- 172.21.15.157:0/1558720865 learned_addr learned my addr 172.21.15.157:0/1558720865 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f01977fe700 1 --2- 172.21.15.157:0/1558720865 >> v2:172.21.15.175:3300/0 conn(0x7f0198143fa0 0x7f019815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f0196ffd700 1 -- 172.21.15.157:0/1558720865 >> v2:172.21.15.175:3300/0 conn(0x7f0198143fa0 msgr2=0x7f019815b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f0196ffd700 1 --2- 172.21.15.157:0/1558720865 >> v2:172.21.15.175:3300/0 conn(0x7f0198143fa0 0x7f019815b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f0196ffd700 1 -- 172.21.15.157:0/1558720865 >> v1:172.21.15.157:6789/0 conn(0x7f01980ce6c0 legacy=0x7f019806b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f01967fc700 1 -- 172.21.15.157:0/1558720865 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011931297 0 0) 0x7f019806b220 con 0x7f01980ce6c0 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f0196ffd700 1 -- 172.21.15.157:0/1558720865 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019806abd0 con 0x7f01980ce260 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f0196ffd700 1 --2- 172.21.15.157:0/1558720865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce260 0x7f0198071080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f01980b41b0 tx=0x7f0188009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4356776ab61b4ff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f01967fc700 1 -- 172.21.15.157:0/1558720865 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188011830 con 0x7f01980ce260 2024-04-18T03:38:01.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f01967fc700 1 -- 172.21.15.157:0/1558720865 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0188011990 con 0x7f01980ce260 2024-04-18T03:38:01.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f01967fc700 1 -- 172.21.15.157:0/1558720865 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188011d40 con 0x7f01980ce260 2024-04-18T03:38:01.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- 172.21.15.157:0/1558720865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce260 msgr2=0x7f0198071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1558720865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce260 0x7f0198071080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f01980b41b0 tx=0x7f0188009b30 comp rx=0 tx=0).stop 2024-04-18T03:38:01.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- 172.21.15.157:0/1558720865 shutdown_connections 2024-04-18T03:38:01.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1558720865 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce260 0x7f0198071080 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1558720865 >> v2:172.21.15.175:3300/0 conn(0x7f0198143fa0 0x7f019815b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- 172.21.15.157:0/1558720865 >> 172.21.15.157:0/1558720865 conn(0x7f019806e190 msgr2=0x7f019806e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:01.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- 172.21.15.157:0/1558720865 shutdown_connections 2024-04-18T03:38:01.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.147+0000 7f019e1ef700 1 -- 172.21.15.157:0/1558720865 wait complete. 2024-04-18T03:38:01.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 Processor -- start 2024-04-18T03:38:01.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 -- start start 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01980ce260 0x7f01980c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce6c0 0x7f01980c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0198143fa0 0x7f01981396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980ab8c0 con 0x7f01980ce6c0 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0198137000 con 0x7f0198143fa0 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980c50d0 con 0x7f01980ce260 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce6c0 0x7f01980c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce6c0 0x7f01980c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57206/0 (socket says 172.21.15.157:57206) 2024-04-18T03:38:01.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 -- 172.21.15.157:0/1686521153 learned_addr learned my addr 172.21.15.157:0/1686521153 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0197fff700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0198143fa0 0x7f01981396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f01977fe700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01980ce260 0x7f01980c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 -- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01980ce260 msgr2=0x7f01980c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01980ce260 0x7f01980c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 -- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0198143fa0 msgr2=0x7f01981396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0198143fa0 0x7f01981396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 -- 172.21.15.157:0/1686521153 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880094b0 con 0x7f01980ce6c0 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f01977fe700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01980ce260 0x7f01980c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f0196ffd700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce6c0 0x7f01980c4610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0188000c00 tx=0x7f0188004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f018ffff700 1 -- 172.21.15.157:0/1686521153 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018801aa10 con 0x7f01980ce6c0 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f018ffff700 1 -- 172.21.15.157:0/1686521153 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018801f070 con 0x7f01980ce6c0 2024-04-18T03:38:01.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 -- 172.21.15.157:0/1686521153 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01980abb10 con 0x7f01980ce6c0 2024-04-18T03:38:01.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f018ffff700 1 -- 172.21.15.157:0/1686521153 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018801add0 con 0x7f01980ce6c0 2024-04-18T03:38:01.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.151+0000 7f019e1ef700 1 -- 172.21.15.157:0/1686521153 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01980ac0d0 con 0x7f01980ce6c0 2024-04-18T03:38:01.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.155+0000 7f018ffff700 1 -- 172.21.15.157:0/1686521153 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f018801b430 con 0x7f01980ce6c0 2024-04-18T03:38:01.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.155+0000 7f018ffff700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0178066730 0x7f0178068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.155+0000 7f018ffff700 1 -- 172.21.15.157:0/1686521153 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0188085580 con 0x7f01980ce6c0 2024-04-18T03:38:01.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.155+0000 7f01977fe700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0178066730 0x7f0178068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.155+0000 7f01977fe700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0178066730 0x7f0178068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0180007a70 tx=0x7f0180008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01a149a740 1 Processor -- start 2024-04-18T03:38:01.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01a149a740 1 -- start start 2024-04-18T03:38:01.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01a149a740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01a149a740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c10aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01a149a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c10fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01a149a740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b832d0 con 0x1c5c260 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01a149a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b80a60 con 0x1c5cb80 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01a149a740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b7c350 con 0x1c3b2d0 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01977fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01977fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57216/0 (socket says 172.21.15.157:57216) 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f01977fe700 1 -- 172.21.15.157:0/899858439 learned_addr learned my addr 172.21.15.157:0/899858439 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f0196ffd700 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c10aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.159+0000 7f0197fff700 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c10fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01977fe700 1 -- 172.21.15.157:0/899858439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 msgr2=0x1c10aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01977fe700 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c10aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01977fe700 1 -- 172.21.15.157:0/899858439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 msgr2=0x1c10fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01977fe700 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c10fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01977fe700 1 -- 172.21.15.157:0/899858439 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19ef960 con 0x1c5c260 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01977fe700 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5c640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f018000f910 tx=0x7f0180012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d15e6f99d881859 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f018d7fa700 1 -- 172.21.15.157:0/899858439 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800146e0 con 0x1c5c260 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f018d7fa700 1 -- 172.21.15.157:0/899858439 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180019070 con 0x1c5c260 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f018d7fa700 1 -- 172.21.15.157:0/899858439 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180014a40 con 0x1c5c260 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- 172.21.15.157:0/899858439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 msgr2=0x1c5c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5c640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f018000f910 tx=0x7f0180012000 comp rx=0 tx=0).stop 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- 172.21.15.157:0/899858439 shutdown_connections 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c10fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c10aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 --2- 172.21.15.157:0/899858439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5c640 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- 172.21.15.157:0/899858439 >> 172.21.15.157:0/899858439 conn(0x19a44d0 msgr2=0x1c3d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:01.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- 172.21.15.157:0/899858439 shutdown_connections 2024-04-18T03:38:01.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- 172.21.15.157:0/899858439 wait complete. 2024-04-18T03:38:01.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- start start 2024-04-18T03:38:01.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 Processor -- start 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c3a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c3acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c53e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b39c80 con 0x1c5c260 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b3fb00 con 0x1c5cb80 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a28aa0 con 0x1c3b2d0 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.163+0000 7f01a149a740 10 client.0 _ll_register_callbacks cb 0x1b41030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c3acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c3acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57232/0 (socket says 172.21.15.157:57232) 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 -- 172.21.15.157:0/851337296 learned_addr learned my addr 172.21.15.157:0/851337296 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:01.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01977fe700 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c3a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0197fff700 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c53e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 -- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 msgr2=0x1c3a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c3a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 -- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 msgr2=0x1c53e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c53e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 -- 172.21.15.157:0/851337296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018000e040 con 0x1c5c260 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f0196ffd700 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c3acd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0188056050 tx=0x7f0188006da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c099379f93c408a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01767fc700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01767fc700 1 -- 172.21.15.157:0/851337296 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188083de0 con 0x1c5c260 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01767fc700 1 -- 172.21.15.157:0/851337296 <== mon.0 v2:172.21.15.157:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f018806b070 con 0x1c5c260 2024-04-18T03:38:01.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 1 -- 172.21.15.157:0/851337296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19b11e0 con 0x1c5c260 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01767fc700 1 -- 172.21.15.157:0/851337296 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f018805a180 con 0x1c5c260 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 10 client.4875 fetch_fsmap learned FSMap version 9 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 1 -- 172.21.15.157:0/851337296 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1b42770 con 0x1c5c260 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01767fc700 1 -- 172.21.15.157:0/851337296 <== mon.0 v2:172.21.15.157:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19b11e0 con 0x1c5c260 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01767fc700 1 -- 172.21.15.157:0/851337296 <== mon.0 v2:172.21.15.157:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f01880565b0 con 0x1c5c260 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 10 client.4875 fetch_fsmap finished waiting for FSMap version 9 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 10 client.4875 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 20 client.4875 populate_metadata read hostname 'smithi157' 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0x1c55590 0x1c55970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 4 client.4875 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01a149a740 1 -- 172.21.15.157:0/851337296 --> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x19fb460 con 0x1c55590 2024-04-18T03:38:01.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01977fe700 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0x1c55590 0x1c55970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01767fc700 10 client.4875 ms_handle_connect on v2:172.21.15.175:6836/1564130449 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.167+0000 7f01977fe700 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0x1c55590 0x1c55970 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77751a7f7494b88 server_cookie=92584d04fcf2341a in_seq=0 out_seq=0 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01767fc700 1 -- 172.21.15.157:0/851337296 <== mds.0 v2:172.21.15.175:6836/1564130449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x19fb460 con 0x1c55590 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01767fc700 10 client.4875 handle_command_reply: tid=0 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 client.4875 shutdown 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 -- 172.21.15.157:0/851337296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 msgr2=0x1c3acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c3acd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0188056050 tx=0x7f0188006da0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 -- 172.21.15.157:0/851337296 shutdown_connections 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0x1c55590 0x1c55970 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c53e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01767fc700 0 client.4875 ms_handle_reset on v2:172.21.15.175:6836/1564130449 2024-04-18T03:38:01.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c3acd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 --2- 172.21.15.157:0/851337296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c3a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 -- 172.21.15.157:0/851337296 >> 172.21.15.157:0/851337296 conn(0x19a44d0 msgr2=0x1c16f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:01.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 -- 172.21.15.157:0/851337296 shutdown_connections 2024-04-18T03:38:01.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 1 -- 172.21.15.157:0/851337296 wait complete. 2024-04-18T03:38:01.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.171+0000 7f01a149a740 20 client.4875 trim_cache size 0 max 16384 2024-04-18T03:38:01.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.187+0000 7f01a149a740 1 Processor -- start 2024-04-18T03:38:01.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.187+0000 7f01a149a740 1 -- start start 2024-04-18T03:38:01.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c5bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c6bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c6c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b1a9c0 con 0x1c5c260 2024-04-18T03:38:01.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c536b0 con 0x1c5cb80 2024-04-18T03:38:01.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b4d790 con 0x1c3b2d0 2024-04-18T03:38:01.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c6bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c6bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57240/0 (socket says 172.21.15.157:57240) 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 -- 172.21.15.157:0/2855117593 learned_addr learned my addr 172.21.15.157:0/2855117593 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0197fff700 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c6c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01977fe700 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c5bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 -- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 msgr2=0x1c5bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c5bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 -- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 msgr2=0x1c6c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c6c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 -- 172.21.15.157:0/2855117593 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b289a0 con 0x1c5c260 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0197fff700 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c6c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:38:01.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f0196ffd700 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c6bf60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f01880090b0 tx=0x7f0188026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671c620dd462f269 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f018dffb700 1 -- 172.21.15.157:0/2855117593 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188055cb0 con 0x1c5c260 2024-04-18T03:38:01.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f018dffb700 1 -- 172.21.15.157:0/2855117593 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018805e740 con 0x1c5c260 2024-04-18T03:38:01.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f018dffb700 1 -- 172.21.15.157:0/2855117593 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188083de0 con 0x1c5c260 2024-04-18T03:38:01.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 -- 172.21.15.157:0/2855117593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 msgr2=0x1c6bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c6bf60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f01880090b0 tx=0x7f0188026000 comp rx=0 tx=0).stop 2024-04-18T03:38:01.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 -- 172.21.15.157:0/2855117593 shutdown_connections 2024-04-18T03:38:01.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c5cb80 0x1c6c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c6bf60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 --2- 172.21.15.157:0/2855117593 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c3b2d0 0x1c5bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 -- 172.21.15.157:0/2855117593 >> 172.21.15.157:0/2855117593 conn(0x19a44d0 msgr2=0x1c6b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:01.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 -- 172.21.15.157:0/2855117593 shutdown_connections 2024-04-18T03:38:01.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.191+0000 7f01a149a740 1 -- 172.21.15.157:0/2855117593 wait complete. 2024-04-18T03:38:01.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 1 -- start start 2024-04-18T03:38:01.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 1 Processor -- start 2024-04-18T03:38:01.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c3b2d0 0x1c5b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c5cb80 0x1cba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c79300 con 0x1c5c260 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c5b750 con 0x1c3b2d0 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c5af60 con 0x1c5cb80 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01a149a740 10 client.0 _ll_register_callbacks cb 0x1b40300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57244/0 (socket says 172.21.15.157:57244) 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0196ffd700 1 -- 172.21.15.157:0/2544764343 learned_addr learned my addr 172.21.15.157:0/2544764343 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01977fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c3b2d0 0x1c5b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0197fff700 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c5cb80 0x1cba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0196ffd700 1 -- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c5cb80 msgr2=0x1cba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0196ffd700 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c5cb80 0x1cba6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0196ffd700 1 -- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c3b2d0 msgr2=0x1c5b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0196ffd700 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c3b2d0 0x1c5b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f0196ffd700 1 -- 172.21.15.157:0/2544764343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1b42770 con 0x1c5c260 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.195+0000 7f01977fe700 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c3b2d0 0x1c5b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f0196ffd700 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5a600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f01880546a0 tx=0x7f0188083720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca1f780a87afa80 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 10 client.0 ms_handle_connect on v2:172.21.15.157:3300/0 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 1 -- 172.21.15.157:0/2544764343 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188055cb0 con 0x1c5c260 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 1 -- 172.21.15.157:0/2544764343 <== mon.0 v2:172.21.15.157:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f018806b040 con 0x1c5c260 2024-04-18T03:38:01.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 -- 172.21.15.157:0/2544764343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0180019070 con 0x1c5c260 2024-04-18T03:38:01.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 1 -- 172.21.15.157:0/2544764343 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0188074340 con 0x1c5c260 2024-04-18T03:38:01.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 10 client.4881 fetch_fsmap learned FSMap version 9 2024-04-18T03:38:01.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 -- 172.21.15.157:0/2544764343 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x1b1cc70 con 0x1c5c260 2024-04-18T03:38:01.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 1 -- 172.21.15.157:0/2544764343 <== mon.0 v2:172.21.15.157:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180019070 con 0x1c5c260 2024-04-18T03:38:01.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 1 -- 172.21.15.157:0/2544764343 <== mon.0 v2:172.21.15.157:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f018807d3d0 con 0x1c5c260 2024-04-18T03:38:01.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 10 client.4881 fetch_fsmap finished waiting for FSMap version 9 2024-04-18T03:38:01.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 10 client.4881 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-18T03:38:01.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 20 client.4881 populate_metadata read hostname 'smithi157' 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0x1c586a0 0x1c58a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 4 client.4881 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 -- 172.21.15.157:0/2544764343 --> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1a201e0 con 0x1c586a0 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01977fe700 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0x1c586a0 0x1c58a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 10 client.4881 ms_handle_connect on v2:172.21.15.175:6836/1564130449 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01977fe700 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0x1c586a0 0x1c58a80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7758120a90fcb8 server_cookie=1042bbd7d96a26c5 in_seq=0 out_seq=0 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 1 -- 172.21.15.157:0/2544764343 <== mds.0 v2:172.21.15.175:6836/1564130449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1a201e0 con 0x1c586a0 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 10 client.4881 handle_command_reply: tid=0 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 client.4881 shutdown 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 -- 172.21.15.157:0/2544764343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 msgr2=0x1c5a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5a600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f01880546a0 tx=0x7f0188083720 comp rx=0 tx=0).stop 2024-04-18T03:38:01.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 -- 172.21.15.157:0/2544764343 shutdown_connections 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:6836/1564130449,v1:172.21.15.175:6837/1564130449] conn(0x1c586a0 0x1c58a80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x1c5cb80 0x1cba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x1c5c260 0x1c5a600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 --2- 172.21.15.157:0/2544764343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x1c3b2d0 0x1c5b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 -- 172.21.15.157:0/2544764343 >> 172.21.15.157:0/2544764343 conn(0x19a44d0 msgr2=0x1c6b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01767fc700 0 client.4881 ms_handle_reset on v2:172.21.15.175:6836/1564130449 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 -- 172.21.15.157:0/2544764343 shutdown_connections 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 1 -- 172.21.15.157:0/2544764343 wait complete. 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.199+0000 7f01a149a740 20 client.4881 trim_cache size 0 max 16384 2024-04-18T03:38:01.207 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "cluster_fsid": "f4d3acd0-980f-44ff-9559-06e2da8e4de0", 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "whoami": 0, 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 4276, 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "want_state": "up:active", 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "state": "up:active", 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs", 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "rank_uptime": 26.926691698999999, 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "mdsmap_epoch": 9, 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_epoch": 25, 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "osdmap_epoch_barrier": 25, 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout: "uptime": 33.157225359999998 2024-04-18T03:38:01.208 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:38:01.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 -- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0178066730 msgr2=0x7f0178068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0178066730 0x7f0178068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0180007a70 tx=0x7f0180008040 comp rx=0 tx=0).stop 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 -- 172.21.15.157:0/1686521153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce6c0 msgr2=0x7f01980c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce6c0 0x7f01980c4610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0188000c00 tx=0x7f0188004770 comp rx=0 tx=0).stop 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 -- 172.21.15.157:0/1686521153 shutdown_connections 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0178066730 0x7f0178068bf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0198143fa0 0x7f01981396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01980ce6c0 0x7f01980c4610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 --2- 172.21.15.157:0/1686521153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01980ce260 0x7f01980c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 -- 172.21.15.157:0/1686521153 >> 172.21.15.157:0/1686521153 conn(0x7f019806e190 msgr2=0x7f01980ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 -- 172.21.15.157:0/1686521153 shutdown_connections 2024-04-18T03:38:01.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.203+0000 7f019e1ef700 1 -- 172.21.15.157:0/1686521153 wait complete. 2024-04-18T03:38:01.221 INFO:teuthology.run_tasks:Running task sequential... 2024-04-18T03:38:01.230 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-18T03:38:01.230 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-18T03:38:01.231 INFO:teuthology.task.print:Enabling mgr modules 2024-04-18T03:38:01.231 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-18T03:38:01.244 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-18T03:38:01.245 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-18T03:38:01.245 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-18T03:38:01.245 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T03:38:01.245 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:01.245 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-18T03:38:01.245 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T03:38:01.245 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-18T03:38:01.245 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-18T03:38:01.245 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T03:38:01.245 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-18T03:38:01.246 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-18T03:38:01.246 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T03:38:01.246 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-18T03:38:01.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.246 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-04-18T03:38:01.257 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-18T03:38:01.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.258 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-18T03:38:01.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.315 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2024-04-18T03:38:01.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.414 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-18T03:38:01.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.422 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-18T03:38:01.442 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2024-04-18T03:38:01.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:38:01.443 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-18T03:38:01.444 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T03:38:01.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.563+0000 7f258dc2e700 1 Processor -- start 2024-04-18T03:38:01.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.563+0000 7f258dc2e700 1 -- start start 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f25800e11d0 0x7f25800073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580038820 0x7f2580039f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2580051010 0x7f258003a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800078e0 con 0x7f2580051010 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2580006f10 con 0x7f25800e11d0 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258003a9f0 con 0x7f2580038820 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2580051010 0x7f258003a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2580051010 0x7f258003a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57256/0 (socket says 172.21.15.157:57256) 2024-04-18T03:38:01.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 -- 172.21.15.157:0/1294988473 learned_addr learned my addr 172.21.15.157:0/1294988473 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258cc2c700 1 --2- 172.21.15.157:0/1294988473 >> v2:172.21.15.175:3300/0 conn(0x7f25800e11d0 0x7f25800073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f2587fff700 1 --2- 172.21.15.157:0/1294988473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580038820 0x7f2580039f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 -- 172.21.15.157:0/1294988473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580038820 msgr2=0x7f2580039f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 --2- 172.21.15.157:0/1294988473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580038820 0x7f2580039f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 -- 172.21.15.157:0/1294988473 >> v2:172.21.15.175:3300/0 conn(0x7f25800e11d0 msgr2=0x7f25800073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 --2- 172.21.15.157:0/1294988473 >> v2:172.21.15.175:3300/0 conn(0x7f25800e11d0 0x7f25800073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 -- 172.21.15.157:0/1294988473 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800e15b0 con 0x7f2580051010 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f2587fff700 1 --2- 172.21.15.157:0/1294988473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580038820 0x7f2580039f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258d42d700 1 --2- 172.21.15.157:0/1294988473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2580051010 0x7f258003a4b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f258000c570 tx=0x7f257c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285494c97096cb6a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f25877fe700 1 -- 172.21.15.157:0/1294988473 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00b8a0 con 0x7f2580051010 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f25877fe700 1 -- 172.21.15.157:0/1294988473 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c00ba00 con 0x7f2580051010 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f25877fe700 1 -- 172.21.15.157:0/1294988473 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00bd90 con 0x7f2580051010 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 -- 172.21.15.157:0/1294988473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2580051010 msgr2=0x7f258003a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 --2- 172.21.15.157:0/1294988473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2580051010 0x7f258003a4b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f258000c570 tx=0x7f257c009bf0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 -- 172.21.15.157:0/1294988473 shutdown_connections 2024-04-18T03:38:01.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 --2- 172.21.15.157:0/1294988473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2580051010 0x7f258003a4b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 --2- 172.21.15.157:0/1294988473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580038820 0x7f2580039f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 --2- 172.21.15.157:0/1294988473 >> v2:172.21.15.175:3300/0 conn(0x7f25800e11d0 0x7f25800073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 -- 172.21.15.157:0/1294988473 >> 172.21.15.157:0/1294988473 conn(0x7f2580054b70 msgr2=0x7f2580054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:01.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 -- 172.21.15.157:0/1294988473 shutdown_connections 2024-04-18T03:38:01.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.567+0000 7f258dc2e700 1 -- 172.21.15.157:0/1294988473 wait complete. 2024-04-18T03:38:01.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 Processor -- start 2024-04-18T03:38:01.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 -- start start 2024-04-18T03:38:01.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2580038820 0x7f2580033a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580051010 0x7f25800cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25800e11d0 0x7f25800ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800e3630 con 0x7f25800e11d0 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800e29b0 con 0x7f2580038820 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800e2c90 con 0x7f2580051010 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25800e11d0 0x7f25800ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25800e11d0 0x7f25800ddee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57258/0 (socket says 172.21.15.157:57258) 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 -- 172.21.15.157:0/2566404110 learned_addr learned my addr 172.21.15.157:0/2566404110 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258cc2c700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2580038820 0x7f2580033a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f2587fff700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580051010 0x7f25800cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 -- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580051010 msgr2=0x7f25800cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580051010 0x7f25800cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 -- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2580038820 msgr2=0x7f2580033a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2580038820 0x7f2580033a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 -- 172.21.15.157:0/2566404110 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c009570 con 0x7f25800e11d0 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258d42d700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25800e11d0 0x7f25800ddee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f258000db90 tx=0x7f257c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f25857fa700 1 -- 172.21.15.157:0/2566404110 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c0038c0 con 0x7f25800e11d0 2024-04-18T03:38:01.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f25857fa700 1 -- 172.21.15.157:0/2566404110 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c01e070 con 0x7f25800e11d0 2024-04-18T03:38:01.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25800e2f70 con 0x7f25800e11d0 2024-04-18T03:38:01.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f25857fa700 1 -- 172.21.15.157:0/2566404110 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c003c60 con 0x7f25800e11d0 2024-04-18T03:38:01.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25800cefc0 con 0x7f25800e11d0 2024-04-18T03:38:01.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.571+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25800e3770 con 0x7f25800e11d0 2024-04-18T03:38:01.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.575+0000 7f25857fa700 1 -- 172.21.15.157:0/2566404110 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f257c02f430 con 0x7f25800e11d0 2024-04-18T03:38:01.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.575+0000 7f25857fa700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f256c066730 0x7f256c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:01.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.575+0000 7f25857fa700 1 -- 172.21.15.157:0/2566404110 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f257c020070 con 0x7f25800e11d0 2024-04-18T03:38:01.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.575+0000 7f258cc2c700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f256c066730 0x7f256c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:01.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.575+0000 7f258cc2c700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f256c066730 0x7f256c068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2588067f10 tx=0x7f2588061e30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:01.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.583+0000 7f25857fa700 1 -- 172.21.15.157:0/2566404110 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f257c052d40 con 0x7f25800e11d0 2024-04-18T03:38:01.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.787+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25800e3770 con 0x7f25800e11d0 2024-04-18T03:38:01.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.787+0000 7f25857fa700 1 -- 172.21.15.157:0/2566404110 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f25800e3770 con 0x7f25800e11d0 2024-04-18T03:38:01.791 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f256c066730 msgr2=0x7f256c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f256c066730 0x7f256c068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2588067f10 tx=0x7f2588061e30 comp rx=0 tx=0).stop 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25800e11d0 msgr2=0x7f25800ddee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25800e11d0 0x7f25800ddee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f258000db90 tx=0x7f257c004770 comp rx=0 tx=0).stop 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 shutdown_connections 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f256c066730 0x7f256c068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25800e11d0 0x7f25800ddee0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2580051010 0x7f25800cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 --2- 172.21.15.157:0/2566404110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2580038820 0x7f2580033a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:01.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 >> 172.21.15.157:0/2566404110 conn(0x7f2580054b70 msgr2=0x7f258004d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:01.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 shutdown_connections 2024-04-18T03:38:01.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:01.791+0000 7f258dc2e700 1 -- 172.21.15.157:0/2566404110 wait complete. 2024-04-18T03:38:01.805 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T03:38:01.805 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T03:38:01.805 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2024-04-18T03:38:01.805 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-18T03:38:01.806 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:01.806 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T03:38:01.806 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T03:38:01.806 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T03:38:01.806 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-18T03:38:01.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.806 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:01.814 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42589sec preferred_lft 42589sec 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 02:42:c1:95:ef:d6 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T03:38:01.815 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:01.816 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T03:38:01.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.816 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:01.816 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:01.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add name ceph-brx type bridge 2024-04-18T03:38:01.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr flush dev ceph-brx 2024-04-18T03:38:01.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set ceph-brx up 2024-04-18T03:38:01.816 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T03:38:01.816 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:01.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.858 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T03:38:01.870 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-04-18T03:38:01.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.872 DEBUG:teuthology.orchestra.run.smithi157:> route 2024-04-18T03:38:01.879 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2024-04-18T03:38:01.880 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T03:38:01.880 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T03:38:01.880 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T03:38:01.880 INFO:teuthology.orchestra.run.smithi157.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T03:38:01.880 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-04-18T03:38:01.880 INFO:teuthology.orchestra.run.smithi157.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T03:38:01.880 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T03:38:01.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.880 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:01.880 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:01.880 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T03:38:01.881 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T03:38:01.881 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T03:38:01.881 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:01.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.965 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-04-18T03:38:01.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.971 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2024-04-18T03:38:01.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:01.977 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:01.977 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:01.977 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T03:38:01.977 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-18T03:38:01.977 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:02.048 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-18T03:38:02.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:02.049 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:02.049 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:02.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-18T03:38:02.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T03:38:02.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-18T03:38:02.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-18T03:38:02.049 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-18T03:38:02.049 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:02.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:02.104 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:02.104 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:02.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2024-04-18T03:38:02.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T03:38:02.104 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:02.130 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-18T03:38:02.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:38:02.130 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:02.179 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-18T03:38:02.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:38:02.179 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:02.186 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:38:02.204 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:02.204 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:02.264 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:02.265 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:02.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:02.266 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:38:02.273 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T03:38:02.273 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-18T03:38:02.276 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:38:02.292 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:02.292 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:02.346 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:02.347 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:02.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:02.348 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:38:02.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi157.stderr:2024-04-18T03:38:02.363+0000 7ff150a04640 -1 init, newargv = 0x555dbebbd3b0 newargc=15 2024-04-18T03:38:02.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi157.stderr:ceph-fuse[32743]: starting ceph client 2024-04-18T03:38:02.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi157.stderr:ceph-fuse[32743]: starting fuse 2024-04-18T03:38:03.455 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:38:03.474 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:03.474 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:03.536 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:03.537 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:03.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:03.537 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:38:03.542 INFO:teuthology.orchestra.run.smithi157.stdout:52 2024-04-18T03:38:03.542 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-04-18T03:38:03.542 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-18T03:38:03.542 DEBUG:teuthology.orchestra.run.smithi157:> import glob 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> import re 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> import os 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> import subprocess 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> def _find_admin_socket(client_name): 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> files = glob.glob(asok_path) 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> # Given a non-glob path, it better be there 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> if "*" not in asok_path: 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> assert(len(files) == 1) 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> return files[0] 2024-04-18T03:38:03.543 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> for f in files: 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> contents = proc_f.read() 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> if mountpoint in contents: 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> return f 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> print(_find_admin_socket("client.0")) 2024-04-18T03:38:03.544 DEBUG:teuthology.orchestra.run.smithi157:> ' 2024-04-18T03:38:03.626 INFO:teuthology.orchestra.run.smithi157.stdout:/var/run/ceph/ceph-client.0.32743.asok 2024-04-18T03:38:03.814 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32743.asok 2024-04-18T03:38:03.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:03.814 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32743.asok status 2024-04-18T03:38:03.965 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:38:03.965 INFO:teuthology.orchestra.run.smithi157.stdout: "metadata": { 2024-04-18T03:38:03.965 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_sha1": "56a91dd158be807f143cc918a11685fc9ee164ae", 2024-04-18T03:38:03.965 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 18.2.2-1229-g56a91dd1 (56a91dd158be807f143cc918a11685fc9ee164ae) reef (stable)", 2024-04-18T03:38:03.965 INFO:teuthology.orchestra.run.smithi157.stdout: "entity_id": "0", 2024-04-18T03:38:03.965 INFO:teuthology.orchestra.run.smithi157.stdout: "hostname": "smithi157", 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "pid": "32743", 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "root": "/" 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_count": 0, 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_pinned_count": 0, 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 4890, 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "inst": { 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "name": { 2024-04-18T03:38:03.966 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "client", 2024-04-18T03:38:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: "num": 4890 2024-04-18T03:38:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:38:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-04-18T03:38:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-04-18T03:38:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2024-04-18T03:38:03.970 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 3113975224 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 3113975224 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "inst_str": "client.4890 192.168.0.1:0/3113975224", 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "addr_str": "192.168.0.1:0/3113975224", 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "inode_count": 1, 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_epoch": 9, 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch": 25, 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch_barrier": 0, 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "blocklisted": false, 2024-04-18T03:38:03.971 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs" 2024-04-18T03:38:03.972 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:38:03.976 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T03:38:04.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa127fff700 1 Processor -- start 2024-04-18T03:38:04.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa127fff700 1 -- start start 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa127fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 0x7fa1280ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa127fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa12806e810 0x7fa12806ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa127fff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12806f180 con 0x7fa12814a360 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa127fff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1280b25c0 con 0x7fa12806e810 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa127fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281621f0 con 0x7fa1280cdd20 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1277fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa12806e810 0x7fa12806ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1277fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa12806e810 0x7fa12806ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40866/0 (socket says 172.21.15.157:40866) 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1277fe700 1 -- 172.21.15.157:0/1312266636 learned_addr learned my addr 172.21.15.157:0/1312266636 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa126ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa12814a360 0x7fa128161ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:48962/0 (socket says 172.21.15.157:48962) 2024-04-18T03:38:04.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1267fc700 1 --2- 172.21.15.157:0/1312266636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 0x7fa1280ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:04.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1277fe700 1 -- 172.21.15.157:0/1312266636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 msgr2=0x7fa1280ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:04.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1277fe700 1 --2- 172.21.15.157:0/1312266636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 0x7fa1280ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1277fe700 1 -- 172.21.15.157:0/1312266636 >> v1:172.21.15.157:6789/0 conn(0x7fa12814a360 legacy=0x7fa128161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:04.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1277fe700 1 -- 172.21.15.157:0/1312266636 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280b1c20 con 0x7fa12806e810 2024-04-18T03:38:04.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.083+0000 7fa1277fe700 1 --2- 172.21.15.157:0/1312266636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12806ec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa120009940 tx=0x7fa120009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ab03cea462a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:04.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa125ffb700 1 -- 172.21.15.157:0/1312266636 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12000ba20 con 0x7fa12806e810 2024-04-18T03:38:04.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa125ffb700 1 -- 172.21.15.157:0/1312266636 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa120009e90 con 0x7fa12806e810 2024-04-18T03:38:04.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa125ffb700 1 -- 172.21.15.157:0/1312266636 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12000bda0 con 0x7fa12806e810 2024-04-18T03:38:04.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 -- 172.21.15.157:0/1312266636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 msgr2=0x7fa12806ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:04.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 --2- 172.21.15.157:0/1312266636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12806ec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa120009940 tx=0x7fa120009c50 comp rx=0 tx=0).stop 2024-04-18T03:38:04.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 -- 172.21.15.157:0/1312266636 shutdown_connections 2024-04-18T03:38:04.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 --2- 172.21.15.157:0/1312266636 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12806ec40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 --2- 172.21.15.157:0/1312266636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 0x7fa1280ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 -- 172.21.15.157:0/1312266636 >> 172.21.15.157:0/1312266636 conn(0x7fa1280b1330 msgr2=0x7fa12806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:04.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 -- 172.21.15.157:0/1312266636 shutdown_connections 2024-04-18T03:38:04.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 -- 172.21.15.157:0/1312266636 wait complete. 2024-04-18T03:38:04.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 Processor -- start 2024-04-18T03:38:04.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.087+0000 7fa127fff700 1 -- start start 2024-04-18T03:38:04.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa127fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12815e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:04.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa127fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 0x7fa12815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa127fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12814a360 0x7fa12815f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa127fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12815b100 con 0x7fa12806e810 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa127fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12815e670 con 0x7fa12814a360 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa127fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12815b770 con 0x7fa1280cdd20 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12815e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40870/0 (socket says 172.21.15.157:40870) 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 -- 172.21.15.157:0/3794475745 learned_addr learned my addr 172.21.15.157:0/3794475745 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa1267fc700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 0x7fa12815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa1277fe700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12814a360 0x7fa12815f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 -- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 msgr2=0x7fa12815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 0x7fa12815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 -- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12814a360 msgr2=0x7fa12815f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12814a360 0x7fa12815f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 -- 172.21.15.157:0/3794475745 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120009570 con 0x7fa12806e810 2024-04-18T03:38:04.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa126ffd700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12815e130 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c4e0 tx=0x7fa11800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:04.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa11f7fe700 1 -- 172.21.15.157:0/3794475745 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118005cd0 con 0x7fa12806e810 2024-04-18T03:38:04.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa11f7fe700 1 -- 172.21.15.157:0/3794475745 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118005e30 con 0x7fa12806e810 2024-04-18T03:38:04.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12815ccc0 con 0x7fa12806e810 2024-04-18T03:38:04.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa11f7fe700 1 -- 172.21.15.157:0/3794475745 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118007310 con 0x7fa12806e810 2024-04-18T03:38:04.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.091+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1281457f0 con 0x7fa12806e810 2024-04-18T03:38:04.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.095+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12804e650 con 0x7fa12806e810 2024-04-18T03:38:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.095+0000 7fa11f7fe700 1 -- 172.21.15.157:0/3794475745 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa118007470 con 0x7fa12806e810 2024-04-18T03:38:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.095+0000 7fa11f7fe700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa108066730 0x7fa108068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:04.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.095+0000 7fa11f7fe700 1 -- 172.21.15.157:0/3794475745 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa118083740 con 0x7fa12806e810 2024-04-18T03:38:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.095+0000 7fa1267fc700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa108066730 0x7fa108068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:04.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.095+0000 7fa1267fc700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa108066730 0x7fa108068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa128144c00 tx=0x7fa110009830 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:04.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.103+0000 7fa11f7fe700 1 -- 172.21.15.157:0/3794475745 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa118050850 con 0x7fa12806e810 2024-04-18T03:38:04.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.307+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa12806e2a0 con 0x7fa12806e810 2024-04-18T03:38:04.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa11f7fe700 1 -- 172.21.15.157:0/3794475745 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa118017070 con 0x7fa12806e810 2024-04-18T03:38:04.312 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-18T03:38:04.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa108066730 msgr2=0x7fa108068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:04.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa108066730 0x7fa108068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa128144c00 tx=0x7fa110009830 comp rx=0 tx=0).stop 2024-04-18T03:38:04.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 msgr2=0x7fa12815e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:04.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12815e130 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c4e0 tx=0x7fa11800c7f0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 shutdown_connections 2024-04-18T03:38:04.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa108066730 0x7fa108068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12814a360 0x7fa12815f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1280cdd20 0x7fa12815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 --2- 172.21.15.157:0/3794475745 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa12806e810 0x7fa12815e130 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:04.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 >> 172.21.15.157:0/3794475745 conn(0x7fa1280b1330 msgr2=0x7fa128070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:04.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 shutdown_connections 2024-04-18T03:38:04.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:04.311+0000 7fa127fff700 1 -- 172.21.15.157:0/3794475745 wait complete. 2024-04-18T03:38:04.327 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T03:38:04.327 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T03:38:04.327 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2024-04-18T03:38:04.328 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-18T03:38:04.328 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-18T03:38:04.328 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T03:38:04.328 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T03:38:04.328 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T03:38:04.328 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-18T03:38:04.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.328 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2024-04-18T03:38:04.333 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:38:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:38:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:38:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-04-18T03:38:04.333 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.333 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42586sec preferred_lft 42586sec 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T03:38:04.334 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 02:42:c1:95:ef:d6 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether f6:75:57:c2:7f:51 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ace2:b3ff:fefd:c443/64 scope link 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-18T03:38:04.335 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether f6:75:57:c2:7f:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T03:38:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::f475:57ff:fec2:7f51/64 scope link 2024-04-18T03:38:04.336 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.336 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T03:38:04.391 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-04-18T03:38:04.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.393 DEBUG:teuthology.orchestra.run.smithi157:> route 2024-04-18T03:38:04.402 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2024-04-18T03:38:04.402 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T03:38:04.402 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T03:38:04.402 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T03:38:04.402 INFO:teuthology.orchestra.run.smithi157.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T03:38:04.402 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-04-18T03:38:04.402 INFO:teuthology.orchestra.run.smithi157.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T03:38:04.402 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T03:38:04.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.403 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:04.403 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:04.403 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T03:38:04.403 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T03:38:04.403 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T03:38:04.403 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:04.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.439 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-04-18T03:38:04.447 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-18T03:38:04.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.447 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2024-04-18T03:38:04.454 INFO:teuthology.orchestra.run.smithi157.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-18T03:38:04.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.454 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:04.454 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:04.454 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-18T03:38:04.454 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-18T03:38:04.455 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:04.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.528 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-18T03:38:04.538 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:38:04.538 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 2e:05:84:47:3b:0c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::2c05:84ff:fe47:3b0c/64 scope link 2024-04-18T03:38:04.539 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.540 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 2e:05:84:47:3b:0c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-18T03:38:04.552 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::2c05:84ff:fe47:3b0c/64 scope link 2024-04-18T03:38:04.553 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:04.554 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-18T03:38:04.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.554 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:04.554 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:04.554 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-18T03:38:04.554 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-18T03:38:04.554 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-18T03:38:04.555 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-18T03:38:04.555 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-18T03:38:04.555 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:04.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.661 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-04-18T03:38:04.661 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-04-18T03:38:04.661 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.1 up 2024-04-18T03:38:04.662 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.1 master ceph-brx 2024-04-18T03:38:04.662 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-04-18T03:38:04.689 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-18T03:38:04.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:38:04.689 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-18T03:38:04.695 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-18T03:38:04.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:38:04.695 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-18T03:38:04.702 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:38:04.759 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:04.759 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:04.770 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:04.771 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:04.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.773 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:38:04.779 INFO:teuthology.orchestra.run.smithi157.stdout:52 2024-04-18T03:38:04.779 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-04-18T03:38:04.780 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-18T03:38:04.822 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:38:04.838 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:04.838 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:04.849 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:04.849 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:04.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:04.850 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:38:04.855 INFO:teuthology.orchestra.run.smithi157.stdout:52 2024-04-18T03:38:04.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi157.stderr:2024-04-18T03:38:04.911+0000 7f8886b6d640 -1 init, newargv = 0x55d8977a1480 newargc=15 2024-04-18T03:38:04.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi157.stderr:ceph-fuse[32887]: starting ceph client 2024-04-18T03:38:04.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi157.stderr:ceph-fuse[32887]: starting fuse 2024-04-18T03:38:05.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-04-18T03:38:05.975 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:05.975 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:06.032 INFO:teuthology.orchestra.run.smithi157.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:06.032 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:06.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:06.033 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-04-18T03:38:06.040 INFO:teuthology.orchestra.run.smithi157.stdout:52 2024-04-18T03:38:06.040 INFO:teuthology.orchestra.run.smithi157.stdout:53 2024-04-18T03:38:06.040 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> import glob 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> import re 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> import os 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> import subprocess 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> def _find_admin_socket(client_name): 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> files = glob.glob(asok_path) 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> # Given a non-glob path, it better be there 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> if "*" not in asok_path: 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> assert(len(files) == 1) 2024-04-18T03:38:06.041 DEBUG:teuthology.orchestra.run.smithi157:> return files[0] 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> for f in files: 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> contents = proc_f.read() 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> if mountpoint in contents: 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> return f 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> print(_find_admin_socket("client.2")) 2024-04-18T03:38:06.042 DEBUG:teuthology.orchestra.run.smithi157:> ' 2024-04-18T03:38:06.123 INFO:teuthology.orchestra.run.smithi157.stdout:/var/run/ceph/ceph-client.2.32887.asok 2024-04-18T03:38:06.308 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.32887.asok 2024-04-18T03:38:06.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:06.308 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.32887.asok status 2024-04-18T03:38:06.452 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:38:06.452 INFO:teuthology.orchestra.run.smithi157.stdout: "metadata": { 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_sha1": "56a91dd158be807f143cc918a11685fc9ee164ae", 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 18.2.2-1229-g56a91dd1 (56a91dd158be807f143cc918a11685fc9ee164ae) reef (stable)", 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "entity_id": "2", 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "hostname": "smithi157", 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "pid": "32887", 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "root": "/" 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_count": 0, 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_pinned_count": 0, 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 4846, 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "inst": { 2024-04-18T03:38:06.453 INFO:teuthology.orchestra.run.smithi157.stdout: "name": { 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "client", 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "num": 4846 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "172.21.15.157:0", 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 3292400371 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-04-18T03:38:06.454 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "172.21.15.157:0", 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 3292400371 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "inst_str": "client.4846 172.21.15.157:0/3292400371", 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "addr_str": "172.21.15.157:0/3292400371", 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "inode_count": 1, 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_epoch": 9, 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch": 25, 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch_barrier": 0, 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "blocklisted": false, 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs" 2024-04-18T03:38:06.455 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:38:06.463 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T03:38:06.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a1ef5700 1 Processor -- start 2024-04-18T03:38:06.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a1ef5700 1 -- start start 2024-04-18T03:38:06.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a1ef5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd59c06e810 0x7fd59c141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:06.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a1ef5700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59c142300 con 0x7fd59c1445a0 2024-04-18T03:38:06.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a1ef5700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59c1425e0 con 0x7fd59c15b590 2024-04-18T03:38:06.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a1ef5700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c142f80 con 0x7fd59c06e810 2024-04-18T03:38:06.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a0ef3700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd59c06e810 0x7fd59c141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:06.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a16f4700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd59c1445a0 0x7fd59c1433a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:48964/0 (socket says 172.21.15.157:48964) 2024-04-18T03:38:06.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a16f4700 1 -- 172.21.15.157:0/4071766089 learned_addr learned my addr 172.21.15.157:0/4071766089 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:38:06.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a0ef3700 1 -- 172.21.15.157:0/4071766089 >> v1:172.21.15.175:6789/0 conn(0x7fd59c15b590 legacy=0x7fd59c06ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:06.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a0ef3700 1 -- 172.21.15.157:0/4071766089 >> v1:172.21.15.157:6789/0 conn(0x7fd59c1445a0 legacy=0x7fd59c1433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:06.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd59b7fe700 1 -- 172.21.15.157:0/4071766089 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368526295 0 0) 0x7fd59c142300 con 0x7fd59c1445a0 2024-04-18T03:38:06.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a0ef3700 1 -- 172.21.15.157:0/4071766089 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c1428c0 con 0x7fd59c06e810 2024-04-18T03:38:06.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.571+0000 7fd5a0ef3700 1 --2- 172.21.15.157:0/4071766089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c141c00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd584009850 tx=0x7fd584009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d6461cc1d32c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:06.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd59b7fe700 1 -- 172.21.15.157:0/4071766089 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584011830 con 0x7fd59c06e810 2024-04-18T03:38:06.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd59b7fe700 1 -- 172.21.15.157:0/4071766089 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584011990 con 0x7fd59c06e810 2024-04-18T03:38:06.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd59b7fe700 1 -- 172.21.15.157:0/4071766089 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584011d20 con 0x7fd59c06e810 2024-04-18T03:38:06.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/4071766089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 msgr2=0x7fd59c141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:06.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 --2- 172.21.15.157:0/4071766089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c141c00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd584009850 tx=0x7fd584009b60 comp rx=0 tx=0).stop 2024-04-18T03:38:06.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/4071766089 shutdown_connections 2024-04-18T03:38:06.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 --2- 172.21.15.157:0/4071766089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c141c00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:06.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/4071766089 >> 172.21.15.157:0/4071766089 conn(0x7fd59c0b1330 msgr2=0x7fd59c06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:06.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/4071766089 shutdown_connections 2024-04-18T03:38:06.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/4071766089 wait complete. 2024-04-18T03:38:06.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 Processor -- start 2024-04-18T03:38:06.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.575+0000 7fd5a1ef5700 1 -- start start 2024-04-18T03:38:06.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c1f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:06.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd59c1445a0 0x7fd59c0aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:06.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd59c15b590 0x7fd59c0af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:06.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c12fae0 con 0x7fd59c06e810 2024-04-18T03:38:06.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0ae3f0 con 0x7fd59c15b590 2024-04-18T03:38:06.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0ae6d0 con 0x7fd59c1445a0 2024-04-18T03:38:06.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a0ef3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c1f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:06.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a16f4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd59c15b590 0x7fd59c0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:06.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a0ef3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c1f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40882/0 (socket says 172.21.15.157:40882) 2024-04-18T03:38:06.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd59bfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd59c1445a0 0x7fd59c0aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:06.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a0ef3700 1 -- 172.21.15.157:0/2679148004 learned_addr learned my addr 172.21.15.157:0/2679148004 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a16f4700 1 -- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd59c1445a0 msgr2=0x7fd59c0aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a16f4700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd59c1445a0 0x7fd59c0aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a16f4700 1 -- 172.21.15.157:0/2679148004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 msgr2=0x7fd59c1f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a16f4700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c1f0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a16f4700 1 -- 172.21.15.157:0/2679148004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840094b0 con 0x7fd59c15b590 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd59bfff700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd59c1445a0 0x7fd59c0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a0ef3700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c1f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a16f4700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd59c15b590 0x7fd59c0af400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd59400cbe0 tx=0x7fd59400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5997fa700 1 -- 172.21.15.157:0/2679148004 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400aaa0 con 0x7fd59c15b590 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5997fa700 1 -- 172.21.15.157:0/2679148004 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59400ac00 con 0x7fd59c15b590 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c12fd30 con 0x7fd59c15b590 2024-04-18T03:38:06.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5997fa700 1 -- 172.21.15.157:0/2679148004 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940070d0 con 0x7fd59c15b590 2024-04-18T03:38:06.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c1f0580 con 0x7fd59c15b590 2024-04-18T03:38:06.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.579+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c130250 con 0x7fd59c15b590 2024-04-18T03:38:06.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.583+0000 7fd5997fa700 1 -- 172.21.15.157:0/2679148004 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd594007230 con 0x7fd59c15b590 2024-04-18T03:38:06.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.583+0000 7fd5997fa700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd57c066730 0x7fd57c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:06.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.583+0000 7fd5997fa700 1 -- 172.21.15.157:0/2679148004 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd594084260 con 0x7fd59c15b590 2024-04-18T03:38:06.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.583+0000 7fd5a0ef3700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd57c066730 0x7fd57c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:06.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.583+0000 7fd5a0ef3700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd57c066730 0x7fd57c068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd584009fd0 tx=0x7fd584008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:06.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.591+0000 7fd5997fa700 1 -- 172.21.15.157:0/2679148004 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd5940513c0 con 0x7fd59c15b590 2024-04-18T03:38:06.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.799+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd59c130250 con 0x7fd59c15b590 2024-04-18T03:38:06.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.799+0000 7fd5997fa700 1 -- 172.21.15.157:0/2679148004 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd594018070 con 0x7fd59c15b590 2024-04-18T03:38:06.802 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-18T03:38:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd57c066730 msgr2=0x7fd57c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd57c066730 0x7fd57c068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd584009fd0 tx=0x7fd584008030 comp rx=0 tx=0).stop 2024-04-18T03:38:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd59c15b590 msgr2=0x7fd59c0af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd59c15b590 0x7fd59c0af400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd59400cbe0 tx=0x7fd59400cef0 comp rx=0 tx=0).stop 2024-04-18T03:38:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 shutdown_connections 2024-04-18T03:38:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd57c066730 0x7fd57c068bf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:06.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd59c15b590 0x7fd59c0af400 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:06.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd59c1445a0 0x7fd59c0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:06.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 --2- 172.21.15.157:0/2679148004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd59c06e810 0x7fd59c1f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:06.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 >> 172.21.15.157:0/2679148004 conn(0x7fd59c0b1330 msgr2=0x7fd59c15c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:06.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 shutdown_connections 2024-04-18T03:38:06.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:06.803+0000 7fd5a1ef5700 1 -- 172.21.15.157:0/2679148004 wait complete. 2024-04-18T03:38:06.823 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T03:38:06.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T03:38:06.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-18T03:38:06.823 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-18T03:38:06.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-18T03:38:06.824 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T03:38:06.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T03:38:06.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T03:38:06.824 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-18T03:38:06.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:06.824 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:06.832 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42553sec preferred_lft 42553sec 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:41:66:b1:72 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T03:38:06.833 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:06.834 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T03:38:06.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:06.834 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:06.834 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:06.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2024-04-18T03:38:06.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2024-04-18T03:38:06.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2024-04-18T03:38:06.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T03:38:06.834 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:06.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:06.921 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T03:38:06.930 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-18T03:38:06.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:06.932 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-18T03:38:06.950 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-18T03:38:06.951 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T03:38:06.951 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T03:38:06.951 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T03:38:06.951 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T03:38:06.951 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-04-18T03:38:06.951 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T03:38:06.951 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T03:38:06.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:06.951 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:06.952 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:06.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T03:38:06.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T03:38:06.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T03:38:06.952 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:07.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:07.035 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-18T03:38:07.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:07.041 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2024-04-18T03:38:07.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:07.049 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:07.049 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:07.049 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T03:38:07.049 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-18T03:38:07.049 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:07.076 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-18T03:38:07.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:07.077 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:07.077 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:07.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-18T03:38:07.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T03:38:07.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-18T03:38:07.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-18T03:38:07.077 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-18T03:38:07.077 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:07.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:07.141 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:07.142 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:07.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-18T03:38:07.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T03:38:07.142 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:07.166 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-18T03:38:07.166 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:38:07.166 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-18T03:38:07.173 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-18T03:38:07.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:38:07.173 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-18T03:38:07.178 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-04-18T03:38:07.193 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:07.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:07.207 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:07.207 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:07.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:07.208 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-04-18T03:38:07.213 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T03:38:07.213 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-18T03:38:07.258 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-04-18T03:38:07.274 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:07.274 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:07.285 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:07.285 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:07.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:07.286 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-04-18T03:38:07.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:2024-04-18T03:38:07.344+0000 7f5c9bbb9640 -1 init, newargv = 0x55cd7a0103a0 newargc=15 2024-04-18T03:38:07.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[31127]: starting ceph client 2024-04-18T03:38:07.359 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[31127]: starting fuse 2024-04-18T03:38:08.392 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-04-18T03:38:08.410 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:08.410 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:08.420 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:08.421 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:08.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:08.422 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-04-18T03:38:08.470 INFO:teuthology.orchestra.run.smithi175.stdout:52 2024-04-18T03:38:08.471 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> import re 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-18T03:38:08.471 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> return f 2024-04-18T03:38:08.472 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T03:38:08.473 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-18T03:38:08.473 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.1")) 2024-04-18T03:38:08.473 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-18T03:38:08.559 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.1.31127.asok 2024-04-18T03:38:08.742 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.31127.asok 2024-04-18T03:38:08.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:08.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.31127.asok status 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "56a91dd158be807f143cc918a11685fc9ee164ae", 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.2.2-1229-g56a91dd1 (56a91dd158be807f143cc918a11685fc9ee164ae) reef (stable)", 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "1", 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "31127", 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-18T03:38:08.847 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 14606, 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 14606 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2238896433 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2024-04-18T03:38:08.848 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2238896433 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.14606 192.168.0.1:0/2238896433", 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.1:0/2238896433", 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 9, 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 25, 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2024-04-18T03:38:08.849 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-18T03:38:08.857 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T03:38:08.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cc0ca6700 1 Processor -- start 2024-04-18T03:38:08.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cc0ca6700 1 -- start start 2024-04-18T03:38:08.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cc0ca6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cbc0b48a0 0x7f8cbc070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:08.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cc0ca6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc0ceb60 0x7f8cbc0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:08.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cc0ca6700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cbc0cd3e0 con 0x7f8cbc15d730 2024-04-18T03:38:08.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cc0ca6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cbc0b53f0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cc0ca6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc071710 con 0x7f8cbc0ceb60 2024-04-18T03:38:08.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cba59c700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8cbc15d730 0x7f8cbc0b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:59670/0 (socket says 172.21.15.157:59670) 2024-04-18T03:38:08.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cbad9d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc0ceb60 0x7f8cbc0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:08.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cb9d9b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cbc0b48a0 0x7f8cbc070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:08.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.979+0000 7f8cba59c700 1 -- 172.21.15.157:0/1252829939 learned_addr learned my addr 172.21.15.157:0/1252829939 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:38:08.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb959a700 1 -- 172.21.15.157:0/1252829939 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733904732 0 0) 0x7f8cbc0cd3e0 con 0x7f8cbc15d730 2024-04-18T03:38:08.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb959a700 1 -- 172.21.15.157:0/1252829939 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca40035d0 con 0x7f8cbc15d730 2024-04-18T03:38:08.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb9d9b700 1 -- 172.21.15.157:0/1252829939 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc0ceb60 msgr2=0x7f8cbc0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:38:08.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb9d9b700 1 --2- 172.21.15.157:0/1252829939 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc0ceb60 0x7f8cbc0705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:08.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb9d9b700 1 -- 172.21.15.157:0/1252829939 >> v1:172.21.15.175:6789/0 conn(0x7f8cbc15d730 legacy=0x7f8cbc0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:08.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb9d9b700 1 -- 172.21.15.157:0/1252829939 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc0719f0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cbad9d700 1 --2- 172.21.15.157:0/1252829939 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc0ceb60 0x7f8cbc0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:38:08.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb9d9b700 1 --2- 172.21.15.157:0/1252829939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc070070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009850 tx=0x7f8cb0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d2de07a092afca server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:08.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb959a700 1 -- 172.21.15.157:0/1252829939 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0011830 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb959a700 1 -- 172.21.15.157:0/1252829939 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb0011990 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cb959a700 1 -- 172.21.15.157:0/1252829939 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0011d40 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/1252829939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0b48a0 msgr2=0x7f8cbc070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:08.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/1252829939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc070070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009850 tx=0x7f8cb0009b60 comp rx=0 tx=0).stop 2024-04-18T03:38:08.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/1252829939 shutdown_connections 2024-04-18T03:38:08.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/1252829939 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc0ceb60 0x7f8cbc0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:08.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/1252829939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc070070 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:08.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/1252829939 >> 172.21.15.157:0/1252829939 conn(0x7f8cbc098a50 msgr2=0x7f8cbc0b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:08.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/1252829939 shutdown_connections 2024-04-18T03:38:08.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.983+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/1252829939 wait complete. 2024-04-18T03:38:08.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 Processor -- start 2024-04-18T03:38:08.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 -- start start 2024-04-18T03:38:08.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:08.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0ceb60 0x7f8cbc0c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:08.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc15d730 0x7f8cbc15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:08.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc0c89d0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc0c7930 con 0x7f8cbc0ceb60 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc0c7c10 con 0x7f8cbc15d730 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc15ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40894/0 (socket says 172.21.15.157:40894) 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 -- 172.21.15.157:0/4060482788 learned_addr learned my addr 172.21.15.157:0/4060482788 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cb9d9b700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0ceb60 0x7f8cbc0c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cbad9d700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc15d730 0x7f8cbc15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 -- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc15d730 msgr2=0x7f8cbc15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc15d730 0x7f8cbc15b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 -- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0ceb60 msgr2=0x7f8cbc0c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0ceb60 0x7f8cbc0c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 -- 172.21.15.157:0/4060482788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4009a70 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cba59c700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc15ac50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c4d0 tx=0x7f8cac00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:08.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8caaffd700 1 -- 172.21.15.157:0/4060482788 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac005d90 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8caaffd700 1 -- 172.21.15.157:0/4060482788 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac0070d0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb00094b0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8caaffd700 1 -- 172.21.15.157:0/4060482788 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac007480 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.987+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc0c81d0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.991+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc0676b0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.991+0000 7f8caaffd700 1 -- 172.21.15.157:0/4060482788 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8cac0075e0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.991+0000 7f8caaffd700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8c9c066730 0x7f8c9c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:38:08.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.991+0000 7f8caaffd700 1 -- 172.21.15.157:0/4060482788 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8cac0838e0 con 0x7f8cbc0b48a0 2024-04-18T03:38:08.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.991+0000 7f8cb9d9b700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8c9c066730 0x7f8c9c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:38:08.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.991+0000 7f8cb9d9b700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8c9c066730 0x7f8c9c068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00090b0 tx=0x7f8cb0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:38:09.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:08.999+0000 7f8caaffd700 1 -- 172.21.15.157:0/4060482788 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8cac0508e0 con 0x7f8cbc0b48a0 2024-04-18T03:38:09.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8cbc04e6c0 con 0x7f8cbc0b48a0 2024-04-18T03:38:09.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8caaffd700 1 -- 172.21.15.157:0/4060482788 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8cac053f00 con 0x7f8cbc0b48a0 2024-04-18T03:38:09.213 INFO:teuthology.orchestra.run.smithi157.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8c9c066730 msgr2=0x7f8c9c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8c9c066730 0x7f8c9c068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00090b0 tx=0x7f8cb0008030 comp rx=0 tx=0).stop 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cbc0b48a0 msgr2=0x7f8cbc15ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc15ac50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c4d0 tx=0x7f8cac00c7e0 comp rx=0 tx=0).stop 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 shutdown_connections 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8c9c066730 0x7f8c9c068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cbc0ceb60 0x7f8cbc0c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cbc15d730 0x7f8cbc15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 --2- 172.21.15.157:0/4060482788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8cbc0b48a0 0x7f8cbc15ac50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:38:09.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 >> 172.21.15.157:0/4060482788 conn(0x7f8cbc098a50 msgr2=0x7f8cbc0ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:38:09.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 shutdown_connections 2024-04-18T03:38:09.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:38:09.211+0000 7f8cc0ca6700 1 -- 172.21.15.157:0/4060482788 wait complete. 2024-04-18T03:38:09.228 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T03:38:09.228 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T03:38:09.228 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-18T03:38:09.228 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-18T03:38:09.228 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-18T03:38:09.229 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T03:38:09.229 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T03:38:09.229 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T03:38:09.229 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-18T03:38:09.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.229 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-18T03:38:09.237 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:38:09.237 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:38:09.237 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:38:09.237 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.237 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42551sec preferred_lft 42551sec 2024-04-18T03:38:09.238 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:41:66:b1:72 brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 2a:1d:4e:f2:1d:cf brd ff:ff:ff:ff:ff:ff 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::a46e:43ff:feec:7ba/64 scope link 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 2a:1d:4e:f2:1d:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::281d:4eff:fef2:1dcf/64 scope link 2024-04-18T03:38:09.239 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.240 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T03:38:09.253 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-18T03:38:09.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.255 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-18T03:38:09.308 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-18T03:38:09.308 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T03:38:09.309 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-18T03:38:09.309 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T03:38:09.309 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-18T03:38:09.309 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-04-18T03:38:09.309 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-18T03:38:09.309 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T03:38:09.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.309 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:09.309 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:09.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T03:38:09.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T03:38:09.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T03:38:09.310 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:09.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.349 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-18T03:38:09.354 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-18T03:38:09.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.355 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2024-04-18T03:38:09.362 INFO:teuthology.orchestra.run.smithi175.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-18T03:38:09.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.362 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:09.362 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:09.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-18T03:38:09.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-18T03:38:09.363 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:09.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:83:6f:11:9a:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c483:6fff:fe11:9a1f/64 scope link 2024-04-18T03:38:09.447 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.448 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-18T03:38:09.462 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T03:38:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T03:38:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T03:38:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-18T03:38:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.462 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-18T03:38:09.462 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:83:6f:11:9a:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-18T03:38:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-18T03:38:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c483:6fff:fe11:9a1f/64 scope link 2024-04-18T03:38:09.463 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-18T03:38:09.464 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-18T03:38:09.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.464 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:09.464 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:09.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-18T03:38:09.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-18T03:38:09.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-18T03:38:09.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-18T03:38:09.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-18T03:38:09.464 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:09.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.519 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-18T03:38:09.520 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-18T03:38:09.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.1 up 2024-04-18T03:38:09.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.1 master ceph-brx 2024-04-18T03:38:09.520 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-18T03:38:09.547 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-18T03:38:09.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:38:09.547 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-18T03:38:09.552 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-18T03:38:09.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T03:38:09.552 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-18T03:38:09.559 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-04-18T03:38:09.617 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:09.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:09.634 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:09.634 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:09.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.635 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-04-18T03:38:09.640 INFO:teuthology.orchestra.run.smithi175.stdout:52 2024-04-18T03:38:09.640 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-04-18T03:38:09.640 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-18T03:38:09.642 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-04-18T03:38:09.661 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:09.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:09.717 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:09.718 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:09.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:09.719 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-04-18T03:38:09.724 INFO:teuthology.orchestra.run.smithi175.stdout:52 2024-04-18T03:38:09.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:2024-04-18T03:38:09.728+0000 7fa030dbb640 -1 init, newargv = 0x562ff603c2b0 newargc=15 2024-04-18T03:38:09.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[31238]: starting ceph client 2024-04-18T03:38:09.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[31238]: starting fuse 2024-04-18T03:38:09.945 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:38:09.948 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:38:10.826 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2024-04-18T03:38:10.845 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-18T03:38:10.845 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-18T03:38:10.855 INFO:teuthology.orchestra.run.smithi175.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-18T03:38:10.856 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-18T03:38:10.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:10.857 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2024-04-18T03:38:10.906 INFO:teuthology.orchestra.run.smithi175.stdout:52 2024-04-18T03:38:10.906 INFO:teuthology.orchestra.run.smithi175.stdout:53 2024-04-18T03:38:10.906 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> import re 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2024-04-18T03:38:10.907 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> return f 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.3")) 2024-04-18T03:38:10.908 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-18T03:38:10.988 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.3.31238.asok 2024-04-18T03:38:11.175 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.31238.asok 2024-04-18T03:38:11.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.175 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.31238.asok status 2024-04-18T03:38:11.276 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-18T03:38:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2024-04-18T03:38:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "56a91dd158be807f143cc918a11685fc9ee164ae", 2024-04-18T03:38:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.2.2-1229-g56a91dd1 (56a91dd158be807f143cc918a11685fc9ee164ae) reef (stable)", 2024-04-18T03:38:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "3", 2024-04-18T03:38:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2024-04-18T03:38:11.276 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "31238", 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4876, 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4876 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2024-04-18T03:38:11.277 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 4023729163 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 4023729163 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-18T03:38:11.278 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4876 192.168.0.2:0/4023729163", 2024-04-18T03:38:11.279 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.2:0/4023729163", 2024-04-18T03:38:11.279 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2024-04-18T03:38:11.279 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 9, 2024-04-18T03:38:11.279 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 25, 2024-04-18T03:38:11.279 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2024-04-18T03:38:11.279 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2024-04-18T03:38:11.279 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2024-04-18T03:38:11.279 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-18T03:38:11.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.285 DEBUG:teuthology.orchestra.run.smithi157:> stat --file-system '--printf=%T 2024-04-18T03:38:11.286 DEBUG:teuthology.orchestra.run.smithi157:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:11.294 INFO:teuthology.orchestra.run.smithi157.stdout:fuseblk 2024-04-18T03:38:11.294 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:11.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.295 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:11.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.352 DEBUG:teuthology.orchestra.run.smithi157:> stat --file-system '--printf=%T 2024-04-18T03:38:11.352 DEBUG:teuthology.orchestra.run.smithi157:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-18T03:38:11.360 INFO:teuthology.orchestra.run.smithi157.stdout:fuseblk 2024-04-18T03:38:11.360 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-18T03:38:11.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-18T03:38:11.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.373 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2024-04-18T03:38:11.373 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-18T03:38:11.381 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2024-04-18T03:38:11.381 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-18T03:38:11.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-18T03:38:11.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.398 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2024-04-18T03:38:11.398 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-18T03:38:11.406 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2024-04-18T03:38:11.406 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-18T03:38:11.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:38:11.406 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-18T03:38:11.463 INFO:teuthology.run_tasks:Running task workunit... 2024-04-18T03:38:11.478 INFO:tasks.workunit:Pulling workunits from ref 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-18T03:38:11.479 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-18T03:38:11.479 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:11.487 INFO:teuthology.orchestra.run.smithi157.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:11.487 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-18T03:38:11.487 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 34h/52d Inode: 1 Links: 2 2024-04-18T03:38:11.487 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T03:38:11.488 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-18T03:38:11.488 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-18 03:37:34.277311073 +0000 2024-04-18T03:38:11.488 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-18 03:37:43.598240696 +0000 2024-04-18T03:38:11.488 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-04-18T03:38:11.488 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-18T03:38:11.488 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-18T03:38:11.511 INFO:tasks.workunit:timeout=3h 2024-04-18T03:38:11.511 INFO:tasks.workunit:cleanup=True 2024-04-18T03:38:11.511 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-18T03:38:11.519 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-18T03:38:40.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:38:40.024 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:39:10.120 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:39:10.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:39:22.873 INFO:tasks.workunit.client.0.smithi157.stderr:Note: switching to '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'. 2024-04-18T03:39:22.873 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-18T03:39:22.873 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-18T03:39:22.873 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-18T03:39:22.873 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-04-18T03:39:22.873 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr: git switch -c 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr:Or undo this operation with: 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr: git switch - 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr: 2024-04-18T03:39:22.874 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at 646b8c7d293 Merge pull request #56968 from zdover23/wip-doc-2024-04-18-backport-56879-to-reef 2024-04-18T03:39:22.878 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-18T03:39:22.900 INFO:tasks.workunit.client.0.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-18T03:39:22.904 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T03:39:22.904 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-18T03:39:23.758 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-18T03:39:23.835 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-18T03:39:23.898 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T03:39:23.900 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T03:39:23.900 INFO:tasks.workunit.client.0.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-18T03:39:23.956 INFO:tasks.workunit.client.0.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T03:39:23.961 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:39:23.961 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-18T03:39:23.968 INFO:tasks.workunit:Running workunits matching fs/maxentries on client.0... 2024-04-18T03:39:23.969 INFO:tasks.workunit:Running workunit fs/maxentries/maxentries.sh... 2024-04-18T03:39:23.969 DEBUG:teuthology.orchestra.run.smithi157:workunit test fs/maxentries/maxentries.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=646b8c7d293d8ec31a40c69f7b3237b19c1be24d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/maxentries/maxentries.sh 2024-04-18T03:39:23.997 INFO:tasks.workunit.client.0.smithi157.stderr:+ test_dir=max_entries 2024-04-18T03:39:23.997 INFO:tasks.workunit.client.0.smithi157.stderr:+ mkdir -p max_entries 2024-04-18T03:39:24.002 INFO:tasks.workunit.client.0.smithi157.stderr:+ pushd max_entries 2024-04-18T03:39:24.005 INFO:tasks.workunit.client.0.smithi157.stdout:~/cephtest/mnt.0/client.0/tmp/max_entries ~/cephtest/mnt.0/client.0/tmp 2024-04-18T03:39:24.006 INFO:tasks.workunit.client.0.smithi157.stderr:+ dir_max_entries=100 2024-04-18T03:39:24.006 INFO:tasks.workunit.client.0.smithi157.stderr:+ ceph config set mds mds_dir_max_entries 100 2024-04-18T03:39:24.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.117+0000 7fa6bca1c700 1 Processor -- start 2024-04-18T03:39:24.120 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.117+0000 7fa6bca1c700 1 -- start start 2024-04-18T03:39:24.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8142e10 0x7fa6b806d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:24.123 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa6b80ce4b0 0x7fa6b806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:24.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b81431f0 con 0x7fa6b8143950 2024-04-18T03:39:24.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b815e750 con 0x7fa6b80ce4b0 2024-04-18T03:39:24.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b815dad0 con 0x7fa6b8142e10 2024-04-18T03:39:24.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b5d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa6b8143950 0x7fa6b80cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:57250/0 (socket says 172.21.15.157:57250) 2024-04-18T03:39:24.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b5d9b700 1 -- 172.21.15.157:0/1282823863 learned_addr learned my addr 172.21.15.157:0/1282823863 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:39:24.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b6d9d700 1 --2- 172.21.15.157:0/1282823863 >> v2:172.21.15.157:3300/0 conn(0x7fa6b80ce4b0 0x7fa6b806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:24.124 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b659c700 1 --2- 172.21.15.157:0/1282823863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8142e10 0x7fa6b806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:24.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b559a700 1 -- 172.21.15.157:0/1282823863 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850822391 0 0) 0x7fa6b81431f0 con 0x7fa6b8143950 2024-04-18T03:39:24.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b559a700 1 -- 172.21.15.157:0/1282823863 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6a00035d0 con 0x7fa6b8143950 2024-04-18T03:39:24.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b6d9d700 1 -- 172.21.15.157:0/1282823863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8142e10 msgr2=0x7fa6b806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:39:24.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b6d9d700 1 --2- 172.21.15.157:0/1282823863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8142e10 0x7fa6b806d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b6d9d700 1 -- 172.21.15.157:0/1282823863 >> v1:172.21.15.157:6789/0 conn(0x7fa6b8143950 legacy=0x7fa6b80cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:24.125 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b6d9d700 1 -- 172.21.15.157:0/1282823863 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b815ddb0 con 0x7fa6b80ce4b0 2024-04-18T03:39:24.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b6d9d700 1 --2- 172.21.15.157:0/1282823863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b80ce4b0 0x7fa6b806d9b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009d90 tx=0x7fa6b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61344dbfdd24a24 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:39:24.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b559a700 1 -- 172.21.15.157:0/1282823863 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b000e070 con 0x7fa6b80ce4b0 2024-04-18T03:39:24.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b559a700 1 -- 172.21.15.157:0/1282823863 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b000bb20 con 0x7fa6b80ce4b0 2024-04-18T03:39:24.126 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6b559a700 1 -- 172.21.15.157:0/1282823863 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b000be90 con 0x7fa6b80ce4b0 2024-04-18T03:39:24.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 -- 172.21.15.157:0/1282823863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b80ce4b0 msgr2=0x7fa6b806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:24.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/1282823863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b80ce4b0 0x7fa6b806d9b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009d90 tx=0x7fa6b000b330 comp rx=0 tx=0).stop 2024-04-18T03:39:24.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 -- 172.21.15.157:0/1282823863 shutdown_connections 2024-04-18T03:39:24.133 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/1282823863 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b80ce4b0 0x7fa6b806d9b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/1282823863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8142e10 0x7fa6b806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 -- 172.21.15.157:0/1282823863 >> 172.21.15.157:0/1282823863 conn(0x7fa6b80cb920 msgr2=0x7fa6b80cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:39:24.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 -- 172.21.15.157:0/1282823863 shutdown_connections 2024-04-18T03:39:24.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.121+0000 7fa6bca1c700 1 -- 172.21.15.157:0/1282823863 wait complete. 2024-04-18T03:39:24.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6bca1c700 1 Processor -- start 2024-04-18T03:39:24.134 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6bca1c700 1 -- start start 2024-04-18T03:39:24.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6bca1c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b80ce4b0 0x7fa6b8141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:24.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6bca1c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b8142e10 0x7fa6b815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:24.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6bca1c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8143950 0x7fa6b80b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:24.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6bca1c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80b27f0 con 0x7fa6b8142e10 2024-04-18T03:39:24.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6bca1c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80b3370 con 0x7fa6b80ce4b0 2024-04-18T03:39:24.135 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6bca1c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8142340 con 0x7fa6b8143950 2024-04-18T03:39:24.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b8142e10 0x7fa6b815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:24.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b80ce4b0 0x7fa6b8141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:24.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b8142e10 0x7fa6b815ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33524/0 (socket says 172.21.15.157:33524) 2024-04-18T03:39:24.136 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 -- 172.21.15.157:0/3314781797 learned_addr learned my addr 172.21.15.157:0/3314781797 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:39:24.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b6d9d700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8143950 0x7fa6b80b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:24.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 -- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8143950 msgr2=0x7fa6b80b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:24.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8143950 0x7fa6b80b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 -- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b80ce4b0 msgr2=0x7fa6b8141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:24.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b80ce4b0 0x7fa6b8141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.137 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 -- 172.21.15.157:0/3314781797 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b0009a70 con 0x7fa6b8142e10 2024-04-18T03:39:24.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.125+0000 7fa6b5d9b700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b8142e10 0x7fa6b815ce40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c500 tx=0x7fa6a800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:39:24.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6a6ffd700 1 -- 172.21.15.157:0/3314781797 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8005d90 con 0x7fa6b8142e10 2024-04-18T03:39:24.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6a6ffd700 1 -- 172.21.15.157:0/3314781797 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a80070d0 con 0x7fa6b8142e10 2024-04-18T03:39:24.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b80b2a40 con 0x7fa6b8142e10 2024-04-18T03:39:24.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6a6ffd700 1 -- 172.21.15.157:0/3314781797 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8007480 con 0x7fa6b8142e10 2024-04-18T03:39:24.138 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b80b3000 con 0x7fa6b8142e10 2024-04-18T03:39:24.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b8074030 con 0x7fa6b8142e10 2024-04-18T03:39:24.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6a6ffd700 1 -- 172.21.15.157:0/3314781797 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6a80075e0 con 0x7fa6b8142e10 2024-04-18T03:39:24.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6a6ffd700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa698066730 0x7fa698068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:24.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6a6ffd700 1 -- 172.21.15.157:0/3314781797 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6a80838e0 con 0x7fa6b8142e10 2024-04-18T03:39:24.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.129+0000 7fa6b659c700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa698066730 0x7fa698068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:24.139 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.133+0000 7fa6b659c700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa698066730 0x7fa698068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac010c00 tx=0x7fa6ac012040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:39:24.140 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.137+0000 7fa6a6ffd700 1 -- 172.21.15.157:0/3314781797 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa6a8050890 con 0x7fa6b8142e10 2024-04-18T03:39:24.305 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.305+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) v1 -- 0x7fa6b806e030 con 0x7fa6b8142e10 2024-04-18T03:39:24.313 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.313+0000 7fa6a6ffd700 1 -- 172.21.15.157:0/3314781797 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v10)=0 v10) v1 ==== 119+0+0 (secure 0 0 0) 0x7fa6a8053eb0 con 0x7fa6b8142e10 2024-04-18T03:39:24.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.417+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) v1 -- 0x7fa6b814a3a0 con 0x7fa6b8142e10 2024-04-18T03:39:24.419 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.417+0000 7fa6a6ffd700 1 -- 172.21.15.157:0/3314781797 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v10)=0 v10) v1 ==== 119+0+0 (secure 0 0 0) 0x7fa6a8017020 con 0x7fa6b8142e10 2024-04-18T03:39:24.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa698066730 msgr2=0x7fa698068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:24.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa698066730 0x7fa698068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac010c00 tx=0x7fa6ac012040 comp rx=0 tx=0).stop 2024-04-18T03:39:24.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b8142e10 msgr2=0x7fa6b815ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:24.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b8142e10 0x7fa6b815ce40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c500 tx=0x7fa6a800c810 comp rx=0 tx=0).stop 2024-04-18T03:39:24.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 shutdown_connections 2024-04-18T03:39:24.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa698066730 0x7fa698068bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6b8143950 0x7fa6b80b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.422 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa6b8142e10 0x7fa6b815ce40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 --2- 172.21.15.157:0/3314781797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6b80ce4b0 0x7fa6b8141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:24.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 >> 172.21.15.157:0/3314781797 conn(0x7fa6b80cb920 msgr2=0x7fa6b80aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:39:24.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 shutdown_connections 2024-04-18T03:39:24.423 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:24.421+0000 7fa6bca1c700 1 -- 172.21.15.157:0/3314781797 wait complete. 2024-04-18T03:39:24.432 INFO:tasks.workunit.client.0.smithi157.stderr:+ ok_dir_max_entries=100 2024-04-18T03:39:24.432 INFO:tasks.workunit.client.0.smithi157.stderr:+ fail_dir_max_entries=101 2024-04-18T03:39:24.433 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_files 100 2024-04-18T03:39:24.433 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:39:24.454 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.454 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.454 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00747595 s, 0.0 kB/s 2024-04-18T03:39:24.484 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.484 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.484 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00448875 s, 0.0 kB/s 2024-04-18T03:39:24.497 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.497 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.497 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00441921 s, 0.0 kB/s 2024-04-18T03:39:24.510 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.510 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.510 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00485701 s, 0.0 kB/s 2024-04-18T03:39:24.523 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.523 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.523 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00486814 s, 0.0 kB/s 2024-04-18T03:39:24.536 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.536 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.536 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00465826 s, 0.0 kB/s 2024-04-18T03:39:24.549 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.549 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.549 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00451739 s, 0.0 kB/s 2024-04-18T03:39:24.562 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.562 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.562 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00441004 s, 0.0 kB/s 2024-04-18T03:39:24.575 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.575 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.575 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00450324 s, 0.0 kB/s 2024-04-18T03:39:24.587 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.587 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.587 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00437086 s, 0.0 kB/s 2024-04-18T03:39:24.600 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.600 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.600 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00444776 s, 0.0 kB/s 2024-04-18T03:39:24.613 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.613 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.614 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00476203 s, 0.0 kB/s 2024-04-18T03:39:24.627 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.627 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.627 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00514649 s, 0.0 kB/s 2024-04-18T03:39:24.640 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.640 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.640 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00453682 s, 0.0 kB/s 2024-04-18T03:39:24.654 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.654 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.654 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00524937 s, 0.0 kB/s 2024-04-18T03:39:24.667 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.667 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.667 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00452285 s, 0.0 kB/s 2024-04-18T03:39:24.681 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.681 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.681 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00552377 s, 0.0 kB/s 2024-04-18T03:39:24.695 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.695 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.695 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00510415 s, 0.0 kB/s 2024-04-18T03:39:24.708 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.708 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.708 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00513909 s, 0.0 kB/s 2024-04-18T03:39:24.721 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.722 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.722 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0051416 s, 0.0 kB/s 2024-04-18T03:39:24.735 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.735 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.735 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00497507 s, 0.0 kB/s 2024-04-18T03:39:24.748 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.748 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.748 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00475939 s, 0.0 kB/s 2024-04-18T03:39:24.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.761 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0054533 s, 0.0 kB/s 2024-04-18T03:39:24.774 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.774 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.774 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00518211 s, 0.0 kB/s 2024-04-18T03:39:24.786 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.786 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.786 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00507163 s, 0.0 kB/s 2024-04-18T03:39:24.798 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.799 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.799 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479495 s, 0.0 kB/s 2024-04-18T03:39:24.810 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.810 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.810 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00428717 s, 0.0 kB/s 2024-04-18T03:39:24.822 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.822 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.822 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00438269 s, 0.0 kB/s 2024-04-18T03:39:24.834 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.834 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.834 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00474005 s, 0.0 kB/s 2024-04-18T03:39:24.846 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.846 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.846 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046206 s, 0.0 kB/s 2024-04-18T03:39:24.858 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.858 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.858 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460359 s, 0.0 kB/s 2024-04-18T03:39:24.871 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.871 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.871 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0055295 s, 0.0 kB/s 2024-04-18T03:39:24.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.883 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00432042 s, 0.0 kB/s 2024-04-18T03:39:24.897 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.897 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.897 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00454495 s, 0.0 kB/s 2024-04-18T03:39:24.906 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.907 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.907 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00454746 s, 0.0 kB/s 2024-04-18T03:39:24.919 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.919 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.919 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00468718 s, 0.0 kB/s 2024-04-18T03:39:24.931 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.931 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.931 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00454555 s, 0.0 kB/s 2024-04-18T03:39:24.943 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.943 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.943 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046112 s, 0.0 kB/s 2024-04-18T03:39:24.954 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.955 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.955 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00431095 s, 0.0 kB/s 2024-04-18T03:39:24.966 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.967 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.967 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046497 s, 0.0 kB/s 2024-04-18T03:39:24.978 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.978 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.978 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00435657 s, 0.0 kB/s 2024-04-18T03:39:24.990 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:24.990 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:24.990 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00465695 s, 0.0 kB/s 2024-04-18T03:39:25.002 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.002 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.002 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00444592 s, 0.0 kB/s 2024-04-18T03:39:25.014 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.014 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.014 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460024 s, 0.0 kB/s 2024-04-18T03:39:25.026 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.026 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.026 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00447439 s, 0.0 kB/s 2024-04-18T03:39:25.038 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.038 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.038 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0045366 s, 0.0 kB/s 2024-04-18T03:39:25.050 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.050 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.050 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00443258 s, 0.0 kB/s 2024-04-18T03:39:25.063 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.063 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.063 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477938 s, 0.0 kB/s 2024-04-18T03:39:25.075 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.075 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.075 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460543 s, 0.0 kB/s 2024-04-18T03:39:25.088 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.089 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.089 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472924 s, 0.0 kB/s 2024-04-18T03:39:25.101 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.101 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.101 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00440039 s, 0.0 kB/s 2024-04-18T03:39:25.114 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.114 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.114 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00461331 s, 0.0 kB/s 2024-04-18T03:39:25.127 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.127 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.127 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00456169 s, 0.0 kB/s 2024-04-18T03:39:25.139 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.139 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.140 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00448148 s, 0.0 kB/s 2024-04-18T03:39:25.152 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.152 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.152 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00427918 s, 0.0 kB/s 2024-04-18T03:39:25.165 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.165 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.165 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00449492 s, 0.0 kB/s 2024-04-18T03:39:25.178 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.178 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.178 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00467473 s, 0.0 kB/s 2024-04-18T03:39:25.191 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.191 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.191 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00496179 s, 0.0 kB/s 2024-04-18T03:39:25.204 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.204 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.204 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048056 s, 0.0 kB/s 2024-04-18T03:39:25.216 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.216 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.216 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469014 s, 0.0 kB/s 2024-04-18T03:39:25.228 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.228 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.228 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00468615 s, 0.0 kB/s 2024-04-18T03:39:25.240 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.240 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.241 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00434569 s, 0.0 kB/s 2024-04-18T03:39:25.252 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.252 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.252 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00430321 s, 0.0 kB/s 2024-04-18T03:39:25.265 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.265 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.265 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00440595 s, 0.0 kB/s 2024-04-18T03:39:25.278 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.278 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.278 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00466107 s, 0.0 kB/s 2024-04-18T03:39:25.290 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.290 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.290 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00432868 s, 0.0 kB/s 2024-04-18T03:39:25.303 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.303 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.303 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00484989 s, 0.0 kB/s 2024-04-18T03:39:25.314 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.315 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.315 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00456788 s, 0.0 kB/s 2024-04-18T03:39:25.326 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.327 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.327 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00393663 s, 0.0 kB/s 2024-04-18T03:39:25.337 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.337 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.337 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046576 s, 0.0 kB/s 2024-04-18T03:39:25.349 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.349 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.349 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00468531 s, 0.0 kB/s 2024-04-18T03:39:25.360 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.361 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.361 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460503 s, 0.0 kB/s 2024-04-18T03:39:25.373 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.373 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.373 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479273 s, 0.0 kB/s 2024-04-18T03:39:25.386 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.386 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.386 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479631 s, 0.0 kB/s 2024-04-18T03:39:25.397 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.397 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.398 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0044606 s, 0.0 kB/s 2024-04-18T03:39:25.409 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.410 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.410 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.004423 s, 0.0 kB/s 2024-04-18T03:39:25.422 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.422 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.422 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478419 s, 0.0 kB/s 2024-04-18T03:39:25.434 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.434 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.434 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00450307 s, 0.0 kB/s 2024-04-18T03:39:25.448 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.448 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.448 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00519621 s, 0.0 kB/s 2024-04-18T03:39:25.460 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.460 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.460 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00481779 s, 0.0 kB/s 2024-04-18T03:39:25.472 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.472 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.472 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00430596 s, 0.0 kB/s 2024-04-18T03:39:25.485 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.485 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.485 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00453391 s, 0.0 kB/s 2024-04-18T03:39:25.496 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.496 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.496 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00416929 s, 0.0 kB/s 2024-04-18T03:39:25.508 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.509 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.509 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00452959 s, 0.0 kB/s 2024-04-18T03:39:25.521 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.521 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.521 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472372 s, 0.0 kB/s 2024-04-18T03:39:25.533 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.533 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.533 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479228 s, 0.0 kB/s 2024-04-18T03:39:25.545 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.545 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.545 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00456464 s, 0.0 kB/s 2024-04-18T03:39:25.558 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.558 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.558 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503291 s, 0.0 kB/s 2024-04-18T03:39:25.570 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.570 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.570 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00449054 s, 0.0 kB/s 2024-04-18T03:39:25.582 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.582 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.582 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046641 s, 0.0 kB/s 2024-04-18T03:39:25.594 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.594 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.594 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00450227 s, 0.0 kB/s 2024-04-18T03:39:25.607 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.607 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.607 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460372 s, 0.0 kB/s 2024-04-18T03:39:25.619 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.619 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.619 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472503 s, 0.0 kB/s 2024-04-18T03:39:25.631 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.631 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.631 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469403 s, 0.0 kB/s 2024-04-18T03:39:25.643 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.643 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.643 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00456192 s, 0.0 kB/s 2024-04-18T03:39:25.655 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.656 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.656 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00466062 s, 0.0 kB/s 2024-04-18T03:39:25.668 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.668 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.668 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00476353 s, 0.0 kB/s 2024-04-18T03:39:25.680 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.680 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.680 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469557 s, 0.0 kB/s 2024-04-18T03:39:25.692 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.692 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.692 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00422543 s, 0.0 kB/s 2024-04-18T03:39:25.704 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.704 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.704 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0047105 s, 0.0 kB/s 2024-04-18T03:39:25.707 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:39:25.707 INFO:tasks.workunit.client.0.smithi157.stderr:+ expect_false make_files 101 2024-04-18T03:39:25.707 INFO:tasks.workunit.client.0.smithi157.stderr:+ set -x 2024-04-18T03:39:25.707 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_files 101 2024-04-18T03:39:25.707 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:39:25.726 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.726 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.726 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00519708 s, 0.0 kB/s 2024-04-18T03:39:25.737 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.737 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.738 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00440721 s, 0.0 kB/s 2024-04-18T03:39:25.749 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.749 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.749 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00453076 s, 0.0 kB/s 2024-04-18T03:39:25.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.762 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046049 s, 0.0 kB/s 2024-04-18T03:39:25.773 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.773 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.773 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00450149 s, 0.0 kB/s 2024-04-18T03:39:25.785 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.785 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.785 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00438046 s, 0.0 kB/s 2024-04-18T03:39:25.797 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.797 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.797 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00442314 s, 0.0 kB/s 2024-04-18T03:39:25.810 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.810 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.810 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00518403 s, 0.0 kB/s 2024-04-18T03:39:25.822 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.822 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.822 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00482842 s, 0.0 kB/s 2024-04-18T03:39:25.834 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.834 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.834 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00468115 s, 0.0 kB/s 2024-04-18T03:39:25.846 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.846 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.846 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00436215 s, 0.0 kB/s 2024-04-18T03:39:25.858 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.858 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.858 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00483015 s, 0.0 kB/s 2024-04-18T03:39:25.871 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.871 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.871 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00536307 s, 0.0 kB/s 2024-04-18T03:39:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.883 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00457191 s, 0.0 kB/s 2024-04-18T03:39:25.895 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.895 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.895 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00456025 s, 0.0 kB/s 2024-04-18T03:39:25.908 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.908 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.908 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00482335 s, 0.0 kB/s 2024-04-18T03:39:25.920 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.920 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.920 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00480633 s, 0.0 kB/s 2024-04-18T03:39:25.933 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.934 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.934 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0044252 s, 0.0 kB/s 2024-04-18T03:39:25.943 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.943 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.943 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0037025 s, 0.0 kB/s 2024-04-18T03:39:25.954 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.954 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.954 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0043479 s, 0.0 kB/s 2024-04-18T03:39:25.965 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.966 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.966 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00426363 s, 0.0 kB/s 2024-04-18T03:39:25.978 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.978 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.978 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00474136 s, 0.0 kB/s 2024-04-18T03:39:25.990 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:25.990 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:25.990 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0044967 s, 0.0 kB/s 2024-04-18T03:39:26.001 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.002 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.002 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00449634 s, 0.0 kB/s 2024-04-18T03:39:26.013 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.014 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.014 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00425675 s, 0.0 kB/s 2024-04-18T03:39:26.026 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.026 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.026 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00496874 s, 0.0 kB/s 2024-04-18T03:39:26.037 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.037 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.037 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00417441 s, 0.0 kB/s 2024-04-18T03:39:26.049 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.050 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.050 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00494965 s, 0.0 kB/s 2024-04-18T03:39:26.061 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.061 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.061 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00456526 s, 0.0 kB/s 2024-04-18T03:39:26.074 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.074 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.074 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00497322 s, 0.0 kB/s 2024-04-18T03:39:26.086 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.086 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.086 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00475587 s, 0.0 kB/s 2024-04-18T03:39:26.098 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.098 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.098 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0050032 s, 0.0 kB/s 2024-04-18T03:39:26.110 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.111 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.111 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00450507 s, 0.0 kB/s 2024-04-18T03:39:26.122 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.122 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.123 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00445255 s, 0.0 kB/s 2024-04-18T03:39:26.135 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.135 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.135 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00471289 s, 0.0 kB/s 2024-04-18T03:39:26.147 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.147 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.147 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00487428 s, 0.0 kB/s 2024-04-18T03:39:26.160 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.160 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.160 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00487582 s, 0.0 kB/s 2024-04-18T03:39:26.172 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.172 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.172 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00494177 s, 0.0 kB/s 2024-04-18T03:39:26.185 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.185 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.185 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00546717 s, 0.0 kB/s 2024-04-18T03:39:26.197 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.197 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.197 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478385 s, 0.0 kB/s 2024-04-18T03:39:26.210 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.210 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.210 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00507237 s, 0.0 kB/s 2024-04-18T03:39:26.222 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.222 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.222 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00461917 s, 0.0 kB/s 2024-04-18T03:39:26.234 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.235 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.235 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00512935 s, 0.0 kB/s 2024-04-18T03:39:26.247 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.247 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.247 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00507091 s, 0.0 kB/s 2024-04-18T03:39:26.260 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.260 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.260 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00493873 s, 0.0 kB/s 2024-04-18T03:39:26.272 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.272 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.272 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00430407 s, 0.0 kB/s 2024-04-18T03:39:26.284 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.284 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.284 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00422522 s, 0.0 kB/s 2024-04-18T03:39:26.295 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.295 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.295 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00412737 s, 0.0 kB/s 2024-04-18T03:39:26.308 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.308 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.308 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00448179 s, 0.0 kB/s 2024-04-18T03:39:26.316 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.317 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.317 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00347429 s, 0.0 kB/s 2024-04-18T03:39:26.325 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.325 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.325 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0035172 s, 0.0 kB/s 2024-04-18T03:39:26.334 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.334 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.335 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00361884 s, 0.0 kB/s 2024-04-18T03:39:26.345 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.345 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.345 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00422895 s, 0.0 kB/s 2024-04-18T03:39:26.356 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.356 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.356 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00432846 s, 0.0 kB/s 2024-04-18T03:39:26.368 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.369 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.369 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00485357 s, 0.0 kB/s 2024-04-18T03:39:26.380 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.381 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.381 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00435026 s, 0.0 kB/s 2024-04-18T03:39:26.395 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.395 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.395 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0051269 s, 0.0 kB/s 2024-04-18T03:39:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.407 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00412669 s, 0.0 kB/s 2024-04-18T03:39:26.419 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.419 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.419 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00441732 s, 0.0 kB/s 2024-04-18T03:39:26.431 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.431 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.431 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00423695 s, 0.0 kB/s 2024-04-18T03:39:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.443 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.004833 s, 0.0 kB/s 2024-04-18T03:39:26.455 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.455 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.455 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00434127 s, 0.0 kB/s 2024-04-18T03:39:26.467 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.467 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.467 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00462109 s, 0.0 kB/s 2024-04-18T03:39:26.479 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.479 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.479 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00428917 s, 0.0 kB/s 2024-04-18T03:39:26.491 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.491 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.491 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00480359 s, 0.0 kB/s 2024-04-18T03:39:26.503 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.503 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.503 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00449811 s, 0.0 kB/s 2024-04-18T03:39:26.515 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.515 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.515 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00415347 s, 0.0 kB/s 2024-04-18T03:39:26.527 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.527 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.528 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00446563 s, 0.0 kB/s 2024-04-18T03:39:26.539 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.539 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.539 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00446285 s, 0.0 kB/s 2024-04-18T03:39:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00439744 s, 0.0 kB/s 2024-04-18T03:39:26.563 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.563 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.564 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0044532 s, 0.0 kB/s 2024-04-18T03:39:26.576 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.576 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.576 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00497894 s, 0.0 kB/s 2024-04-18T03:39:26.588 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.588 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.588 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048697 s, 0.0 kB/s 2024-04-18T03:39:26.601 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.601 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.601 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048582 s, 0.0 kB/s 2024-04-18T03:39:26.613 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.613 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.613 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00444224 s, 0.0 kB/s 2024-04-18T03:39:26.625 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.625 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.626 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478283 s, 0.0 kB/s 2024-04-18T03:39:26.638 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.638 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.638 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460664 s, 0.0 kB/s 2024-04-18T03:39:26.650 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.650 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.650 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00446856 s, 0.0 kB/s 2024-04-18T03:39:26.661 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.662 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.662 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00438122 s, 0.0 kB/s 2024-04-18T03:39:26.673 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.674 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.674 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469603 s, 0.0 kB/s 2024-04-18T03:39:26.685 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.685 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.686 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00439363 s, 0.0 kB/s 2024-04-18T03:39:26.698 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.698 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.698 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00465305 s, 0.0 kB/s 2024-04-18T03:39:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.709 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0044658 s, 0.0 kB/s 2024-04-18T03:39:26.722 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.723 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.723 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503198 s, 0.0 kB/s 2024-04-18T03:39:26.735 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.735 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.735 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478063 s, 0.0 kB/s 2024-04-18T03:39:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00445295 s, 0.0 kB/s 2024-04-18T03:39:26.759 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.760 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.760 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00480493 s, 0.0 kB/s 2024-04-18T03:39:26.771 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.771 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.772 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0045849 s, 0.0 kB/s 2024-04-18T03:39:26.783 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.784 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.784 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00461927 s, 0.0 kB/s 2024-04-18T03:39:26.796 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.796 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.796 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00451119 s, 0.0 kB/s 2024-04-18T03:39:26.807 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.808 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.808 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00448733 s, 0.0 kB/s 2024-04-18T03:39:26.820 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.820 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.820 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00449148 s, 0.0 kB/s 2024-04-18T03:39:26.832 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.832 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.832 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00508952 s, 0.0 kB/s 2024-04-18T03:39:26.844 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.844 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.844 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00492133 s, 0.0 kB/s 2024-04-18T03:39:26.856 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.856 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.856 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00494854 s, 0.0 kB/s 2024-04-18T03:39:26.869 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.870 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.870 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0047329 s, 0.0 kB/s 2024-04-18T03:39:26.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.883 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00495143 s, 0.0 kB/s 2024-04-18T03:39:26.895 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.895 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.895 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0049065 s, 0.0 kB/s 2024-04-18T03:39:26.907 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.907 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.907 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00491881 s, 0.0 kB/s 2024-04-18T03:39:26.920 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:26.920 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:26.920 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0050431 s, 0.0 kB/s 2024-04-18T03:39:26.927 INFO:tasks.workunit.client.0.smithi157.stderr:dd: failed to open 'mkfile_test_Gr7dLg/file_101': No space left on device 2024-04-18T03:39:28.196 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:39:28.196 INFO:tasks.workunit.client.0.smithi157.stderr:+ expect_false make_dirs 101 2024-04-18T03:39:28.196 INFO:tasks.workunit.client.0.smithi157.stderr:+ set -x 2024-04-18T03:39:28.197 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_dirs 101 2024-04-18T03:39:28.197 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:39:29.437 INFO:tasks.workunit.client.0.smithi157.stderr:mkdir: cannot create directory 'mkdir_test_AkbDpV/dir_101': No space left on device 2024-04-18T03:39:30.654 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:39:30.654 INFO:tasks.workunit.client.0.smithi157.stderr:+ expect_false make_nodes 101 2024-04-18T03:39:30.654 INFO:tasks.workunit.client.0.smithi157.stderr:+ set -x 2024-04-18T03:39:30.654 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_nodes 101 2024-04-18T03:39:30.654 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:39:31.884 INFO:tasks.workunit.client.0.smithi157.stderr:mknod: mknod_test_K8Rjbd/fifo_101: No space left on device 2024-04-18T03:39:33.966 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:39:33.966 INFO:tasks.workunit.client.0.smithi157.stderr:+ expect_false rename_files 101 2024-04-18T03:39:33.966 INFO:tasks.workunit.client.0.smithi157.stderr:+ set -x 2024-04-18T03:39:33.966 INFO:tasks.workunit.client.0.smithi157.stderr:+ rename_files 101 2024-04-18T03:39:33.966 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:39:35.993 INFO:tasks.workunit.client.0.smithi157.stderr:mv: cannot move 'rename_test_JbUZeI/file_101' to 'rename_test_JbUZeI/rename/file_101': No space left on device 2024-04-18T03:39:36.841 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:39:36.841 INFO:tasks.workunit.client.0.smithi157.stderr:+ expect_false make_symlinks 101 2024-04-18T03:39:36.841 INFO:tasks.workunit.client.0.smithi157.stderr:+ set -x 2024-04-18T03:39:36.841 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_symlinks 101 2024-04-18T03:39:36.841 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:39:37.701 INFO:tasks.workunit.client.0.smithi157.stderr:ln: failed to create symbolic link 'symlink_test_mXfOxz/symlink/sym_101': No space left on device 2024-04-18T03:39:39.451 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:39:39.451 INFO:tasks.workunit.client.0.smithi157.stderr:+ expect_false make_links 101 2024-04-18T03:39:39.451 INFO:tasks.workunit.client.0.smithi157.stderr:+ set -x 2024-04-18T03:39:39.452 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_links 101 2024-04-18T03:39:39.452 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:39:40.176 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:39:40.179 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:39:41.197 INFO:tasks.workunit.client.0.smithi157.stderr:ln: failed to create hard link 'link_test_KJVB4P/link/link_101': No space left on device 2024-04-18T03:39:41.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.309+0000 7f1f51eaf700 1 Processor -- start 2024-04-18T03:39:41.311 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.309+0000 7f1f51eaf700 1 -- start start 2024-04-18T03:39:41.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.309+0000 7f1f51eaf700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1f4c158fe0 0x7f1f4c0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:41.314 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.309+0000 7f1f51eaf700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1f4c0708b0 0x7f1f4c0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.309+0000 7f1f51eaf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0b4d80 con 0x7f1f4c0b4920 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.309+0000 7f1f51eaf700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c070d00 con 0x7f1f4c0708b0 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.309+0000 7f1f51eaf700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c15cd10 con 0x7f1f4c158fe0 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1f4c0708b0 0x7f1f4c0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1f4c0708b0 0x7f1f4c0ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35896/0 (socket says 172.21.15.157:35896) 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4bfff700 1 -- 172.21.15.157:0/1755255700 learned_addr learned my addr 172.21.15.157:0/1755255700 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4b7fe700 1 --2- 172.21.15.157:0/1755255700 >> v2:172.21.15.175:3300/0 conn(0x7f1f4c158fe0 0x7f1f4c0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4bfff700 1 -- 172.21.15.157:0/1755255700 >> v2:172.21.15.175:3300/0 conn(0x7f1f4c158fe0 msgr2=0x7f1f4c0b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:39:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4bfff700 1 --2- 172.21.15.157:0/1755255700 >> v2:172.21.15.175:3300/0 conn(0x7f1f4c158fe0 0x7f1f4c0b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4bfff700 1 -- 172.21.15.157:0/1755255700 >> v1:172.21.15.175:6789/0 conn(0x7f1f4c0b4920 legacy=0x7f1f4c0701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4bfff700 1 -- 172.21.15.157:0/1755255700 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c15cff0 con 0x7f1f4c0708b0 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4b7fe700 1 --2- 172.21.15.157:0/1755255700 >> v2:172.21.15.175:3300/0 conn(0x7f1f4c158fe0 0x7f1f4c0b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4bfff700 1 --2- 172.21.15.157:0/1755255700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c0ccf40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c06e110 tx=0x7f1f4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42931d36867aa024 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4a7fc700 1 -- 172.21.15.157:0/1755255700 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400e070 con 0x7f1f4c0708b0 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4a7fc700 1 -- 172.21.15.157:0/1755255700 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44003a40 con 0x7f1f4c0708b0 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f4a7fc700 1 -- 172.21.15.157:0/1755255700 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44003df0 con 0x7f1f4c0708b0 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f51eaf700 1 -- 172.21.15.157:0/1755255700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 msgr2=0x7f1f4c0ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/1755255700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c0ccf40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c06e110 tx=0x7f1f4400b330 comp rx=0 tx=0).stop 2024-04-18T03:39:41.316 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f51eaf700 1 -- 172.21.15.157:0/1755255700 shutdown_connections 2024-04-18T03:39:41.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/1755255700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c0ccf40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/1755255700 >> v2:172.21.15.175:3300/0 conn(0x7f1f4c158fe0 0x7f1f4c0b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f51eaf700 1 -- 172.21.15.157:0/1755255700 >> 172.21.15.157:0/1755255700 conn(0x7f1f4c0cb920 msgr2=0x7f1f4c0cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:39:41.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f51eaf700 1 -- 172.21.15.157:0/1755255700 shutdown_connections 2024-04-18T03:39:41.317 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.313+0000 7f1f51eaf700 1 -- 172.21.15.157:0/1755255700 wait complete. 2024-04-18T03:39:41.318 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.317+0000 7f1f51eaf700 1 Processor -- start 2024-04-18T03:39:41.319 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.317+0000 7f1f51eaf700 1 -- start start 2024-04-18T03:39:41.322 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f4c0b4920 0x7f1f4c0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f4c158fe0 0x7f1f4c0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0cb280 con 0x7f1f4c0708b0 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0cb560 con 0x7f1f4c158fe0 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c13e280 con 0x7f1f4c0b4920 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c13ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:35910/0 (socket says 172.21.15.157:35910) 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 -- 172.21.15.157:0/535699929 learned_addr learned my addr 172.21.15.157:0/535699929 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4bfff700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f4c158fe0 0x7f1f4c0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4affd700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f4c0b4920 0x7f1f4c0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 -- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f4c0b4920 msgr2=0x7f1f4c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:41.323 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f4c0b4920 0x7f1f4c0ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 -- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f4c158fe0 msgr2=0x7f1f4c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f4c158fe0 0x7f1f4c0cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 -- 172.21.15.157:0/535699929 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44009b30 con 0x7f1f4c0708b0 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f4b7fe700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c13ed60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c7c0 tx=0x7f1f4000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f33fff700 1 -- 172.21.15.157:0/535699929 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40011800 con 0x7f1f4c0708b0 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c13e560 con 0x7f1f4c0708b0 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f33fff700 1 -- 172.21.15.157:0/535699929 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40011960 con 0x7f1f4c0708b0 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f33fff700 1 -- 172.21.15.157:0/535699929 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40011cf0 con 0x7f1f4c0708b0 2024-04-18T03:39:41.324 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c1392b0 con 0x7f1f4c0708b0 2024-04-18T03:39:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.321+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c06e140 con 0x7f1f4c0708b0 2024-04-18T03:39:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.325+0000 7f1f33fff700 1 -- 172.21.15.157:0/535699929 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f40023480 con 0x7f1f4c0708b0 2024-04-18T03:39:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.325+0000 7f1f33fff700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1f38066730 0x7f1f38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:39:41.325 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.325+0000 7f1f33fff700 1 -- 172.21.15.157:0/535699929 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1f40084780 con 0x7f1f4c0708b0 2024-04-18T03:39:41.326 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.325+0000 7f1f4affd700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1f38066730 0x7f1f38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:39:41.327 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.325+0000 7f1f4affd700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1f38066730 0x7f1f38068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c005150 tx=0x7f1f3c007ee0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:39:41.334 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.333+0000 7f1f33fff700 1 -- 172.21.15.157:0/535699929 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1f40051740 con 0x7f1f4c0708b0 2024-04-18T03:39:41.509 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.509+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) v1 -- 0x7f1f4c074030 con 0x7f1f4c0708b0 2024-04-18T03:39:41.517 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.517+0000 7f1f33fff700 1 -- 172.21.15.157:0/535699929 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v11)=0 v11) v1 ==== 117+0+0 (secure 0 0 0) 0x7f1f40054d60 con 0x7f1f4c0708b0 2024-04-18T03:39:41.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.617+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) v1 -- 0x7f1f4c14b450 con 0x7f1f4c0708b0 2024-04-18T03:39:41.620 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f33fff700 1 -- 172.21.15.157:0/535699929 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v11)=0 v11) v1 ==== 117+0+0 (secure 0 0 0) 0x7f1f4001e030 con 0x7f1f4c0708b0 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1f38066730 msgr2=0x7f1f38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1f38066730 0x7f1f38068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c005150 tx=0x7f1f3c007ee0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 msgr2=0x7f1f4c13ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c13ed60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c7c0 tx=0x7f1f4000cad0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 shutdown_connections 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1f38066730 0x7f1f38068bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f4c158fe0 0x7f1f4c0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f4c0b4920 0x7f1f4c0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 --2- 172.21.15.157:0/535699929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f4c0708b0 0x7f1f4c13ed60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 >> 172.21.15.157:0/535699929 conn(0x7f1f4c0cb920 msgr2=0x7f1f4c06c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 shutdown_connections 2024-04-18T03:39:41.624 INFO:tasks.workunit.client.0.smithi157.stderr:2024-04-18T03:39:41.621+0000 7f1f51eaf700 1 -- 172.21.15.157:0/535699929 wait complete. 2024-04-18T03:39:41.699 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.699 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.699 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0520173 s, 0.0 kB/s 2024-04-18T03:39:41.711 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.711 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.711 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0045643 s, 0.0 kB/s 2024-04-18T03:39:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.724 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.724 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00456988 s, 0.0 kB/s 2024-04-18T03:39:41.737 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.737 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.737 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00529269 s, 0.0 kB/s 2024-04-18T03:39:41.750 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.750 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.750 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00527756 s, 0.0 kB/s 2024-04-18T03:39:41.762 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.762 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.763 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00484179 s, 0.0 kB/s 2024-04-18T03:39:41.775 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.775 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.775 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0050002 s, 0.0 kB/s 2024-04-18T03:39:41.787 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.788 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.788 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0056718 s, 0.0 kB/s 2024-04-18T03:39:41.799 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.799 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.799 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00458277 s, 0.0 kB/s 2024-04-18T03:39:41.812 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.812 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.812 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00505394 s, 0.0 kB/s 2024-04-18T03:39:41.824 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.824 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.824 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477032 s, 0.0 kB/s 2024-04-18T03:39:41.837 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.838 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.838 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0051215 s, 0.0 kB/s 2024-04-18T03:39:41.849 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.850 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.850 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00457379 s, 0.0 kB/s 2024-04-18T03:39:41.862 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.862 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.862 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00507455 s, 0.0 kB/s 2024-04-18T03:39:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.875 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00495859 s, 0.0 kB/s 2024-04-18T03:39:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.888 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00521241 s, 0.0 kB/s 2024-04-18T03:39:41.900 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.901 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.901 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478937 s, 0.0 kB/s 2024-04-18T03:39:41.913 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.913 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.913 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00511119 s, 0.0 kB/s 2024-04-18T03:39:41.926 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.926 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.926 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00556383 s, 0.0 kB/s 2024-04-18T03:39:41.937 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.937 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.937 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00430821 s, 0.0 kB/s 2024-04-18T03:39:41.947 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.947 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.947 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00400904 s, 0.0 kB/s 2024-04-18T03:39:41.959 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.959 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.959 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00452777 s, 0.0 kB/s 2024-04-18T03:39:41.971 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.971 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.971 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00462755 s, 0.0 kB/s 2024-04-18T03:39:41.983 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.983 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.983 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00491055 s, 0.0 kB/s 2024-04-18T03:39:41.996 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:41.996 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:41.996 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00476919 s, 0.0 kB/s 2024-04-18T03:39:42.008 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.008 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.008 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00489216 s, 0.0 kB/s 2024-04-18T03:39:42.020 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.021 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.021 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00459341 s, 0.0 kB/s 2024-04-18T03:39:42.033 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.033 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.033 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503627 s, 0.0 kB/s 2024-04-18T03:39:42.046 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.046 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.046 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00451465 s, 0.0 kB/s 2024-04-18T03:39:42.058 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.058 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.058 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00492059 s, 0.0 kB/s 2024-04-18T03:39:42.070 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.071 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.071 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00483531 s, 0.0 kB/s 2024-04-18T03:39:42.083 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.083 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.083 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048221 s, 0.0 kB/s 2024-04-18T03:39:42.096 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.096 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.096 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00517278 s, 0.0 kB/s 2024-04-18T03:39:42.108 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.108 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.108 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477766 s, 0.0 kB/s 2024-04-18T03:39:42.121 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.121 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.121 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503401 s, 0.0 kB/s 2024-04-18T03:39:42.133 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.133 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.133 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469194 s, 0.0 kB/s 2024-04-18T03:39:42.146 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.146 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.146 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00483318 s, 0.0 kB/s 2024-04-18T03:39:42.158 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.158 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.158 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00485134 s, 0.0 kB/s 2024-04-18T03:39:42.170 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.170 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.171 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00517326 s, 0.0 kB/s 2024-04-18T03:39:42.182 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.183 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.183 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00485049 s, 0.0 kB/s 2024-04-18T03:39:42.195 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.196 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.196 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00530553 s, 0.0 kB/s 2024-04-18T03:39:42.208 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.208 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.208 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00487709 s, 0.0 kB/s 2024-04-18T03:39:42.220 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.220 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.220 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00511757 s, 0.0 kB/s 2024-04-18T03:39:42.233 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.233 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.233 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00511436 s, 0.0 kB/s 2024-04-18T03:39:42.246 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.246 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.246 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00508815 s, 0.0 kB/s 2024-04-18T03:39:42.258 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.258 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.258 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00496386 s, 0.0 kB/s 2024-04-18T03:39:42.270 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.270 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.270 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00500499 s, 0.0 kB/s 2024-04-18T03:39:42.282 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.282 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.283 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00486843 s, 0.0 kB/s 2024-04-18T03:39:42.295 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.296 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.296 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00555486 s, 0.0 kB/s 2024-04-18T03:39:42.309 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.309 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.309 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472188 s, 0.0 kB/s 2024-04-18T03:39:42.319 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.319 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.319 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00522331 s, 0.0 kB/s 2024-04-18T03:39:42.333 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.333 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.333 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00665789 s, 0.0 kB/s 2024-04-18T03:39:42.343 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.343 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.344 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00430851 s, 0.0 kB/s 2024-04-18T03:39:42.355 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.356 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.356 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00473965 s, 0.0 kB/s 2024-04-18T03:39:42.368 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.368 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.368 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00461881 s, 0.0 kB/s 2024-04-18T03:39:42.381 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.381 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.381 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00445811 s, 0.0 kB/s 2024-04-18T03:39:42.393 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.394 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.394 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00458381 s, 0.0 kB/s 2024-04-18T03:39:42.407 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.408 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.408 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00490583 s, 0.0 kB/s 2024-04-18T03:39:42.421 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.421 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.421 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00588078 s, 0.0 kB/s 2024-04-18T03:39:42.434 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.434 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.434 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00525333 s, 0.0 kB/s 2024-04-18T03:39:42.446 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.446 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.446 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00474817 s, 0.0 kB/s 2024-04-18T03:39:42.458 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.459 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.459 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048186 s, 0.0 kB/s 2024-04-18T03:39:42.471 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.471 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.471 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00494842 s, 0.0 kB/s 2024-04-18T03:39:42.484 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.484 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.484 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00490473 s, 0.0 kB/s 2024-04-18T03:39:42.496 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.496 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.496 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046897 s, 0.0 kB/s 2024-04-18T03:39:42.508 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.509 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.509 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479316 s, 0.0 kB/s 2024-04-18T03:39:42.522 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.522 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.522 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00515389 s, 0.0 kB/s 2024-04-18T03:39:42.534 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.534 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.534 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00435982 s, 0.0 kB/s 2024-04-18T03:39:42.545 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.545 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.545 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0040373 s, 0.0 kB/s 2024-04-18T03:39:42.557 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.557 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.557 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00446422 s, 0.0 kB/s 2024-04-18T03:39:42.569 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.569 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.569 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00463785 s, 0.0 kB/s 2024-04-18T03:39:42.582 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.583 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.583 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469034 s, 0.0 kB/s 2024-04-18T03:39:42.596 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.596 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.596 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00488465 s, 0.0 kB/s 2024-04-18T03:39:42.609 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.609 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.609 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00457749 s, 0.0 kB/s 2024-04-18T03:39:42.622 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.622 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.622 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470635 s, 0.0 kB/s 2024-04-18T03:39:42.635 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.635 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.635 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00444925 s, 0.0 kB/s 2024-04-18T03:39:42.650 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.650 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.650 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00507252 s, 0.0 kB/s 2024-04-18T03:39:42.665 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.665 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.665 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00693305 s, 0.0 kB/s 2024-04-18T03:39:42.680 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.680 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.680 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00678834 s, 0.0 kB/s 2024-04-18T03:39:42.696 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.696 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.696 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00724193 s, 0.0 kB/s 2024-04-18T03:39:42.709 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.709 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.709 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00438737 s, 0.0 kB/s 2024-04-18T03:39:42.722 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.722 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.722 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470903 s, 0.0 kB/s 2024-04-18T03:39:42.735 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.735 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.735 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00431119 s, 0.0 kB/s 2024-04-18T03:39:42.749 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.749 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.749 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00525721 s, 0.0 kB/s 2024-04-18T03:39:42.762 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.762 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.762 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00445537 s, 0.0 kB/s 2024-04-18T03:39:42.773 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.774 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.774 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00434038 s, 0.0 kB/s 2024-04-18T03:39:42.786 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.786 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.786 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00444366 s, 0.0 kB/s 2024-04-18T03:39:42.802 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.802 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.802 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0067059 s, 0.0 kB/s 2024-04-18T03:39:42.815 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.815 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.815 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00436174 s, 0.0 kB/s 2024-04-18T03:39:42.828 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.828 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.829 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472772 s, 0.0 kB/s 2024-04-18T03:39:42.842 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.842 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.842 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00442226 s, 0.0 kB/s 2024-04-18T03:39:42.855 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.855 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.855 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00510404 s, 0.0 kB/s 2024-04-18T03:39:42.869 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.869 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.869 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00481977 s, 0.0 kB/s 2024-04-18T03:39:42.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.883 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00645506 s, 0.0 kB/s 2024-04-18T03:39:42.897 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.897 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.897 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00490997 s, 0.0 kB/s 2024-04-18T03:39:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503177 s, 0.0 kB/s 2024-04-18T03:39:42.924 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.924 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.924 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00475928 s, 0.0 kB/s 2024-04-18T03:39:42.938 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.938 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.938 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00480959 s, 0.0 kB/s 2024-04-18T03:39:42.952 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.952 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.952 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00507223 s, 0.0 kB/s 2024-04-18T03:39:42.965 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.965 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.965 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0047009 s, 0.0 kB/s 2024-04-18T03:39:42.978 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.978 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.978 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00495362 s, 0.0 kB/s 2024-04-18T03:39:42.990 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:42.990 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:42.991 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00481934 s, 0.0 kB/s 2024-04-18T03:39:43.003 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.003 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.003 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00494701 s, 0.0 kB/s 2024-04-18T03:39:43.018 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.018 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.018 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00687269 s, 0.0 kB/s 2024-04-18T03:39:43.031 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.031 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.031 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00490232 s, 0.0 kB/s 2024-04-18T03:39:43.043 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.043 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.043 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460404 s, 0.0 kB/s 2024-04-18T03:39:43.062 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.062 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.062 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0108125 s, 0.0 kB/s 2024-04-18T03:39:43.073 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.073 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.073 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00442112 s, 0.0 kB/s 2024-04-18T03:39:43.083 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.083 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.084 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046244 s, 0.0 kB/s 2024-04-18T03:39:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.094 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00437622 s, 0.0 kB/s 2024-04-18T03:39:43.106 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.106 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.106 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00513856 s, 0.0 kB/s 2024-04-18T03:39:43.118 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.118 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.118 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479231 s, 0.0 kB/s 2024-04-18T03:39:43.131 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.131 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.131 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00505273 s, 0.0 kB/s 2024-04-18T03:39:43.143 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.143 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.143 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00475072 s, 0.0 kB/s 2024-04-18T03:39:43.155 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.155 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.155 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00467744 s, 0.0 kB/s 2024-04-18T03:39:43.168 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.168 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.168 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048303 s, 0.0 kB/s 2024-04-18T03:39:43.181 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.181 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.181 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00538814 s, 0.0 kB/s 2024-04-18T03:39:43.194 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.194 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.194 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0051749 s, 0.0 kB/s 2024-04-18T03:39:43.207 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.208 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.208 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00568824 s, 0.0 kB/s 2024-04-18T03:39:43.220 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.220 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.220 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00517912 s, 0.0 kB/s 2024-04-18T03:39:43.232 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.232 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.233 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00491735 s, 0.0 kB/s 2024-04-18T03:39:43.245 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.245 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.245 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477626 s, 0.0 kB/s 2024-04-18T03:39:43.258 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.258 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.258 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048991 s, 0.0 kB/s 2024-04-18T03:39:43.270 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.270 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.271 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479718 s, 0.0 kB/s 2024-04-18T03:39:43.284 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.284 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.284 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00551243 s, 0.0 kB/s 2024-04-18T03:39:43.298 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.298 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.298 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00532554 s, 0.0 kB/s 2024-04-18T03:39:43.311 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.311 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.311 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00551272 s, 0.0 kB/s 2024-04-18T03:39:43.325 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.325 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.325 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00523288 s, 0.0 kB/s 2024-04-18T03:39:43.337 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.338 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.338 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00495986 s, 0.0 kB/s 2024-04-18T03:39:43.350 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.350 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.351 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048441 s, 0.0 kB/s 2024-04-18T03:39:43.363 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.363 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.363 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503154 s, 0.0 kB/s 2024-04-18T03:39:43.376 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.376 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.376 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048963 s, 0.0 kB/s 2024-04-18T03:39:43.390 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.390 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.390 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00526345 s, 0.0 kB/s 2024-04-18T03:39:43.404 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.404 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.404 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00556016 s, 0.0 kB/s 2024-04-18T03:39:43.418 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.418 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.418 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00548052 s, 0.0 kB/s 2024-04-18T03:39:43.432 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.432 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.432 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00536158 s, 0.0 kB/s 2024-04-18T03:39:43.445 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.446 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.446 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00523208 s, 0.0 kB/s 2024-04-18T03:39:43.457 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.457 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.457 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00440163 s, 0.0 kB/s 2024-04-18T03:39:43.469 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.470 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.470 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00466644 s, 0.0 kB/s 2024-04-18T03:39:43.482 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.482 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.482 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.004987 s, 0.0 kB/s 2024-04-18T03:39:43.496 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.496 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.496 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00480263 s, 0.0 kB/s 2024-04-18T03:39:43.510 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.510 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.510 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00474001 s, 0.0 kB/s 2024-04-18T03:39:43.519 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.520 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.520 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479942 s, 0.0 kB/s 2024-04-18T03:39:43.532 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.532 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.532 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00490546 s, 0.0 kB/s 2024-04-18T03:39:43.543 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.543 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.544 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470545 s, 0.0 kB/s 2024-04-18T03:39:43.554 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.555 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.555 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00474421 s, 0.0 kB/s 2024-04-18T03:39:43.566 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.566 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.566 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00455112 s, 0.0 kB/s 2024-04-18T03:39:43.578 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.578 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.578 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00488931 s, 0.0 kB/s 2024-04-18T03:39:43.591 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.591 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.591 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00519129 s, 0.0 kB/s 2024-04-18T03:39:43.604 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.604 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.604 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00534667 s, 0.0 kB/s 2024-04-18T03:39:43.617 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.617 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.617 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00513495 s, 0.0 kB/s 2024-04-18T03:39:43.630 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.630 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.630 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00568071 s, 0.0 kB/s 2024-04-18T03:39:43.642 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.643 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.643 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469833 s, 0.0 kB/s 2024-04-18T03:39:43.656 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.656 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.657 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00553463 s, 0.0 kB/s 2024-04-18T03:39:43.670 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.670 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.670 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00516453 s, 0.0 kB/s 2024-04-18T03:39:43.682 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.682 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.682 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00497522 s, 0.0 kB/s 2024-04-18T03:39:43.695 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.695 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.695 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00561559 s, 0.0 kB/s 2024-04-18T03:39:43.709 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.709 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.709 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00573377 s, 0.0 kB/s 2024-04-18T03:39:43.723 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.723 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.723 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00569216 s, 0.0 kB/s 2024-04-18T03:39:43.736 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.736 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.736 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00541456 s, 0.0 kB/s 2024-04-18T03:39:43.749 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.749 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.749 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00508882 s, 0.0 kB/s 2024-04-18T03:39:43.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.762 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00438977 s, 0.0 kB/s 2024-04-18T03:39:43.774 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.774 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.774 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00483897 s, 0.0 kB/s 2024-04-18T03:39:43.786 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.786 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.787 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00459277 s, 0.0 kB/s 2024-04-18T03:39:43.799 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.799 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.799 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00501652 s, 0.0 kB/s 2024-04-18T03:39:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00448184 s, 0.0 kB/s 2024-04-18T03:39:43.823 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.823 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.823 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0047407 s, 0.0 kB/s 2024-04-18T03:39:43.835 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.836 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.836 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0045859 s, 0.0 kB/s 2024-04-18T03:39:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00491513 s, 0.0 kB/s 2024-04-18T03:39:43.860 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.861 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.861 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0050654 s, 0.0 kB/s 2024-04-18T03:39:43.873 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.874 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477961 s, 0.0 kB/s 2024-04-18T03:39:43.886 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.886 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.886 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00475381 s, 0.0 kB/s 2024-04-18T03:39:43.899 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.899 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.899 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00504801 s, 0.0 kB/s 2024-04-18T03:39:43.912 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.912 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.912 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00488047 s, 0.0 kB/s 2024-04-18T03:39:43.924 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.924 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.924 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00482012 s, 0.0 kB/s 2024-04-18T03:39:43.937 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.937 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.937 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00486968 s, 0.0 kB/s 2024-04-18T03:39:43.950 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.950 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.950 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00507869 s, 0.0 kB/s 2024-04-18T03:39:43.967 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.967 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.967 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00778465 s, 0.0 kB/s 2024-04-18T03:39:43.980 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.980 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.980 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00504951 s, 0.0 kB/s 2024-04-18T03:39:43.994 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:43.994 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:43.994 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00520992 s, 0.0 kB/s 2024-04-18T03:39:44.008 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.008 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.008 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00488473 s, 0.0 kB/s 2024-04-18T03:39:44.021 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.021 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.021 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00481026 s, 0.0 kB/s 2024-04-18T03:39:44.034 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.034 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.035 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00462575 s, 0.0 kB/s 2024-04-18T03:39:44.048 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.048 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.048 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0051203 s, 0.0 kB/s 2024-04-18T03:39:44.061 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.061 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.061 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00447098 s, 0.0 kB/s 2024-04-18T03:39:44.075 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.075 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.075 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00537271 s, 0.0 kB/s 2024-04-18T03:39:44.088 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.089 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.089 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00493006 s, 0.0 kB/s 2024-04-18T03:39:44.102 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.102 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.102 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00531458 s, 0.0 kB/s 2024-04-18T03:39:44.116 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.116 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.116 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477861 s, 0.0 kB/s 2024-04-18T03:39:44.129 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.130 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.130 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479521 s, 0.0 kB/s 2024-04-18T03:39:44.143 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.143 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.143 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00459402 s, 0.0 kB/s 2024-04-18T03:39:44.157 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.157 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.157 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00502642 s, 0.0 kB/s 2024-04-18T03:39:44.171 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.171 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.171 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00501495 s, 0.0 kB/s 2024-04-18T03:39:44.185 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.185 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.185 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00529815 s, 0.0 kB/s 2024-04-18T03:39:44.199 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.199 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.199 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00464344 s, 0.0 kB/s 2024-04-18T03:39:44.212 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.212 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.212 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00535562 s, 0.0 kB/s 2024-04-18T03:39:44.225 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.226 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.226 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0047494 s, 0.0 kB/s 2024-04-18T03:39:44.239 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.239 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.239 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00493857 s, 0.0 kB/s 2024-04-18T03:39:44.253 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.253 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.253 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0051168 s, 0.0 kB/s 2024-04-18T03:39:44.266 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.266 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.267 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00538399 s, 0.0 kB/s 2024-04-18T03:39:44.279 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.280 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.280 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00500959 s, 0.0 kB/s 2024-04-18T03:39:44.292 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.293 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.293 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472456 s, 0.0 kB/s 2024-04-18T03:39:44.306 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.306 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.306 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00465167 s, 0.0 kB/s 2024-04-18T03:39:44.319 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.319 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.319 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00519056 s, 0.0 kB/s 2024-04-18T03:39:44.333 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.333 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.333 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00499009 s, 0.0 kB/s 2024-04-18T03:39:44.346 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.346 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.346 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479545 s, 0.0 kB/s 2024-04-18T03:39:44.360 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.360 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.360 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00483613 s, 0.0 kB/s 2024-04-18T03:39:44.376 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.376 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.376 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00703367 s, 0.0 kB/s 2024-04-18T03:39:44.390 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.390 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.390 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00498969 s, 0.0 kB/s 2024-04-18T03:39:44.404 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.404 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.404 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00527217 s, 0.0 kB/s 2024-04-18T03:39:44.417 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.417 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.417 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00488604 s, 0.0 kB/s 2024-04-18T03:39:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00462381 s, 0.0 kB/s 2024-04-18T03:39:44.446 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.446 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.446 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00736265 s, 0.0 kB/s 2024-04-18T03:39:44.461 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.462 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.462 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00744648 s, 0.0 kB/s 2024-04-18T03:39:44.477 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.478 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.478 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00728857 s, 0.0 kB/s 2024-04-18T03:39:44.493 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.493 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.493 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00736209 s, 0.0 kB/s 2024-04-18T03:39:44.510 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.510 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.510 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00779183 s, 0.0 kB/s 2024-04-18T03:39:44.523 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.523 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.524 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00486803 s, 0.0 kB/s 2024-04-18T03:39:44.536 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.536 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.536 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00511202 s, 0.0 kB/s 2024-04-18T03:39:44.549 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.549 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.549 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00446197 s, 0.0 kB/s 2024-04-18T03:39:44.562 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.562 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.562 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00538107 s, 0.0 kB/s 2024-04-18T03:39:44.575 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.575 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.575 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00473083 s, 0.0 kB/s 2024-04-18T03:39:44.587 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.587 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.587 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00476614 s, 0.0 kB/s 2024-04-18T03:39:44.598 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.599 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.599 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00456552 s, 0.0 kB/s 2024-04-18T03:39:44.611 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.611 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.611 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503836 s, 0.0 kB/s 2024-04-18T03:39:44.623 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.623 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.624 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00454748 s, 0.0 kB/s 2024-04-18T03:39:44.636 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.636 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.636 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00485603 s, 0.0 kB/s 2024-04-18T03:39:44.648 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.648 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.648 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00473267 s, 0.0 kB/s 2024-04-18T03:39:44.662 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.663 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.663 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00544331 s, 0.0 kB/s 2024-04-18T03:39:44.675 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.675 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.675 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00511051 s, 0.0 kB/s 2024-04-18T03:39:44.690 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.690 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.690 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00733305 s, 0.0 kB/s 2024-04-18T03:39:44.705 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.705 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.705 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00715451 s, 0.0 kB/s 2024-04-18T03:39:44.717 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.717 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.717 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00464745 s, 0.0 kB/s 2024-04-18T03:39:44.729 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.730 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.730 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478241 s, 0.0 kB/s 2024-04-18T03:39:44.742 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.742 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.742 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472114 s, 0.0 kB/s 2024-04-18T03:39:44.754 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.755 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.755 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00514922 s, 0.0 kB/s 2024-04-18T03:39:44.770 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.771 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.771 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00504008 s, 0.0 kB/s 2024-04-18T03:39:44.781 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.781 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.781 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00537018 s, 0.0 kB/s 2024-04-18T03:39:44.794 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.794 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.794 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503721 s, 0.0 kB/s 2024-04-18T03:39:44.806 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.806 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.806 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0052605 s, 0.0 kB/s 2024-04-18T03:39:44.819 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.819 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.819 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00481865 s, 0.0 kB/s 2024-04-18T03:39:44.832 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.832 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.832 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00487592 s, 0.0 kB/s 2024-04-18T03:39:44.844 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.844 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.844 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00458099 s, 0.0 kB/s 2024-04-18T03:39:44.857 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.857 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.857 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00496318 s, 0.0 kB/s 2024-04-18T03:39:44.870 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.870 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.870 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00504547 s, 0.0 kB/s 2024-04-18T03:39:44.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.883 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.883 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00543083 s, 0.0 kB/s 2024-04-18T03:39:44.896 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.896 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.896 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00484474 s, 0.0 kB/s 2024-04-18T03:39:44.909 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.909 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.909 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00530862 s, 0.0 kB/s 2024-04-18T03:39:44.922 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.922 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.922 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00485414 s, 0.0 kB/s 2024-04-18T03:39:44.935 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.936 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.936 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046128 s, 0.0 kB/s 2024-04-18T03:39:44.948 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.948 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.948 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046008 s, 0.0 kB/s 2024-04-18T03:39:44.961 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.962 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.962 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00467313 s, 0.0 kB/s 2024-04-18T03:39:44.974 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.974 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.974 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0042506 s, 0.0 kB/s 2024-04-18T03:39:44.987 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:44.987 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:44.987 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472312 s, 0.0 kB/s 2024-04-18T03:39:45.000 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.000 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.000 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00468586 s, 0.0 kB/s 2024-04-18T03:39:45.013 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.013 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.013 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00457228 s, 0.0 kB/s 2024-04-18T03:39:45.026 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.027 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.027 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472921 s, 0.0 kB/s 2024-04-18T03:39:45.039 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.039 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.040 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00454859 s, 0.0 kB/s 2024-04-18T03:39:45.052 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.052 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.053 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00486272 s, 0.0 kB/s 2024-04-18T03:39:45.065 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.065 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.065 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00462869 s, 0.0 kB/s 2024-04-18T03:39:45.078 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.078 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.078 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00547628 s, 0.0 kB/s 2024-04-18T03:39:45.090 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.091 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.091 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00524616 s, 0.0 kB/s 2024-04-18T03:39:45.104 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.104 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.104 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00528345 s, 0.0 kB/s 2024-04-18T03:39:45.117 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.117 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.117 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00532366 s, 0.0 kB/s 2024-04-18T03:39:45.129 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.129 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.130 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00483186 s, 0.0 kB/s 2024-04-18T03:39:45.141 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.142 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.142 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00475583 s, 0.0 kB/s 2024-04-18T03:39:45.154 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.154 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.154 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00497292 s, 0.0 kB/s 2024-04-18T03:39:45.166 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.166 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.166 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00461757 s, 0.0 kB/s 2024-04-18T03:39:45.179 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.179 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.179 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00524047 s, 0.0 kB/s 2024-04-18T03:39:45.192 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.192 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.192 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00516435 s, 0.0 kB/s 2024-04-18T03:39:45.205 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.205 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.205 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00533624 s, 0.0 kB/s 2024-04-18T03:39:45.218 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.218 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.218 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00509765 s, 0.0 kB/s 2024-04-18T03:39:45.230 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.230 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.230 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048814 s, 0.0 kB/s 2024-04-18T03:39:45.242 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.242 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.242 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00458026 s, 0.0 kB/s 2024-04-18T03:39:45.255 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.255 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.255 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00511092 s, 0.0 kB/s 2024-04-18T03:39:45.268 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.268 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.268 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00491929 s, 0.0 kB/s 2024-04-18T03:39:45.280 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.280 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.281 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00511189 s, 0.0 kB/s 2024-04-18T03:39:45.293 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.293 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.293 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046344 s, 0.0 kB/s 2024-04-18T03:39:45.305 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.306 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.306 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00507403 s, 0.0 kB/s 2024-04-18T03:39:45.318 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.318 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.318 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00461561 s, 0.0 kB/s 2024-04-18T03:39:45.330 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.330 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.330 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00498614 s, 0.0 kB/s 2024-04-18T03:39:45.342 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.342 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.342 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00452814 s, 0.0 kB/s 2024-04-18T03:39:45.354 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.354 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.354 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00484921 s, 0.0 kB/s 2024-04-18T03:39:45.366 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.367 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.367 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00494285 s, 0.0 kB/s 2024-04-18T03:39:45.379 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.379 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.380 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00523871 s, 0.0 kB/s 2024-04-18T03:39:45.391 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.391 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.392 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469307 s, 0.0 kB/s 2024-04-18T03:39:45.403 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.404 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.404 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00455496 s, 0.0 kB/s 2024-04-18T03:39:45.416 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.416 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.416 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00461944 s, 0.0 kB/s 2024-04-18T03:39:45.430 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.430 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.430 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00491707 s, 0.0 kB/s 2024-04-18T03:39:45.444 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.444 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.444 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00489378 s, 0.0 kB/s 2024-04-18T03:39:45.457 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.457 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.457 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00457053 s, 0.0 kB/s 2024-04-18T03:39:45.470 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.470 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.470 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00491409 s, 0.0 kB/s 2024-04-18T03:39:45.483 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.483 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.483 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460449 s, 0.0 kB/s 2024-04-18T03:39:45.499 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.499 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.499 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0072203 s, 0.0 kB/s 2024-04-18T03:39:45.511 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.511 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.511 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00453349 s, 0.0 kB/s 2024-04-18T03:39:45.524 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.524 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.524 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00516599 s, 0.0 kB/s 2024-04-18T03:39:45.537 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.537 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.537 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00541607 s, 0.0 kB/s 2024-04-18T03:39:45.549 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.549 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.550 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00428184 s, 0.0 kB/s 2024-04-18T03:39:45.561 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.561 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.561 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00419137 s, 0.0 kB/s 2024-04-18T03:39:45.573 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.573 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.573 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00508403 s, 0.0 kB/s 2024-04-18T03:39:45.586 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.586 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.586 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00481791 s, 0.0 kB/s 2024-04-18T03:39:45.599 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.599 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.599 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00509985 s, 0.0 kB/s 2024-04-18T03:39:45.611 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.611 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.611 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00452086 s, 0.0 kB/s 2024-04-18T03:39:45.626 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.626 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.627 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00748153 s, 0.0 kB/s 2024-04-18T03:39:45.639 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.639 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.639 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00505583 s, 0.0 kB/s 2024-04-18T03:39:45.652 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.652 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.652 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00500072 s, 0.0 kB/s 2024-04-18T03:39:45.666 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.666 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.666 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00530728 s, 0.0 kB/s 2024-04-18T03:39:45.678 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.678 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.679 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469512 s, 0.0 kB/s 2024-04-18T03:39:45.691 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.691 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.691 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00506947 s, 0.0 kB/s 2024-04-18T03:39:45.703 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.704 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.704 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00482652 s, 0.0 kB/s 2024-04-18T03:39:45.716 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.717 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.717 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00518231 s, 0.0 kB/s 2024-04-18T03:39:45.730 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.730 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.730 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00518995 s, 0.0 kB/s 2024-04-18T03:39:45.743 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.743 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.743 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00510574 s, 0.0 kB/s 2024-04-18T03:39:45.755 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.756 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.756 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0045559 s, 0.0 kB/s 2024-04-18T03:39:45.768 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.768 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.768 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00508621 s, 0.0 kB/s 2024-04-18T03:39:45.780 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.780 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.781 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00476564 s, 0.0 kB/s 2024-04-18T03:39:45.793 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.793 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.793 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00475885 s, 0.0 kB/s 2024-04-18T03:39:45.808 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.808 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.808 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00712665 s, 0.0 kB/s 2024-04-18T03:39:45.823 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.823 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.823 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00773455 s, 0.0 kB/s 2024-04-18T03:39:45.838 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.838 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.838 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00723351 s, 0.0 kB/s 2024-04-18T03:39:45.851 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.851 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.851 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00516988 s, 0.0 kB/s 2024-04-18T03:39:45.864 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.864 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.864 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478369 s, 0.0 kB/s 2024-04-18T03:39:45.877 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.877 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.877 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00506015 s, 0.0 kB/s 2024-04-18T03:39:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478939 s, 0.0 kB/s 2024-04-18T03:39:45.905 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.905 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.905 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00774597 s, 0.0 kB/s 2024-04-18T03:39:45.919 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.920 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.920 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00681107 s, 0.0 kB/s 2024-04-18T03:39:45.935 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.935 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.935 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00755478 s, 0.0 kB/s 2024-04-18T03:39:45.950 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.950 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.951 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00730256 s, 0.0 kB/s 2024-04-18T03:39:45.966 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.966 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.966 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00496558 s, 0.0 kB/s 2024-04-18T03:39:45.978 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.978 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.978 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00522678 s, 0.0 kB/s 2024-04-18T03:39:45.992 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:45.992 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:45.992 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0051427 s, 0.0 kB/s 2024-04-18T03:39:46.005 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.005 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.005 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470305 s, 0.0 kB/s 2024-04-18T03:39:46.018 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.018 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.018 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00442781 s, 0.0 kB/s 2024-04-18T03:39:46.032 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.033 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.033 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00509831 s, 0.0 kB/s 2024-04-18T03:39:46.046 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.046 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.046 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00475896 s, 0.0 kB/s 2024-04-18T03:39:46.060 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.060 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.060 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00480955 s, 0.0 kB/s 2024-04-18T03:39:46.074 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.074 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.074 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0044736 s, 0.0 kB/s 2024-04-18T03:39:46.086 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.086 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.086 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00457095 s, 0.0 kB/s 2024-04-18T03:39:46.100 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.100 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.100 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00487462 s, 0.0 kB/s 2024-04-18T03:39:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.113 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00458811 s, 0.0 kB/s 2024-04-18T03:39:46.126 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.127 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.127 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00471524 s, 0.0 kB/s 2024-04-18T03:39:46.142 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.142 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.142 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00712408 s, 0.0 kB/s 2024-04-18T03:39:46.158 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.158 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.158 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00715998 s, 0.0 kB/s 2024-04-18T03:39:46.174 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.174 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.174 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00733895 s, 0.0 kB/s 2024-04-18T03:39:46.187 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.187 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.188 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00473765 s, 0.0 kB/s 2024-04-18T03:39:46.201 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.201 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.201 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00473991 s, 0.0 kB/s 2024-04-18T03:39:46.214 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.214 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.214 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00462808 s, 0.0 kB/s 2024-04-18T03:39:46.227 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.227 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.227 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00481223 s, 0.0 kB/s 2024-04-18T03:39:46.242 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.243 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.243 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00701867 s, 0.0 kB/s 2024-04-18T03:39:46.256 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.257 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.257 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00533018 s, 0.0 kB/s 2024-04-18T03:39:46.271 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.271 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.271 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0051118 s, 0.0 kB/s 2024-04-18T03:39:46.285 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.285 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.285 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00533923 s, 0.0 kB/s 2024-04-18T03:39:46.297 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.297 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.297 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00459171 s, 0.0 kB/s 2024-04-18T03:39:46.310 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.310 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.310 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503833 s, 0.0 kB/s 2024-04-18T03:39:46.322 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.322 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.322 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00472024 s, 0.0 kB/s 2024-04-18T03:39:46.335 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.335 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.335 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00558089 s, 0.0 kB/s 2024-04-18T03:39:46.346 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.347 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.347 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0037925 s, 0.0 kB/s 2024-04-18T03:39:46.356 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.357 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.357 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00445127 s, 0.0 kB/s 2024-04-18T03:39:46.367 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.367 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.368 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00451419 s, 0.0 kB/s 2024-04-18T03:39:46.379 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.380 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.380 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00529944 s, 0.0 kB/s 2024-04-18T03:39:46.392 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.392 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.392 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00499561 s, 0.0 kB/s 2024-04-18T03:39:46.405 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.405 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.405 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0054141 s, 0.0 kB/s 2024-04-18T03:39:46.417 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.418 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.418 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00492078 s, 0.0 kB/s 2024-04-18T03:39:46.432 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.432 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.433 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503471 s, 0.0 kB/s 2024-04-18T03:39:46.445 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.445 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.445 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00492679 s, 0.0 kB/s 2024-04-18T03:39:46.457 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.457 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.457 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00464796 s, 0.0 kB/s 2024-04-18T03:39:46.470 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.470 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.470 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00485186 s, 0.0 kB/s 2024-04-18T03:39:46.483 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.483 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.483 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00567504 s, 0.0 kB/s 2024-04-18T03:39:46.496 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.496 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.496 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00491689 s, 0.0 kB/s 2024-04-18T03:39:46.508 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.508 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.508 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00489617 s, 0.0 kB/s 2024-04-18T03:39:46.521 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.521 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.521 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048731 s, 0.0 kB/s 2024-04-18T03:39:46.534 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.535 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.535 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00566825 s, 0.0 kB/s 2024-04-18T03:39:46.547 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.547 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.547 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00523101 s, 0.0 kB/s 2024-04-18T03:39:46.561 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.561 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.561 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00543034 s, 0.0 kB/s 2024-04-18T03:39:46.571 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.571 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.571 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00419824 s, 0.0 kB/s 2024-04-18T03:39:46.581 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.581 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.581 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00436432 s, 0.0 kB/s 2024-04-18T03:39:46.592 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.592 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.592 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00488826 s, 0.0 kB/s 2024-04-18T03:39:46.604 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.604 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.604 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00480786 s, 0.0 kB/s 2024-04-18T03:39:46.616 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.617 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.617 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00503353 s, 0.0 kB/s 2024-04-18T03:39:46.629 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.629 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.629 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00476163 s, 0.0 kB/s 2024-04-18T03:39:46.642 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.642 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.642 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00552635 s, 0.0 kB/s 2024-04-18T03:39:46.655 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.655 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.655 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00519408 s, 0.0 kB/s 2024-04-18T03:39:46.670 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.670 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.670 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00583065 s, 0.0 kB/s 2024-04-18T03:39:46.683 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.684 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.684 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00598862 s, 0.0 kB/s 2024-04-18T03:39:46.696 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.696 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.696 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00520394 s, 0.0 kB/s 2024-04-18T03:39:46.709 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.710 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.710 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00518339 s, 0.0 kB/s 2024-04-18T03:39:46.722 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.722 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.722 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00513686 s, 0.0 kB/s 2024-04-18T03:39:46.735 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.736 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.736 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00529952 s, 0.0 kB/s 2024-04-18T03:39:46.749 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.749 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.749 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00519048 s, 0.0 kB/s 2024-04-18T03:39:46.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.762 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.762 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00521506 s, 0.0 kB/s 2024-04-18T03:39:46.774 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.774 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.774 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00512505 s, 0.0 kB/s 2024-04-18T03:39:46.788 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.788 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.788 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0056584 s, 0.0 kB/s 2024-04-18T03:39:46.800 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.801 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.801 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00508948 s, 0.0 kB/s 2024-04-18T03:39:46.814 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.814 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.814 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00523715 s, 0.0 kB/s 2024-04-18T03:39:46.826 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.826 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.826 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470082 s, 0.0 kB/s 2024-04-18T03:39:46.838 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.838 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.838 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00487077 s, 0.0 kB/s 2024-04-18T03:39:46.851 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.851 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.851 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0050513 s, 0.0 kB/s 2024-04-18T03:39:46.864 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.864 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.864 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477159 s, 0.0 kB/s 2024-04-18T03:39:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.876 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00466716 s, 0.0 kB/s 2024-04-18T03:39:46.889 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.889 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.889 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046253 s, 0.0 kB/s 2024-04-18T03:39:46.901 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.901 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.901 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00467639 s, 0.0 kB/s 2024-04-18T03:39:46.914 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.914 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.914 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0048332 s, 0.0 kB/s 2024-04-18T03:39:46.926 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.926 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.926 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00462033 s, 0.0 kB/s 2024-04-18T03:39:46.938 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.939 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.939 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477042 s, 0.0 kB/s 2024-04-18T03:39:46.953 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.953 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.954 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0073651 s, 0.0 kB/s 2024-04-18T03:39:46.969 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.970 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.970 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00728924 s, 0.0 kB/s 2024-04-18T03:39:46.986 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:46.986 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:46.986 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00717249 s, 0.0 kB/s 2024-04-18T03:39:46.999 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.000 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.000 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0074259 s, 0.0 kB/s 2024-04-18T03:39:47.012 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.012 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.012 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470873 s, 0.0 kB/s 2024-04-18T03:39:47.024 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.025 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.025 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479285 s, 0.0 kB/s 2024-04-18T03:39:47.037 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.037 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.037 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0046337 s, 0.0 kB/s 2024-04-18T03:39:47.049 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.049 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.049 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00460966 s, 0.0 kB/s 2024-04-18T03:39:47.062 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.062 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.062 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00486235 s, 0.0 kB/s 2024-04-18T03:39:47.074 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.074 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.075 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469967 s, 0.0 kB/s 2024-04-18T03:39:47.086 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.086 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.086 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00490137 s, 0.0 kB/s 2024-04-18T03:39:47.098 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.098 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.099 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00459267 s, 0.0 kB/s 2024-04-18T03:39:47.111 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.111 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.111 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.004995 s, 0.0 kB/s 2024-04-18T03:39:47.123 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.123 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.123 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00476074 s, 0.0 kB/s 2024-04-18T03:39:47.136 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.136 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.136 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00505385 s, 0.0 kB/s 2024-04-18T03:39:47.148 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.148 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.148 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00484948 s, 0.0 kB/s 2024-04-18T03:39:47.161 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.161 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.161 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00501068 s, 0.0 kB/s 2024-04-18T03:39:47.174 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.174 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.174 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00502567 s, 0.0 kB/s 2024-04-18T03:39:47.190 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.190 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.190 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00498963 s, 0.0 kB/s 2024-04-18T03:39:47.200 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.200 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.200 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00520327 s, 0.0 kB/s 2024-04-18T03:39:47.213 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.213 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.213 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00542544 s, 0.0 kB/s 2024-04-18T03:39:47.226 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.226 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.226 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00494506 s, 0.0 kB/s 2024-04-18T03:39:47.239 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.239 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.239 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00524748 s, 0.0 kB/s 2024-04-18T03:39:47.252 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.252 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.252 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.004752 s, 0.0 kB/s 2024-04-18T03:39:47.265 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.265 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.265 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00528394 s, 0.0 kB/s 2024-04-18T03:39:47.280 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.280 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.280 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00750711 s, 0.0 kB/s 2024-04-18T03:39:47.293 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.293 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.293 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0050873 s, 0.0 kB/s 2024-04-18T03:39:47.308 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.308 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.308 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00733081 s, 0.0 kB/s 2024-04-18T03:39:47.321 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.321 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.321 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00501297 s, 0.0 kB/s 2024-04-18T03:39:47.333 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.333 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.333 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00467981 s, 0.0 kB/s 2024-04-18T03:39:47.346 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.346 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.346 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00519704 s, 0.0 kB/s 2024-04-18T03:39:47.359 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.359 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.359 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.004948 s, 0.0 kB/s 2024-04-18T03:39:47.374 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.374 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.374 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00746496 s, 0.0 kB/s 2024-04-18T03:39:47.389 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.389 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.389 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00753937 s, 0.0 kB/s 2024-04-18T03:39:47.404 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.404 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.404 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00773948 s, 0.0 kB/s 2024-04-18T03:39:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0080195 s, 0.0 kB/s 2024-04-18T03:39:47.462 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.462 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.462 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0278577 s, 0.0 kB/s 2024-04-18T03:39:47.480 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.480 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.480 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0106563 s, 0.0 kB/s 2024-04-18T03:39:47.492 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.492 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.492 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00438659 s, 0.0 kB/s 2024-04-18T03:39:47.503 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.504 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.504 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00457929 s, 0.0 kB/s 2024-04-18T03:39:47.515 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.516 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.516 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00431134 s, 0.0 kB/s 2024-04-18T03:39:47.528 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.528 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.528 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00490867 s, 0.0 kB/s 2024-04-18T03:39:47.541 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.541 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.541 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.004675 s, 0.0 kB/s 2024-04-18T03:39:47.552 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.552 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.552 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00458033 s, 0.0 kB/s 2024-04-18T03:39:47.563 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.563 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.563 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00450031 s, 0.0 kB/s 2024-04-18T03:39:47.576 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.576 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.576 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00465073 s, 0.0 kB/s 2024-04-18T03:39:47.588 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.588 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.588 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00468196 s, 0.0 kB/s 2024-04-18T03:39:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.601 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00516278 s, 0.0 kB/s 2024-04-18T03:39:47.616 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.616 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.616 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00724067 s, 0.0 kB/s 2024-04-18T03:39:47.631 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.631 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.632 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00778001 s, 0.0 kB/s 2024-04-18T03:39:47.647 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.647 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.647 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0073959 s, 0.0 kB/s 2024-04-18T03:39:47.662 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.662 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.662 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00693159 s, 0.0 kB/s 2024-04-18T03:39:47.677 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.677 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.677 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00615344 s, 0.0 kB/s 2024-04-18T03:39:47.689 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.689 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.689 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00455578 s, 0.0 kB/s 2024-04-18T03:39:47.702 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.702 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.702 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00505771 s, 0.0 kB/s 2024-04-18T03:39:47.715 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.715 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.715 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00512346 s, 0.0 kB/s 2024-04-18T03:39:47.731 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.731 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.731 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00788163 s, 0.0 kB/s 2024-04-18T03:39:47.746 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.746 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.746 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00735574 s, 0.0 kB/s 2024-04-18T03:39:47.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.761 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.761 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0072863 s, 0.0 kB/s 2024-04-18T03:39:47.776 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.776 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.776 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00734701 s, 0.0 kB/s 2024-04-18T03:39:47.790 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.790 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.790 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00535069 s, 0.0 kB/s 2024-04-18T03:39:47.803 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.803 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.803 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00531498 s, 0.0 kB/s 2024-04-18T03:39:47.818 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.818 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.818 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0071844 s, 0.0 kB/s 2024-04-18T03:39:47.830 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.830 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.830 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00414544 s, 0.0 kB/s 2024-04-18T03:39:47.844 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.845 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.845 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00731543 s, 0.0 kB/s 2024-04-18T03:39:47.859 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.859 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.859 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00706414 s, 0.0 kB/s 2024-04-18T03:39:47.874 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.874 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.875 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00722316 s, 0.0 kB/s 2024-04-18T03:39:47.889 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.889 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.889 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00701577 s, 0.0 kB/s 2024-04-18T03:39:47.901 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.901 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.902 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470859 s, 0.0 kB/s 2024-04-18T03:39:47.914 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.914 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.914 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00485475 s, 0.0 kB/s 2024-04-18T03:39:47.926 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.927 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.927 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00432876 s, 0.0 kB/s 2024-04-18T03:39:47.939 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.939 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.939 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00478809 s, 0.0 kB/s 2024-04-18T03:39:47.951 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.951 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.951 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470413 s, 0.0 kB/s 2024-04-18T03:39:47.967 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.967 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.967 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00753536 s, 0.0 kB/s 2024-04-18T03:39:47.982 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.982 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.982 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00720289 s, 0.0 kB/s 2024-04-18T03:39:47.997 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:47.997 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:47.997 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00739497 s, 0.0 kB/s 2024-04-18T03:39:48.009 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.010 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.010 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00481979 s, 0.0 kB/s 2024-04-18T03:39:48.022 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.022 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.022 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00473006 s, 0.0 kB/s 2024-04-18T03:39:48.034 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.035 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.035 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00458834 s, 0.0 kB/s 2024-04-18T03:39:48.047 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.047 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.047 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00484989 s, 0.0 kB/s 2024-04-18T03:39:48.063 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.063 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.064 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00852085 s, 0.0 kB/s 2024-04-18T03:39:48.074 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.074 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.074 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00358977 s, 0.0 kB/s 2024-04-18T03:39:48.086 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.086 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.086 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00516417 s, 0.0 kB/s 2024-04-18T03:39:48.097 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.098 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.098 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00449007 s, 0.0 kB/s 2024-04-18T03:39:48.109 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.109 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.109 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00477109 s, 0.0 kB/s 2024-04-18T03:39:48.122 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.122 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.122 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00459682 s, 0.0 kB/s 2024-04-18T03:39:48.134 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.134 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.134 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00479814 s, 0.0 kB/s 2024-04-18T03:39:48.147 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.147 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.147 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00528446 s, 0.0 kB/s 2024-04-18T03:39:48.159 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.160 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.160 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00511922 s, 0.0 kB/s 2024-04-18T03:39:48.172 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.172 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.172 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00488798 s, 0.0 kB/s 2024-04-18T03:39:48.185 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.185 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.185 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00522066 s, 0.0 kB/s 2024-04-18T03:39:48.197 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.197 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.197 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.0045391 s, 0.0 kB/s 2024-04-18T03:39:48.209 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.209 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.209 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00474827 s, 0.0 kB/s 2024-04-18T03:39:48.222 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.222 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.222 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00468351 s, 0.0 kB/s 2024-04-18T03:39:48.234 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.234 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.234 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00470729 s, 0.0 kB/s 2024-04-18T03:39:48.246 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records in 2024-04-18T03:39:48.246 INFO:tasks.workunit.client.0.smithi157.stderr:0+0 records out 2024-04-18T03:39:48.246 INFO:tasks.workunit.client.0.smithi157.stderr:0 bytes copied, 0.00469521 s, 0.0 kB/s 2024-04-18T03:39:48.249 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:39:48.249 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_dirs 500 2024-04-18T03:39:48.249 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:39:54.719 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:39:54.720 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_nodes 500 2024-04-18T03:39:54.720 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:40:00.779 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:40:00.780 INFO:tasks.workunit.client.0.smithi157.stderr:+ rename_files 500 2024-04-18T03:40:00.780 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:40:10.473 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:40:10.475 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:40:10.832 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:40:10.832 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_symlinks 500 2024-04-18T03:40:10.832 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:40:14.821 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:40:14.821 INFO:tasks.workunit.client.0.smithi157.stderr:+ make_links 500 2024-04-18T03:40:14.821 INFO:tasks.workunit.client.0.smithi157.stderr:+ set +x 2024-04-18T03:40:25.515 INFO:tasks.workunit.client.0.smithi157.stderr:+ return 0 2024-04-18T03:40:25.515 INFO:tasks.workunit.client.0.smithi157.stderr:+ cleanup 2024-04-18T03:40:25.522 INFO:tasks.workunit.client.0.smithi157.stderr:+ rm -rf link_test_KJVB4P link_test_MKmoot link_test_VCa81F mkdir_test_1O4Ytt mkdir_test_AkbDpV mkdir_test_tGnOY4 mkfile_test_Gr7dLg mkfile_test_lKQIvU mkfile_test_w0e7q2 mknod_test_K8Rjbd mknod_test_sNitu6 mknod_test_XfqJTo rename_test_HUUIl0 rename_test_JbUZeI rename_test_l6tsRC symlink_test_cheDv0 symlink_test_gI9mvC symlink_test_mXfOxz 2024-04-18T03:40:40.546 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:40:40.549 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:40:48.047 INFO:tasks.workunit.client.0.smithi157.stderr:+ popd 2024-04-18T03:40:48.051 INFO:tasks.workunit.client.0.smithi157.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-18T03:40:48.051 INFO:tasks.workunit.client.0.smithi157.stdout:OK 2024-04-18T03:40:48.052 INFO:tasks.workunit.client.0.smithi157.stderr:+ echo OK 2024-04-18T03:40:48.052 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-18T03:40:48.052 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-18T03:40:48.094 INFO:tasks.workunit:Stopping ['fs/maxentries'] on client.0... 2024-04-18T03:40:48.094 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-18T03:40:48.414 DEBUG:teuthology.parallel:result is None 2024-04-18T03:40:48.418 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T03:40:48.448 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T03:40:48.448 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-18T03:40:48.461 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-18T03:40:48.461 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:40:48.461 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:40:48.496 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:40:48.496 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:40:48.503 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:40:48.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ed56df700 1 Processor -- start 2024-04-18T03:40:48.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ed56df700 1 -- start start 2024-04-18T03:40:48.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ed56df700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ed56df700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0ed006e810 0x7f0ed006ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ed56df700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed006f180 con 0x7f0ed014a360 2024-04-18T03:40:48.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ed56df700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed00b25c0 con 0x7f0ed006e810 2024-04-18T03:40:48.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ed56df700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed01621f0 con 0x7f0ed00cdd20 2024-04-18T03:40:48.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ecffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0ed014a360 0x7f0ed0161ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51322/0 (socket says 172.21.15.157:51322) 2024-04-18T03:40:48.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ecffff700 1 -- 172.21.15.157:0/1573622806 learned_addr learned my addr 172.21.15.157:0/1573622806 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:48.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ecf7fe700 1 --2- 172.21.15.157:0/1573622806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.619+0000 7f0ed4ede700 1 --2- 172.21.15.157:0/1573622806 >> v2:172.21.15.175:3300/0 conn(0x7f0ed006e810 0x7f0ed006ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0eceffd700 1 -- 172.21.15.157:0/1573622806 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802740101 0 0) 0x7f0ed006f180 con 0x7f0ed014a360 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0eceffd700 1 -- 172.21.15.157:0/1573622806 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb80035d0 con 0x7f0ed014a360 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ecf7fe700 1 -- 172.21.15.157:0/1573622806 >> v2:172.21.15.175:3300/0 conn(0x7f0ed006e810 msgr2=0x7f0ed006ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ecf7fe700 1 --2- 172.21.15.157:0/1573622806 >> v2:172.21.15.175:3300/0 conn(0x7f0ed006e810 0x7f0ed006ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ecf7fe700 1 -- 172.21.15.157:0/1573622806 >> v1:172.21.15.157:6789/0 conn(0x7f0ed014a360 legacy=0x7f0ed0161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ecf7fe700 1 -- 172.21.15.157:0/1573622806 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00b1c20 con 0x7f0ed00cdd20 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed4ede700 1 --2- 172.21.15.157:0/1573622806 >> v2:172.21.15.175:3300/0 conn(0x7f0ed006e810 0x7f0ed006ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ecf7fe700 1 --2- 172.21.15.157:0/1573622806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00ce1b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009850 tx=0x7f0ec0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626c87db7ce64527 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0eceffd700 1 -- 172.21.15.157:0/1573622806 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0011830 con 0x7f0ed00cdd20 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0eceffd700 1 -- 172.21.15.157:0/1573622806 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec0011990 con 0x7f0ed00cdd20 2024-04-18T03:40:48.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0eceffd700 1 -- 172.21.15.157:0/1573622806 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0011d40 con 0x7f0ed00cdd20 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 -- 172.21.15.157:0/1573622806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 msgr2=0x7f0ed00ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 --2- 172.21.15.157:0/1573622806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00ce1b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009850 tx=0x7f0ec0009b60 comp rx=0 tx=0).stop 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 -- 172.21.15.157:0/1573622806 shutdown_connections 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 --2- 172.21.15.157:0/1573622806 >> v2:172.21.15.175:3300/0 conn(0x7f0ed006e810 0x7f0ed006ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 --2- 172.21.15.157:0/1573622806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00ce1b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 -- 172.21.15.157:0/1573622806 >> 172.21.15.157:0/1573622806 conn(0x7f0ed00b1330 msgr2=0x7f0ed006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 -- 172.21.15.157:0/1573622806 shutdown_connections 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 -- 172.21.15.157:0/1573622806 wait complete. 2024-04-18T03:40:48.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 Processor -- start 2024-04-18T03:40:48.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.623+0000 7f0ed56df700 1 -- start start 2024-04-18T03:40:48.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ed006e810 0x7f0ed0141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00a7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed014a360 0x7f0ed0070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0145030 con 0x7f0ed014a360 2024-04-18T03:40:48.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0144420 con 0x7f0ed006e810 2024-04-18T03:40:48.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0144700 con 0x7f0ed00cdd20 2024-04-18T03:40:48.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed014a360 0x7f0ed0070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed014a360 0x7f0ed0070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45286/0 (socket says 172.21.15.157:45286) 2024-04-18T03:40:48.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 -- 172.21.15.157:0/63186964 learned_addr learned my addr 172.21.15.157:0/63186964 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:48.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ecf7fe700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ecffff700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ed006e810 0x7f0ed0141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 -- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 msgr2=0x7f0ed00a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 -- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ed006e810 msgr2=0x7f0ed0141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ed006e810 0x7f0ed0141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 -- 172.21.15.157:0/63186964 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec8009a70 con 0x7f0ed014a360 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed4ede700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed014a360 0x7f0ed0070070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800efc0 tx=0x7f0ec800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0eccff9700 1 -- 172.21.15.157:0/63186964 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800ca90 con 0x7f0ed014a360 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0eccff9700 1 -- 172.21.15.157:0/63186964 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec800f040 con 0x7f0ed014a360 2024-04-18T03:40:48.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec00094b0 con 0x7f0ed014a360 2024-04-18T03:40:48.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0eccff9700 1 -- 172.21.15.157:0/63186964 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800ce30 con 0x7f0ed014a360 2024-04-18T03:40:48.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed0144cc0 con 0x7f0ed014a360 2024-04-18T03:40:48.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.627+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed01451a0 con 0x7f0ed014a360 2024-04-18T03:40:48.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.631+0000 7f0eccff9700 1 -- 172.21.15.157:0/63186964 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ec8003a40 con 0x7f0ed014a360 2024-04-18T03:40:48.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.631+0000 7f0eccff9700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0ebc066730 0x7f0ebc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.631+0000 7f0eccff9700 1 -- 172.21.15.157:0/63186964 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ec80856f0 con 0x7f0ed014a360 2024-04-18T03:40:48.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.631+0000 7f0ecffff700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0ebc066730 0x7f0ebc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.631+0000 7f0ecffff700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0ebc066730 0x7f0ebc068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4007fd0 tx=0x7f0ec4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:48.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.635+0000 7f0eccff9700 1 -- 172.21.15.157:0/63186964 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0ec8052600 con 0x7f0ed014a360 2024-04-18T03:40:48.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.803+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed004e650 con 0x7f0ed014a360 2024-04-18T03:40:48.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.807+0000 7f0eccff9700 1 -- 172.21.15.157:0/63186964 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f0ec8009cd0 con 0x7f0ed014a360 2024-04-18T03:40:48.811 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:40:48.811 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0ebc066730 msgr2=0x7f0ebc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0ebc066730 0x7f0ebc068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4007fd0 tx=0x7f0ec4009040 comp rx=0 tx=0).stop 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed014a360 msgr2=0x7f0ed0070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed014a360 0x7f0ed0070070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800efc0 tx=0x7f0ec800c3a0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 shutdown_connections 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0ebc066730 0x7f0ebc068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ed014a360 0x7f0ed0070070 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ed00cdd20 0x7f0ed00a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 --2- 172.21.15.157:0/63186964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ed006e810 0x7f0ed0141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 >> 172.21.15.157:0/63186964 conn(0x7f0ed00b1330 msgr2=0x7f0ed00af130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 shutdown_connections 2024-04-18T03:40:48.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.811+0000 7f0ed56df700 1 -- 172.21.15.157:0/63186964 wait complete. 2024-04-18T03:40:48.830 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:40:48.831 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:40:48.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d359e700 1 Processor -- start 2024-04-18T03:40:48.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d359e700 1 -- start start 2024-04-18T03:40:48.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 0x7f17d406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17d4070fa0 0x7f17d4160c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d359e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40b2f50 con 0x7f17d41467c0 2024-04-18T03:40:48.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d406bcd0 con 0x7f17d4070fa0 2024-04-18T03:40:48.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d41617e0 con 0x7f17d4146ba0 2024-04-18T03:40:48.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d259c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f17d41467c0 0x7f17d4070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51338/0 (socket says 172.21.15.157:51338) 2024-04-18T03:40:48.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d259c700 1 -- 172.21.15.157:0/3606173586 learned_addr learned my addr 172.21.15.157:0/3606173586 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:48.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d1d9b700 1 --2- 172.21.15.157:0/3606173586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 0x7f17d406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d2d9d700 1 --2- 172.21.15.157:0/3606173586 >> v2:172.21.15.175:3300/0 conn(0x7f17d4070fa0 0x7f17d4160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d159a700 1 -- 172.21.15.157:0/3606173586 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219949294 0 0) 0x7f17d40b2f50 con 0x7f17d41467c0 2024-04-18T03:40:48.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d159a700 1 -- 172.21.15.157:0/3606173586 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c00035d0 con 0x7f17d41467c0 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d2d9d700 1 -- 172.21.15.157:0/3606173586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 msgr2=0x7f17d406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d2d9d700 1 --2- 172.21.15.157:0/3606173586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 0x7f17d406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d159a700 1 -- 172.21.15.157:0/3606173586 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978391986 0 0) 0x7f17c00035d0 con 0x7f17d41467c0 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d2d9d700 1 -- 172.21.15.157:0/3606173586 >> v1:172.21.15.157:6789/0 conn(0x7f17d41467c0 legacy=0x7f17d4070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.943+0000 7f17d2d9d700 1 -- 172.21.15.157:0/3606173586 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4161ac0 con 0x7f17d4070fa0 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d2d9d700 1 --2- 172.21.15.157:0/3606173586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d4070fa0 0x7f17d4160c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009850 tx=0x7f17cc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a52fbed42e765be9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d159a700 1 -- 172.21.15.157:0/3606173586 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40019f0 con 0x7f17d4070fa0 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d159a700 1 -- 172.21.15.157:0/3606173586 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc004030 con 0x7f17d4070fa0 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d159a700 1 -- 172.21.15.157:0/3606173586 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0043a0 con 0x7f17d4070fa0 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 -- 172.21.15.157:0/3606173586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d4070fa0 msgr2=0x7f17d4160c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 --2- 172.21.15.157:0/3606173586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d4070fa0 0x7f17d4160c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009850 tx=0x7f17cc009b60 comp rx=0 tx=0).stop 2024-04-18T03:40:48.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 -- 172.21.15.157:0/3606173586 shutdown_connections 2024-04-18T03:40:48.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 --2- 172.21.15.157:0/3606173586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d4070fa0 0x7f17d4160c00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 --2- 172.21.15.157:0/3606173586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 0x7f17d406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 -- 172.21.15.157:0/3606173586 >> 172.21.15.157:0/3606173586 conn(0x7f17d40b1920 msgr2=0x7f17d40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:48.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 -- 172.21.15.157:0/3606173586 shutdown_connections 2024-04-18T03:40:48.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 -- 172.21.15.157:0/3606173586 wait complete. 2024-04-18T03:40:48.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 Processor -- start 2024-04-18T03:40:48.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.947+0000 7f17d359e700 1 -- start start 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17d4070fa0 0x7f17d40ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d41467c0 0x7f17d415f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 0x7f17d40cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4140480 con 0x7f17d4070fa0 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d41605c0 con 0x7f17d41467c0 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40cade0 con 0x7f17d4146ba0 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17d4070fa0 0x7f17d40ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17d4070fa0 0x7f17d40ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45290/0 (socket says 172.21.15.157:45290) 2024-04-18T03:40:48.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 -- 172.21.15.157:0/4244332136 learned_addr learned my addr 172.21.15.157:0/4244332136 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d2d9d700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 0x7f17d40cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d1d9b700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d41467c0 0x7f17d415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 -- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 msgr2=0x7f17d40cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 0x7f17d40cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 -- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d41467c0 msgr2=0x7f17d415f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d41467c0 0x7f17d415f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 -- 172.21.15.157:0/4244332136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0094b0 con 0x7f17d4070fa0 2024-04-18T03:40:48.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d259c700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17d4070fa0 0x7f17d40ca8a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001940 tx=0x7f17c400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:48.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17caffd700 1 -- 172.21.15.157:0/4244332136 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400acd0 con 0x7f17d4070fa0 2024-04-18T03:40:48.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17caffd700 1 -- 172.21.15.157:0/4244332136 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c400ae50 con 0x7f17d4070fa0 2024-04-18T03:40:48.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d4160000 con 0x7f17d4070fa0 2024-04-18T03:40:48.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17caffd700 1 -- 172.21.15.157:0/4244332136 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4007310 con 0x7f17d4070fa0 2024-04-18T03:40:48.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.951+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d41400a0 con 0x7f17d4070fa0 2024-04-18T03:40:48.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.955+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d413ff00 con 0x7f17d4070fa0 2024-04-18T03:40:48.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.955+0000 7f17caffd700 1 -- 172.21.15.157:0/4244332136 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f17c4007470 con 0x7f17d4070fa0 2024-04-18T03:40:48.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.955+0000 7f17caffd700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f17b4066730 0x7f17b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:48.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.955+0000 7f17caffd700 1 -- 172.21.15.157:0/4244332136 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17c4083fa0 con 0x7f17d4070fa0 2024-04-18T03:40:48.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.955+0000 7f17d1d9b700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f17b4066730 0x7f17b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:48.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.955+0000 7f17d1d9b700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f17b4066730 0x7f17b4068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17d40b3e30 tx=0x7f17bc009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:48.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:48.963+0000 7f17caffd700 1 -- 172.21.15.157:0/4244332136 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f17c40b5be0 con 0x7f17d4070fa0 2024-04-18T03:40:49.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17d41405c0 con 0x7f17d4070fa0 2024-04-18T03:40:49.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17caffd700 1 -- 172.21.15.157:0/4244332136 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17c4018020 con 0x7f17d4070fa0 2024-04-18T03:40:49.134 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:40:49.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f17b4066730 msgr2=0x7f17b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f17b4066730 0x7f17b4068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17d40b3e30 tx=0x7f17bc009240 comp rx=0 tx=0).stop 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17d4070fa0 msgr2=0x7f17d40ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17d4070fa0 0x7f17d40ca8a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001940 tx=0x7f17c400a340 comp rx=0 tx=0).stop 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 shutdown_connections 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f17b4066730 0x7f17b4068bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17d41467c0 0x7f17d415f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17d4146ba0 0x7f17d40cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 --2- 172.21.15.157:0/4244332136 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f17d4070fa0 0x7f17d40ca8a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 >> 172.21.15.157:0/4244332136 conn(0x7f17d40b1920 msgr2=0x7f17d40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 shutdown_connections 2024-04-18T03:40:49.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.131+0000 7f17d359e700 1 -- 172.21.15.157:0/4244332136 wait complete. 2024-04-18T03:40:49.148 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:40:49.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 Processor -- start 2024-04-18T03:40:49.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- start start 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbe6c1414e0 0x7fbe6c0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c142f80 con 0x7fbe6c06e810 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c1418c0 con 0x7fbe6c141c00 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c142370 con 0x7fbe6c1414e0 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbe6c1414e0 0x7fbe6c0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe70a54700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbe6c06e810 0x7fbe6c06ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51340/0 (socket says 172.21.15.157:51340) 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe70a54700 1 -- 172.21.15.157:0/193207045 learned_addr learned my addr 172.21.15.157:0/193207045 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6affd700 1 -- 172.21.15.157:0/193207045 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985605150 0 0) 0x7fbe6c142f80 con 0x7fbe6c06e810 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6affd700 1 -- 172.21.15.157:0/193207045 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe580035d0 con 0x7fbe6c06e810 2024-04-18T03:40:49.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6bfff700 1 -- 172.21.15.157:0/193207045 >> v1:172.21.15.175:6789/0 conn(0x7fbe6c141c00 legacy=0x7fbe6c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6bfff700 1 -- 172.21.15.157:0/193207045 >> v1:172.21.15.157:6789/0 conn(0x7fbe6c06e810 legacy=0x7fbe6c06ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6bfff700 1 -- 172.21.15.157:0/193207045 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c142650 con 0x7fbe6c1414e0 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6bfff700 1 --2- 172.21.15.157:0/193207045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c0717e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009850 tx=0x7fbe54009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c2247e2acc58ad server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6affd700 1 -- 172.21.15.157:0/193207045 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54011830 con 0x7fbe6c1414e0 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6affd700 1 -- 172.21.15.157:0/193207045 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54011990 con 0x7fbe6c1414e0 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe6affd700 1 -- 172.21.15.157:0/193207045 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54011d00 con 0x7fbe6c1414e0 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- 172.21.15.157:0/193207045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 msgr2=0x7fbe6c0717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 --2- 172.21.15.157:0/193207045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c0717e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009850 tx=0x7fbe54009b60 comp rx=0 tx=0).stop 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- 172.21.15.157:0/193207045 shutdown_connections 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 --2- 172.21.15.157:0/193207045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c0717e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- 172.21.15.157:0/193207045 >> 172.21.15.157:0/193207045 conn(0x7fbe6c0b12d0 msgr2=0x7fbe6c06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- 172.21.15.157:0/193207045 shutdown_connections 2024-04-18T03:40:49.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.263+0000 7fbe71255700 1 -- 172.21.15.157:0/193207045 wait complete. 2024-04-18T03:40:49.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.267+0000 7fbe71255700 1 Processor -- start 2024-04-18T03:40:49.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.267+0000 7fbe71255700 1 -- start start 2024-04-18T03:40:49.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe6c06e810 0x7fbe6c0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c14dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe6c141c00 0x7fbe6c13c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0aa860 con 0x7fbe6c1414e0 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c14e120 con 0x7fbe6c141c00 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0a9280 con 0x7fbe6c06e810 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c14dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c14dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45312/0 (socket says 172.21.15.157:45312) 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 -- 172.21.15.157:0/1427445475 learned_addr learned my addr 172.21.15.157:0/1427445475 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6bfff700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe6c06e810 0x7fbe6c0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe70a54700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe6c141c00 0x7fbe6c13c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 -- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe6c06e810 msgr2=0x7fbe6c0aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe6c06e810 0x7fbe6c0aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 -- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe6c141c00 msgr2=0x7fbe6c13c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe6c141c00 0x7fbe6c13c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 -- 172.21.15.157:0/1427445475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540094b0 con 0x7fbe6c1414e0 2024-04-18T03:40:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe6b7fe700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c14dbe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00cbc0 tx=0x7fbe5c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe68ff9700 1 -- 172.21.15.157:0/1427445475 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c003c20 con 0x7fbe6c1414e0 2024-04-18T03:40:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe68ff9700 1 -- 172.21.15.157:0/1427445475 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c003d80 con 0x7fbe6c1414e0 2024-04-18T03:40:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c0a9560 con 0x7fbe6c1414e0 2024-04-18T03:40:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe68ff9700 1 -- 172.21.15.157:0/1427445475 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c00aaa0 con 0x7fbe6c1414e0 2024-04-18T03:40:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c0a9b20 con 0x7fbe6c1414e0 2024-04-18T03:40:49.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.271+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c1433f0 con 0x7fbe6c1414e0 2024-04-18T03:40:49.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.275+0000 7fbe68ff9700 1 -- 172.21.15.157:0/1427445475 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe5c00ac00 con 0x7fbe6c1414e0 2024-04-18T03:40:49.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.275+0000 7fbe68ff9700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbe4c066730 0x7fbe4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.275+0000 7fbe68ff9700 1 -- 172.21.15.157:0/1427445475 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe5c0844f0 con 0x7fbe6c1414e0 2024-04-18T03:40:49.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.275+0000 7fbe6bfff700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbe4c066730 0x7fbe4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.275+0000 7fbe6bfff700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbe4c066730 0x7fbe4c068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009ba0 tx=0x7fbe54008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.279+0000 7fbe68ff9700 1 -- 172.21.15.157:0/1427445475 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fbe6c1433f0 con 0x7fbe6c1414e0 2024-04-18T03:40:49.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.447+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe6c1433f0 con 0x7fbe6c1414e0 2024-04-18T03:40:49.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.447+0000 7fbe68ff9700 1 -- 172.21.15.157:0/1427445475 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe6c1433f0 con 0x7fbe6c1414e0 2024-04-18T03:40:49.452 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:40:49.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbe4c066730 msgr2=0x7fbe4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbe4c066730 0x7fbe4c068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009ba0 tx=0x7fbe54008030 comp rx=0 tx=0).stop 2024-04-18T03:40:49.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 msgr2=0x7fbe6c14dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c14dbe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00cbc0 tx=0x7fbe5c00ced0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 shutdown_connections 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fbe4c066730 0x7fbe4c068bf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe6c141c00 0x7fbe6c13c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe6c1414e0 0x7fbe6c14dbe0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 --2- 172.21.15.157:0/1427445475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe6c06e810 0x7fbe6c0aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 >> 172.21.15.157:0/1427445475 conn(0x7fbe6c0b12d0 msgr2=0x7fbe6c06ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 shutdown_connections 2024-04-18T03:40:49.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.451+0000 7fbe71255700 1 -- 172.21.15.157:0/1427445475 wait complete. 2024-04-18T03:40:49.467 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:40:49.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.583+0000 7f6a34d40700 1 Processor -- start 2024-04-18T03:40:49.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.583+0000 7f6a34d40700 1 -- start start 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.583+0000 7f6a34d40700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a300717e0 0x7f6a30141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.583+0000 7f6a34d40700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a3006e810 0x7f6a3006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.583+0000 7f6a34d40700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a30142140 con 0x7f6a301414e0 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.583+0000 7f6a34d40700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3006f1c0 con 0x7f6a3006e810 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.583+0000 7f6a34d40700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a30071c40 con 0x7f6a300717e0 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a3006e810 0x7f6a3006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6a301414e0 0x7f6a3015b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51344/0 (socket says 172.21.15.157:51344) 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2f7fe700 1 -- 172.21.15.157:0/93852201 learned_addr learned my addr 172.21.15.157:0/93852201 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:49.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2effd700 1 --2- 172.21.15.157:0/93852201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a300717e0 0x7f6a30141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2ffff700 1 -- 172.21.15.157:0/93852201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a300717e0 msgr2=0x7f6a30141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:49.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2ffff700 1 --2- 172.21.15.157:0/93852201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a300717e0 0x7f6a30141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2ffff700 1 -- 172.21.15.157:0/93852201 >> v1:172.21.15.157:6789/0 conn(0x7f6a301414e0 legacy=0x7f6a3015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2ffff700 1 -- 172.21.15.157:0/93852201 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30142f80 con 0x7f6a3006e810 2024-04-18T03:40:49.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2e7fc700 1 -- 172.21.15.157:0/93852201 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307484140 0 0) 0x7f6a30142140 con 0x7f6a301414e0 2024-04-18T03:40:49.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2ffff700 1 --2- 172.21.15.157:0/93852201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a3006e810 0x7f6a3006ec80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f113335202d3951f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2e7fc700 1 -- 172.21.15.157:0/93852201 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800e070 con 0x7f6a3006e810 2024-04-18T03:40:49.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2e7fc700 1 -- 172.21.15.157:0/93852201 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800bb20 con 0x7f6a3006e810 2024-04-18T03:40:49.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a2e7fc700 1 -- 172.21.15.157:0/93852201 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28012430 con 0x7f6a3006e810 2024-04-18T03:40:49.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a34d40700 1 -- 172.21.15.157:0/93852201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a3006e810 msgr2=0x7f6a3006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a34d40700 1 --2- 172.21.15.157:0/93852201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a3006e810 0x7f6a3006ec80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2800b330 comp rx=0 tx=0).stop 2024-04-18T03:40:49.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a34d40700 1 -- 172.21.15.157:0/93852201 shutdown_connections 2024-04-18T03:40:49.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a34d40700 1 --2- 172.21.15.157:0/93852201 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a3006e810 0x7f6a3006ec80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a34d40700 1 --2- 172.21.15.157:0/93852201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a300717e0 0x7f6a30141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a34d40700 1 -- 172.21.15.157:0/93852201 >> 172.21.15.157:0/93852201 conn(0x7f6a300b12d0 msgr2=0x7f6a3006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:49.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a34d40700 1 -- 172.21.15.157:0/93852201 shutdown_connections 2024-04-18T03:40:49.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.587+0000 7f6a34d40700 1 -- 172.21.15.157:0/93852201 wait complete. 2024-04-18T03:40:49.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 Processor -- start 2024-04-18T03:40:49.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 -- start start 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a3006e810 0x7f6a3013b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a300717e0 0x7f6a301f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a301414e0 0x7f6a300b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3013c810 con 0x7f6a301414e0 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a301f6f80 con 0x7f6a300717e0 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3013bc00 con 0x7f6a3006e810 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a301414e0 0x7f6a300b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a301414e0 0x7f6a300b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45326/0 (socket says 172.21.15.157:45326) 2024-04-18T03:40:49.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 -- 172.21.15.157:0/89520190 learned_addr learned my addr 172.21.15.157:0/89520190 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2effd700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a300717e0 0x7f6a301f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2f7fe700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a3006e810 0x7f6a3013b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 -- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a3006e810 msgr2=0x7f6a3013b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a3006e810 0x7f6a3013b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 -- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a300717e0 msgr2=0x7f6a301f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a300717e0 0x7f6a301f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 -- 172.21.15.157:0/89520190 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28009a70 con 0x7f6a301414e0 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a2ffff700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a301414e0 0x7f6a300b35f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800b680 tx=0x7f6a28004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a27fff700 1 -- 172.21.15.157:0/89520190 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28012430 con 0x7f6a301414e0 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a27fff700 1 -- 172.21.15.157:0/89520190 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a28020070 con 0x7f6a301414e0 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3013bee0 con 0x7f6a301414e0 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a27fff700 1 -- 172.21.15.157:0/89520190 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28004280 con 0x7f6a301414e0 2024-04-18T03:40:49.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.591+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3013c4a0 con 0x7f6a301414e0 2024-04-18T03:40:49.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.595+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3013c980 con 0x7f6a301414e0 2024-04-18T03:40:49.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.595+0000 7f6a27fff700 1 -- 172.21.15.157:0/89520190 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a280043e0 con 0x7f6a301414e0 2024-04-18T03:40:49.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.595+0000 7f6a27fff700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6a10066760 0x7f6a10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.595+0000 7f6a27fff700 1 -- 172.21.15.157:0/89520190 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a28022070 con 0x7f6a301414e0 2024-04-18T03:40:49.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.595+0000 7f6a2f7fe700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6a10066760 0x7f6a10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.595+0000 7f6a2f7fe700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6a10066760 0x7f6a10068c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000f60 tx=0x7f6a18007c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.603+0000 7f6a27fff700 1 -- 172.21.15.157:0/89520190 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6a280536f0 con 0x7f6a301414e0 2024-04-18T03:40:49.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.811+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a3004e650 con 0x7f6a301414e0 2024-04-18T03:40:49.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.811+0000 7f6a27fff700 1 -- 172.21.15.157:0/89520190 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a28056d10 con 0x7f6a301414e0 2024-04-18T03:40:49.817 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:40:49.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6a10066760 msgr2=0x7f6a10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6a10066760 0x7f6a10068c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000f60 tx=0x7f6a18007c00 comp rx=0 tx=0).stop 2024-04-18T03:40:49.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a301414e0 msgr2=0x7f6a300b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a301414e0 0x7f6a300b35f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800b680 tx=0x7f6a28004af0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 shutdown_connections 2024-04-18T03:40:49.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6a10066760 0x7f6a10068c20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a300717e0 0x7f6a301f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a301414e0 0x7f6a300b35f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 --2- 172.21.15.157:0/89520190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a3006e810 0x7f6a3013b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 >> 172.21.15.157:0/89520190 conn(0x7f6a300b12d0 msgr2=0x7f6a3015d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:49.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 shutdown_connections 2024-04-18T03:40:49.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.815+0000 7f6a34d40700 1 -- 172.21.15.157:0/89520190 wait complete. 2024-04-18T03:40:49.831 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:40:49.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ded38700 1 Processor -- start 2024-04-18T03:40:49.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ded38700 1 -- start start 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ded38700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ded38700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f66d8161bb0 0x7f66d80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ded38700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f66d8162010 0x7f66d80ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ded38700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d80b25e0 con 0x7f66d8162010 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ded38700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d80ce8c0 con 0x7f66d8161bb0 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ded38700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d806f130 con 0x7f66d806e810 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66de537700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f66d8162010 0x7f66d80ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66dd535700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f66d8161bb0 0x7f66d80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d806ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:54878/0 (socket says 172.21.15.157:54878) 2024-04-18T03:40:49.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66de537700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f66d8162010 0x7f66d80ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45330/0 (socket says 172.21.15.157:45330) 2024-04-18T03:40:49.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 -- 172.21.15.157:0/1044783700 learned_addr learned my addr 172.21.15.157:0/1044783700 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:49.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 -- 172.21.15.157:0/1044783700 >> v2:172.21.15.175:3300/0 conn(0x7f66d8161bb0 msgr2=0x7f66d80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 --2- 172.21.15.157:0/1044783700 >> v2:172.21.15.175:3300/0 conn(0x7f66d8161bb0 0x7f66d80cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 -- 172.21.15.157:0/1044783700 >> v2:172.21.15.157:3300/0 conn(0x7f66d8162010 msgr2=0x7f66d80ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 --2- 172.21.15.157:0/1044783700 >> v2:172.21.15.157:3300/0 conn(0x7f66d8162010 0x7f66d80ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 -- 172.21.15.157:0/1044783700 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d814aa60 con 0x7f66d806e810 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66de537700 1 --2- 172.21.15.157:0/1044783700 >> v2:172.21.15.157:3300/0 conn(0x7f66d8162010 0x7f66d80ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66ddd36700 1 --2- 172.21.15.157:0/1044783700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d806ebf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66d806f450 tx=0x7f66cc009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe2cb9e15c0ff68a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66dcd34700 1 -- 172.21.15.157:0/1044783700 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc011830 con 0x7f66d806e810 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66dcd34700 1 -- 172.21.15.157:0/1044783700 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc011990 con 0x7f66d806e810 2024-04-18T03:40:49.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.943+0000 7f66dcd34700 1 -- 172.21.15.157:0/1044783700 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc011d20 con 0x7f66d806e810 2024-04-18T03:40:49.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 -- 172.21.15.157:0/1044783700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 msgr2=0x7f66d806ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 --2- 172.21.15.157:0/1044783700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d806ebf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66d806f450 tx=0x7f66cc009bf0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 -- 172.21.15.157:0/1044783700 shutdown_connections 2024-04-18T03:40:49.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 --2- 172.21.15.157:0/1044783700 >> v2:172.21.15.157:3300/0 conn(0x7f66d8162010 0x7f66d80ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 --2- 172.21.15.157:0/1044783700 >> v2:172.21.15.175:3300/0 conn(0x7f66d8161bb0 0x7f66d80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 --2- 172.21.15.157:0/1044783700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d806ebf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 -- 172.21.15.157:0/1044783700 >> 172.21.15.157:0/1044783700 conn(0x7f66d80b12d0 msgr2=0x7f66d806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:49.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 -- 172.21.15.157:0/1044783700 shutdown_connections 2024-04-18T03:40:49.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 -- 172.21.15.157:0/1044783700 wait complete. 2024-04-18T03:40:49.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 Processor -- start 2024-04-18T03:40:49.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.947+0000 7f66ded38700 1 -- start start 2024-04-18T03:40:49.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d81e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66d8161bb0 0x7f66d8142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d8162010 0x7f66d80cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d81f69c0 con 0x7f66d8161bb0 2024-04-18T03:40:49.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d81439f0 con 0x7f66d8162010 2024-04-18T03:40:49.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d8142d70 con 0x7f66d806e810 2024-04-18T03:40:49.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66d8161bb0 0x7f66d8142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ddd36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d81e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66d8161bb0 0x7f66d8142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45336/0 (socket says 172.21.15.157:45336) 2024-04-18T03:40:49.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ddd36700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d81e8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:54886/0 (socket says 172.21.15.157:54886) 2024-04-18T03:40:49.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66de537700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d8162010 0x7f66d80cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 -- 172.21.15.157:0/1517338324 learned_addr learned my addr 172.21.15.157:0/1517338324 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 -- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 msgr2=0x7f66d81e8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d81e8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 -- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d8162010 msgr2=0x7f66d80cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d8162010 0x7f66d80cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 -- 172.21.15.157:0/1517338324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d00094b0 con 0x7f66d8161bb0 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66dd535700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66d8161bb0 0x7f66d8142550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009d30 tx=0x7f66c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66d67fc700 1 -- 172.21.15.157:0/1517338324 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800cbb0 con 0x7f66d8161bb0 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66d67fc700 1 -- 172.21.15.157:0/1517338324 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c800f040 con 0x7f66d8161bb0 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc009570 con 0x7f66d8161bb0 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66d67fc700 1 -- 172.21.15.157:0/1517338324 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8014480 con 0x7f66d8161bb0 2024-04-18T03:40:49.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d8143330 con 0x7f66d8161bb0 2024-04-18T03:40:49.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.951+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d8143b30 con 0x7f66d8161bb0 2024-04-18T03:40:49.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.955+0000 7f66d67fc700 1 -- 172.21.15.157:0/1517338324 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66c80145e0 con 0x7f66d8161bb0 2024-04-18T03:40:49.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.955+0000 7f66d67fc700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f66c4066730 0x7f66c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:49.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.955+0000 7f66d67fc700 1 -- 172.21.15.157:0/1517338324 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66c8084c00 con 0x7f66d8161bb0 2024-04-18T03:40:49.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.955+0000 7f66ddd36700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f66c4066730 0x7f66c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:49.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.955+0000 7f66ddd36700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f66c4066730 0x7f66c4068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000c00 tx=0x7f66cc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:49.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:49.963+0000 7f66d67fc700 1 -- 172.21.15.157:0/1517338324 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f66d8143b30 con 0x7f66d8161bb0 2024-04-18T03:40:50.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f66d8143b30 con 0x7f66d8161bb0 2024-04-18T03:40:50.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66d67fc700 1 -- 172.21.15.157:0/1517338324 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f66c8018020 con 0x7f66d8161bb0 2024-04-18T03:40:50.138 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:40:50.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f66c4066730 msgr2=0x7f66c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f66c4066730 0x7f66c4068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000c00 tx=0x7f66cc008030 comp rx=0 tx=0).stop 2024-04-18T03:40:50.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66d8161bb0 msgr2=0x7f66d8142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66d8161bb0 0x7f66d8142550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009d30 tx=0x7f66c800c3a0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 shutdown_connections 2024-04-18T03:40:50.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f66c4066730 0x7f66c4068bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d8162010 0x7f66d80cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66d8161bb0 0x7f66d8142550 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 --2- 172.21.15.157:0/1517338324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d806e810 0x7f66d81e8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.135+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 >> 172.21.15.157:0/1517338324 conn(0x7f66d80b12d0 msgr2=0x7f66d80af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:50.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.139+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 shutdown_connections 2024-04-18T03:40:50.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.139+0000 7f66ded38700 1 -- 172.21.15.157:0/1517338324 wait complete. 2024-04-18T03:40:50.154 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:40:50.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb40a5a4700 1 Processor -- start 2024-04-18T03:40:50.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb40a5a4700 1 -- start start 2024-04-18T03:40:50.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb40a5a4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb4041414e0 0x7fb4040717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb40a5a4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb404141c00 0x7fb40415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb40a5a4700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb404142f80 con 0x7fb40406e810 2024-04-18T03:40:50.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb40a5a4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4041418c0 con 0x7fb4041414e0 2024-04-18T03:40:50.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb40a5a4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb404142370 con 0x7fb404141c00 2024-04-18T03:40:50.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb409da3700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb40406e810 0x7fb404143410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51356/0 (socket says 172.21.15.157:51356) 2024-04-18T03:40:50.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb409da3700 1 -- 172.21.15.157:0/3013483908 learned_addr learned my addr 172.21.15.157:0/3013483908 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:50.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.267+0000 7fb4095a2700 1 --2- 172.21.15.157:0/3013483908 >> v2:172.21.15.157:3300/0 conn(0x7fb4041414e0 0x7fb4040717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb408da1700 1 --2- 172.21.15.157:0/3013483908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb404141c00 0x7fb40415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb3fbfff700 1 -- 172.21.15.157:0/3013483908 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005919126 0 0) 0x7fb404142f80 con 0x7fb40406e810 2024-04-18T03:40:50.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb408da1700 1 -- 172.21.15.157:0/3013483908 >> v2:172.21.15.157:3300/0 conn(0x7fb4041414e0 msgr2=0x7fb4040717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:50.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb408da1700 1 --2- 172.21.15.157:0/3013483908 >> v2:172.21.15.157:3300/0 conn(0x7fb4041414e0 0x7fb4040717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb408da1700 1 -- 172.21.15.157:0/3013483908 >> v1:172.21.15.157:6789/0 conn(0x7fb40406e810 legacy=0x7fb404143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb408da1700 1 -- 172.21.15.157:0/3013483908 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404142650 con 0x7fb404141c00 2024-04-18T03:40:50.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb4095a2700 1 --2- 172.21.15.157:0/3013483908 >> v2:172.21.15.157:3300/0 conn(0x7fb4041414e0 0x7fb4040717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:40:50.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb408da1700 1 --2- 172.21.15.157:0/3013483908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb404141c00 0x7fb40415b5c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009850 tx=0x7fb3f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd3a9e99321e3ac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb3fbfff700 1 -- 172.21.15.157:0/3013483908 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011830 con 0x7fb404141c00 2024-04-18T03:40:50.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb3fbfff700 1 -- 172.21.15.157:0/3013483908 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f4011990 con 0x7fb404141c00 2024-04-18T03:40:50.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb3fbfff700 1 -- 172.21.15.157:0/3013483908 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011d40 con 0x7fb404141c00 2024-04-18T03:40:50.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb40a5a4700 1 -- 172.21.15.157:0/3013483908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb404141c00 msgr2=0x7fb40415b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/3013483908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb404141c00 0x7fb40415b5c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009850 tx=0x7fb3f4009b60 comp rx=0 tx=0).stop 2024-04-18T03:40:50.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb40a5a4700 1 -- 172.21.15.157:0/3013483908 shutdown_connections 2024-04-18T03:40:50.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/3013483908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb404141c00 0x7fb40415b5c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/3013483908 >> v2:172.21.15.157:3300/0 conn(0x7fb4041414e0 0x7fb4040717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb40a5a4700 1 -- 172.21.15.157:0/3013483908 >> 172.21.15.157:0/3013483908 conn(0x7fb4040b12d0 msgr2=0x7fb40406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:50.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb40a5a4700 1 -- 172.21.15.157:0/3013483908 shutdown_connections 2024-04-18T03:40:50.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.271+0000 7fb40a5a4700 1 -- 172.21.15.157:0/3013483908 wait complete. 2024-04-18T03:40:50.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 Processor -- start 2024-04-18T03:40:50.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 -- start start 2024-04-18T03:40:50.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb40406e810 0x7fb4040b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4041414e0 0x7fb404135670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb404141c00 0x7fb4041561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b2100 con 0x7fb404141c00 2024-04-18T03:40:50.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b23e0 con 0x7fb40406e810 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040b26c0 con 0x7fb4041414e0 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb404141c00 0x7fb4041561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb404141c00 0x7fb4041561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45360/0 (socket says 172.21.15.157:45360) 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 -- 172.21.15.157:0/2028621748 learned_addr learned my addr 172.21.15.157:0/2028621748 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb408da1700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4041414e0 0x7fb404135670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb4095a2700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb40406e810 0x7fb4040b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 -- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4041414e0 msgr2=0x7fb404135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4041414e0 0x7fb404135670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 -- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb40406e810 msgr2=0x7fb4040b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb40406e810 0x7fb4040b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 -- 172.21.15.157:0/2028621748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4000094b0 con 0x7fb404141c00 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb409da3700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb404141c00 0x7fb4041561a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc002230 tx=0x7fb3fc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb3f9ffb700 1 -- 172.21.15.157:0/2028621748 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00aac0 con 0x7fb404141c00 2024-04-18T03:40:50.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb3f9ffb700 1 -- 172.21.15.157:0/2028621748 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc00ac40 con 0x7fb404141c00 2024-04-18T03:40:50.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f40094b0 con 0x7fb404141c00 2024-04-18T03:40:50.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb3f9ffb700 1 -- 172.21.15.157:0/2028621748 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0070d0 con 0x7fb404141c00 2024-04-18T03:40:50.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.275+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040b2c80 con 0x7fb404141c00 2024-04-18T03:40:50.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.279+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40404e650 con 0x7fb404141c00 2024-04-18T03:40:50.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.279+0000 7fb3f9ffb700 1 -- 172.21.15.157:0/2028621748 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb3fc007250 con 0x7fb404141c00 2024-04-18T03:40:50.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.279+0000 7fb3f9ffb700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3e8066730 0x7fb3e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.279+0000 7fb3f9ffb700 1 -- 172.21.15.157:0/2028621748 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb3fc0842c0 con 0x7fb404141c00 2024-04-18T03:40:50.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.279+0000 7fb4095a2700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3e8066730 0x7fb3e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.279+0000 7fb4095a2700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3e8066730 0x7fb3e8068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4040718f0 tx=0x7fb400009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.287+0000 7fb3f9ffb700 1 -- 172.21.15.157:0/2028621748 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb3fc051270 con 0x7fb404141c00 2024-04-18T03:40:50.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.467+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4040b2e70 con 0x7fb404141c00 2024-04-18T03:40:50.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb3f9ffb700 1 -- 172.21.15.157:0/2028621748 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb3fc054890 con 0x7fb404141c00 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3e8066730 msgr2=0x7fb3e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3e8066730 0x7fb3e8068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4040718f0 tx=0x7fb400009240 comp rx=0 tx=0).stop 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb404141c00 msgr2=0x7fb4041561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb404141c00 0x7fb4041561a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc002230 tx=0x7fb3fc00cf50 comp rx=0 tx=0).stop 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 shutdown_connections 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3e8066730 0x7fb3e8068bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb404141c00 0x7fb4041561a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4041414e0 0x7fb404135670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 --2- 172.21.15.157:0/2028621748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb40406e810 0x7fb4040b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 >> 172.21.15.157:0/2028621748 conn(0x7fb4040b12d0 msgr2=0x7fb40415bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 shutdown_connections 2024-04-18T03:40:50.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.471+0000 7fb40a5a4700 1 -- 172.21.15.157:0/2028621748 wait complete. 2024-04-18T03:40:50.477 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:40:50.488 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:40:50.488 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:40:50.496 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:40:50.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25e140d700 1 Processor -- start 2024-04-18T03:40:50.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25e140d700 1 -- start start 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25e140d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f25dc15a060 0x7f25dc0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25e140d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc0cd920 0x7f25dc0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25e140d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc0ce2c0 con 0x7f25dc15da60 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25e140d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc0ccd60 con 0x7f25dc15a060 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25e140d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0cc770 con 0x7f25dc0cd920 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25db7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f25dc15da60 0x7f25dc15def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51360/0 (socket says 172.21.15.157:51360) 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25db7fe700 1 -- 172.21.15.157:0/1651806423 learned_addr learned my addr 172.21.15.157:0/1651806423 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25daffd700 1 --2- 172.21.15.157:0/1651806423 >> v2:172.21.15.175:3300/0 conn(0x7f25dc15a060 0x7f25dc0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25da7fc700 1 --2- 172.21.15.157:0/1651806423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc0cd920 0x7f25dc0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25d9ffb700 1 -- 172.21.15.157:0/1651806423 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354280533 0 0) 0x7f25dc0ce2c0 con 0x7f25dc15da60 2024-04-18T03:40:50.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25d9ffb700 1 -- 172.21.15.157:0/1651806423 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c80035d0 con 0x7f25dc15da60 2024-04-18T03:40:50.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25daffd700 1 -- 172.21.15.157:0/1651806423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc0cd920 msgr2=0x7f25dc0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:50.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25daffd700 1 --2- 172.21.15.157:0/1651806423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc0cd920 0x7f25dc0cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25daffd700 1 -- 172.21.15.157:0/1651806423 >> v1:172.21.15.157:6789/0 conn(0x7f25dc15da60 legacy=0x7f25dc15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25daffd700 1 -- 172.21.15.157:0/1651806423 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0cf3f0 con 0x7f25dc15a060 2024-04-18T03:40:50.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25daffd700 1 --2- 172.21.15.157:0/1651806423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc15a060 0x7f25dc0b0990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009850 tx=0x7f25c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69194fc655251548 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25d9ffb700 1 -- 172.21.15.157:0/1651806423 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4011830 con 0x7f25dc15a060 2024-04-18T03:40:50.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25d9ffb700 1 -- 172.21.15.157:0/1651806423 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c4011990 con 0x7f25dc15a060 2024-04-18T03:40:50.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.607+0000 7f25d9ffb700 1 -- 172.21.15.157:0/1651806423 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4011d40 con 0x7f25dc15a060 2024-04-18T03:40:50.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- 172.21.15.157:0/1651806423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc15a060 msgr2=0x7f25dc0b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 --2- 172.21.15.157:0/1651806423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc15a060 0x7f25dc0b0990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009850 tx=0x7f25c4009b60 comp rx=0 tx=0).stop 2024-04-18T03:40:50.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- 172.21.15.157:0/1651806423 shutdown_connections 2024-04-18T03:40:50.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 --2- 172.21.15.157:0/1651806423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc0cd920 0x7f25dc0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 --2- 172.21.15.157:0/1651806423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc15a060 0x7f25dc0b0990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- 172.21.15.157:0/1651806423 >> 172.21.15.157:0/1651806423 conn(0x7f25dc0b1880 msgr2=0x7f25dc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:50.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- 172.21.15.157:0/1651806423 shutdown_connections 2024-04-18T03:40:50.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- 172.21.15.157:0/1651806423 wait complete. 2024-04-18T03:40:50.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 Processor -- start 2024-04-18T03:40:50.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- start start 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc0cd920 0x7f25dc151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc15a060 0x7f25dc1f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25dc15da60 0x7f25dc1f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0ad1f0 con 0x7f25dc15da60 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0ac5e0 con 0x7f25dc0cd920 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25e140d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0ac8c0 con 0x7f25dc15a060 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25db7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25dc15da60 0x7f25dc1f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25db7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25dc15da60 0x7f25dc1f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45376/0 (socket says 172.21.15.157:45376) 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.611+0000 7f25db7fe700 1 -- 172.21.15.157:0/259116487 learned_addr learned my addr 172.21.15.157:0/259116487 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25daffd700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc0cd920 0x7f25dc151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25da7fc700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc15a060 0x7f25dc1f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25db7fe700 1 -- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc15a060 msgr2=0x7f25dc1f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25db7fe700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc15a060 0x7f25dc1f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25db7fe700 1 -- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc0cd920 msgr2=0x7f25dc151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25db7fe700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc0cd920 0x7f25dc151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25db7fe700 1 -- 172.21.15.157:0/259116487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c40094b0 con 0x7f25dc15da60 2024-04-18T03:40:50.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25db7fe700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25dc15da60 0x7f25dc1f2cf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f25d400caa0 tx=0x7f25d400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25d37fe700 1 -- 172.21.15.157:0/259116487 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4007480 con 0x7f25dc15da60 2024-04-18T03:40:50.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc0acba0 con 0x7f25dc15da60 2024-04-18T03:40:50.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc0ad680 con 0x7f25dc15da60 2024-04-18T03:40:50.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25d37fe700 1 -- 172.21.15.157:0/259116487 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d40075e0 con 0x7f25dc15da60 2024-04-18T03:40:50.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25d37fe700 1 -- 172.21.15.157:0/259116487 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4007970 con 0x7f25dc15da60 2024-04-18T03:40:50.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c0005310 con 0x7f25dc15da60 2024-04-18T03:40:50.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.615+0000 7f25d37fe700 1 -- 172.21.15.157:0/259116487 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25d401b3b0 con 0x7f25dc15da60 2024-04-18T03:40:50.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.619+0000 7f25d37fe700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f25bc066730 0x7f25bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.619+0000 7f25d37fe700 1 -- 172.21.15.157:0/259116487 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f25d4083d70 con 0x7f25dc15da60 2024-04-18T03:40:50.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.619+0000 7f25daffd700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f25bc066730 0x7f25bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.619+0000 7f25daffd700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f25bc066730 0x7f25bc068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f25c40090b0 tx=0x7f25c401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.623+0000 7f25d37fe700 1 -- 172.21.15.157:0/259116487 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f25d40547b0 con 0x7f25dc15da60 2024-04-18T03:40:50.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.803+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25c0005890 con 0x7f25dc15da60 2024-04-18T03:40:50.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.807+0000 7f25d37fe700 1 -- 172.21.15.157:0/259116487 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f25d4017020 con 0x7f25dc15da60 2024-04-18T03:40:50.811 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:40:50.811 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:40:50.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f25bc066730 msgr2=0x7f25bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f25bc066730 0x7f25bc068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f25c40090b0 tx=0x7f25c401c040 comp rx=0 tx=0).stop 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25dc15da60 msgr2=0x7f25dc1f2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25dc15da60 0x7f25dc1f2cf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f25d400caa0 tx=0x7f25d400cad0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 shutdown_connections 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f25bc066730 0x7f25bc068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25dc15da60 0x7f25dc1f2cf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25dc15a060 0x7f25dc1f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 --2- 172.21.15.157:0/259116487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25dc0cd920 0x7f25dc151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 >> 172.21.15.157:0/259116487 conn(0x7f25dc0b1880 msgr2=0x7f25dc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 shutdown_connections 2024-04-18T03:40:50.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.811+0000 7f25e140d700 1 -- 172.21.15.157:0/259116487 wait complete. 2024-04-18T03:40:50.829 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:40:50.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:40:50.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a7fff700 1 Processor -- start 2024-04-18T03:40:50.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a7fff700 1 -- start start 2024-04-18T03:40:50.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a7fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f35a8161660 0x7f35a806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a7fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a80d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a7fff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a806a770 con 0x7f35a8071080 2024-04-18T03:40:50.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a7fff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a806aa50 con 0x7f35a8161660 2024-04-18T03:40:50.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a7fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a806ad30 con 0x7f35a80d12b0 2024-04-18T03:40:50.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a6ffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f35a8071080 0x7f35a8071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51374/0 (socket says 172.21.15.157:51374) 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.943+0000 7f35a6ffd700 1 -- 172.21.15.157:0/2824699055 learned_addr learned my addr 172.21.15.157:0/2824699055 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a67fc700 1 --2- 172.21.15.157:0/2824699055 >> v2:172.21.15.175:3300/0 conn(0x7f35a8161660 0x7f35a806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a77fe700 1 --2- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a80d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a5ffb700 1 -- 172.21.15.157:0/2824699055 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394887135 0 0) 0x7f35a806a770 con 0x7f35a8071080 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a5ffb700 1 -- 172.21.15.157:0/2824699055 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35940035d0 con 0x7f35a8071080 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a67fc700 1 -- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 msgr2=0x7f35a80d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a67fc700 1 --2- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a80d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a67fc700 1 -- 172.21.15.157:0/2824699055 >> v1:172.21.15.157:6789/0 conn(0x7f35a8071080 legacy=0x7f35a8071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a67fc700 1 -- 172.21.15.157:0/2824699055 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a806b010 con 0x7f35a8161660 2024-04-18T03:40:50.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a77fe700 1 --2- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a80d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:40:50.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a67fc700 1 --2- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8161660 0x7f35a806c3a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3598009850 tx=0x7f3598009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa5d317b6f453c24 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a5ffb700 1 -- 172.21.15.157:0/2824699055 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598011830 con 0x7f35a8161660 2024-04-18T03:40:50.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a5ffb700 1 -- 172.21.15.157:0/2824699055 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598011990 con 0x7f35a8161660 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a5ffb700 1 -- 172.21.15.157:0/2824699055 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598011d00 con 0x7f35a8161660 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a7fff700 1 -- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8161660 msgr2=0x7f35a806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8161660 0x7f35a806c3a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3598009850 tx=0x7f3598009b60 comp rx=0 tx=0).stop 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a7fff700 1 -- 172.21.15.157:0/2824699055 shutdown_connections 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a80d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2824699055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8161660 0x7f35a806c3a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a7fff700 1 -- 172.21.15.157:0/2824699055 >> 172.21.15.157:0/2824699055 conn(0x7f35a806e020 msgr2=0x7f35a806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a7fff700 1 -- 172.21.15.157:0/2824699055 shutdown_connections 2024-04-18T03:40:50.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.947+0000 7f35a7fff700 1 -- 172.21.15.157:0/2824699055 wait complete. 2024-04-18T03:40:50.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 Processor -- start 2024-04-18T03:40:50.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 -- start start 2024-04-18T03:40:50.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8071080 0x7f35a81568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a815e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35a8161660 0x7f35a815ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8157a50 con 0x7f35a8161660 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a81f2b00 con 0x7f35a8071080 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80aba60 con 0x7f35a80d12b0 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35a8161660 0x7f35a815ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35a8161660 0x7f35a815ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45386/0 (socket says 172.21.15.157:45386) 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 -- 172.21.15.157:0/2246418741 learned_addr learned my addr 172.21.15.157:0/2246418741 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a67fc700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a6ffd700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8071080 0x7f35a81568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 -- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 msgr2=0x7f35a815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 -- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8071080 msgr2=0x7f35a81568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8071080 0x7f35a81568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 -- 172.21.15.157:0/2246418741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0009a70 con 0x7f35a8161660 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a67fc700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a6ffd700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8071080 0x7f35a81568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:40:50.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a77fe700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35a8161660 0x7f35a815ecd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f35a000efc0 tx=0x7f35a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f359ffff700 1 -- 172.21.15.157:0/2246418741 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0009d70 con 0x7f35a8161660 2024-04-18T03:40:50.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f359ffff700 1 -- 172.21.15.157:0/2246418741 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000f040 con 0x7f35a8161660 2024-04-18T03:40:50.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35980094b0 con 0x7f35a8161660 2024-04-18T03:40:50.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f359ffff700 1 -- 172.21.15.157:0/2246418741 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000ce00 con 0x7f35a8161660 2024-04-18T03:40:50.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.951+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a815ad20 con 0x7f35a8161660 2024-04-18T03:40:50.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.955+0000 7f359ffff700 1 -- 172.21.15.157:0/2246418741 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f35a0014480 con 0x7f35a8161660 2024-04-18T03:40:50.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.955+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a804e650 con 0x7f35a8161660 2024-04-18T03:40:50.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.955+0000 7f359ffff700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3588066730 0x7f3588068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:50.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.955+0000 7f359ffff700 1 -- 172.21.15.157:0/2246418741 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f35a0084fb0 con 0x7f35a8161660 2024-04-18T03:40:50.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.955+0000 7f35a6ffd700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3588066730 0x7f3588068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:50.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.955+0000 7f35a6ffd700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3588066730 0x7f3588068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3590005930 tx=0x7f3590009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:50.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:50.959+0000 7f359ffff700 1 -- 172.21.15.157:0/2246418741 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f35a0051ec0 con 0x7f35a8161660 2024-04-18T03:40:51.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.127+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35a806a550 con 0x7f35a8161660 2024-04-18T03:40:51.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.127+0000 7f359ffff700 1 -- 172.21.15.157:0/2246418741 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35a0018020 con 0x7f35a8161660 2024-04-18T03:40:51.133 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:40:51.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3588066730 msgr2=0x7f3588068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3588066730 0x7f3588068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3590005930 tx=0x7f3590009040 comp rx=0 tx=0).stop 2024-04-18T03:40:51.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35a8161660 msgr2=0x7f35a815ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35a8161660 0x7f35a815ecd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f35a000efc0 tx=0x7f35a000c3a0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 shutdown_connections 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3588066730 0x7f3588068bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35a8161660 0x7f35a815ecd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35a80d12b0 0x7f35a815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 --2- 172.21.15.157:0/2246418741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35a8071080 0x7f35a81568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 >> 172.21.15.157:0/2246418741 conn(0x7f35a806e020 msgr2=0x7f35a815f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 shutdown_connections 2024-04-18T03:40:51.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.131+0000 7f35a7fff700 1 -- 172.21.15.157:0/2246418741 wait complete. 2024-04-18T03:40:51.148 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:40:51.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73ffff700 1 Processor -- start 2024-04-18T03:40:51.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73ffff700 1 -- start start 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73ffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7400adf00 0x7fb740071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 0x7fb74015c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73ffff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74015bef0 con 0x7fb7400716c0 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73ffff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74015b0e0 con 0x7fb7400adf00 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73ffff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb740071b40 con 0x7fb74015ac70 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb7367fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb7400716c0 0x7fb74015a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51376/0 (socket says 172.21.15.157:51376) 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb7367fc700 1 -- 172.21.15.157:0/70541375 learned_addr learned my addr 172.21.15.157:0/70541375 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73f7fe700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 0x7fb74015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73effd700 1 --2- 172.21.15.157:0/70541375 >> v2:172.21.15.175:3300/0 conn(0x7fb7400adf00 0x7fb740071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989460980 0 0) 0x7fb74015bef0 con 0x7fb7400716c0 2024-04-18T03:40:51.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb72c0035d0 con 0x7fb7400716c0 2024-04-18T03:40:51.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776606321 0 0) 0x7fb72c0035d0 con 0x7fb7400716c0 2024-04-18T03:40:51.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 msgr2=0x7fb74015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:51.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 0x7fb74015c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 >> v2:172.21.15.175:3300/0 conn(0x7fb7400adf00 msgr2=0x7fb740071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:51.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 --2- 172.21.15.157:0/70541375 >> v2:172.21.15.175:3300/0 conn(0x7fb7400adf00 0x7fb740071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400ae2e0 con 0x7fb7400716c0 2024-04-18T03:40:51.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7fb728001670 con 0x7fb7400716c0 2024-04-18T03:40:51.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73effd700 1 --2- 172.21.15.157:0/70541375 >> v2:172.21.15.175:3300/0 conn(0x7fb7400adf00 0x7fb740071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73f7fe700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 0x7fb74015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 >> v1:172.21.15.157:6789/0 conn(0x7fb7400716c0 legacy=0x7fb74015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c003a20 0x7fb72c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 0x7fb72c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb72c004db0 0x7fb72c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74015b0e0 con 0x7fb72c004db0 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740071b40 con 0x7fb72c003a20 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c00dc40 con 0x7fb74015ac70 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73f7fe700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb72c004db0 0x7fb72c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb7367fc700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 0x7fb72c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73effd700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c003a20 0x7fb72c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73f7fe700 1 -- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 msgr2=0x7fb72c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73f7fe700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015ac70 0x7fb72c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73f7fe700 1 -- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c003a20 msgr2=0x7fb72c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:51.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73f7fe700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c003a20 0x7fb72c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.263+0000 7fb73f7fe700 1 -- 172.21.15.157:0/70541375 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738009a70 con 0x7fb72c004db0 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73f7fe700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb72c004db0 0x7fb72c005230 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb73800e350 tx=0x7fb72c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2d6fa439443621 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800edf0 con 0x7fb72c004db0 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73800f040 con 0x7fb72c004db0 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73e7fc700 1 -- 172.21.15.157:0/70541375 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380146a0 con 0x7fb72c004db0 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73ffff700 1 -- 172.21.15.157:0/70541375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb72c004db0 msgr2=0x7fb72c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73ffff700 1 --2- 172.21.15.157:0/70541375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb72c004db0 0x7fb72c005230 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb73800e350 tx=0x7fb72c0058a0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73f7fe700 1 -- 172.21.15.157:0/70541375 reap_dead start 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73ffff700 1 -- 172.21.15.157:0/70541375 shutdown_connections 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73ffff700 1 -- 172.21.15.157:0/70541375 >> 172.21.15.157:0/70541375 conn(0x7fb7400b12d0 msgr2=0x7fb74006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73ffff700 1 -- 172.21.15.157:0/70541375 shutdown_connections 2024-04-18T03:40:51.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73ffff700 1 -- 172.21.15.157:0/70541375 wait complete. 2024-04-18T03:40:51.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73ffff700 1 Processor -- start 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.267+0000 7fb73ffff700 1 -- start start 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7401f5ab0 0x7fb7401f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7401f6440 0x7fb74013a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74013ab00 0x7fb7400b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74013af80 con 0x7fb7401f5ab0 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400af820 con 0x7fb7401f6440 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400afa70 con 0x7fb74013ab00 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7401f5ab0 0x7fb7401f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7401f5ab0 0x7fb7401f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45412/0 (socket says 172.21.15.157:45412) 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 -- 172.21.15.157:0/1351519565 learned_addr learned my addr 172.21.15.157:0/1351519565 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb7367fc700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7401f6440 0x7fb74013a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73f7fe700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74013ab00 0x7fb7400b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 -- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74013ab00 msgr2=0x7fb7400b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74013ab00 0x7fb7400b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 -- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7401f6440 msgr2=0x7fb74013a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7401f6440 0x7fb74013a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 -- 172.21.15.157:0/1351519565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400afd50 con 0x7fb7401f5ab0 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73effd700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7401f5ab0 0x7fb7401f5e90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb730011cd0 tx=0x7fb730009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73cff9700 1 -- 172.21.15.157:0/1351519565 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000f9d0 con 0x7fb7401f5ab0 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73cff9700 1 -- 172.21.15.157:0/1351519565 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73000fb30 con 0x7fb7401f5ab0 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73cff9700 1 -- 172.21.15.157:0/1351519565 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000fee0 con 0x7fb7401f5ab0 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7400b0030 con 0x7fb7401f5ab0 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7400b3860 con 0x7fb7401f5ab0 2024-04-18T03:40:51.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.271+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74004e650 con 0x7fb7401f5ab0 2024-04-18T03:40:51.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.275+0000 7fb73cff9700 1 -- 172.21.15.157:0/1351519565 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb730014440 con 0x7fb7401f5ab0 2024-04-18T03:40:51.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.275+0000 7fb73cff9700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb720066760 0x7fb720068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.275+0000 7fb73cff9700 1 -- 172.21.15.157:0/1351519565 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb730085140 con 0x7fb7401f5ab0 2024-04-18T03:40:51.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.275+0000 7fb7367fc700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb720066760 0x7fb720068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.275+0000 7fb7367fc700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb720066760 0x7fb720068c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7401522f0 tx=0x7fb7280079a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.283+0000 7fb73cff9700 1 -- 172.21.15.157:0/1351519565 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb730052260 con 0x7fb7401f5ab0 2024-04-18T03:40:51.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.447+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7400afbb0 con 0x7fb7401f5ab0 2024-04-18T03:40:51.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.447+0000 7fb73cff9700 1 -- 172.21.15.157:0/1351519565 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7400afbb0 con 0x7fb7401f5ab0 2024-04-18T03:40:51.452 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:40:51.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb720066760 msgr2=0x7fb720068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb720066760 0x7fb720068c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7401522f0 tx=0x7fb7280079a0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7401f5ab0 msgr2=0x7fb7401f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7401f5ab0 0x7fb7401f5e90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb730011cd0 tx=0x7fb730009f60 comp rx=0 tx=0).stop 2024-04-18T03:40:51.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 shutdown_connections 2024-04-18T03:40:51.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb720066760 0x7fb720068c20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7401f6440 0x7fb74013a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74013ab00 0x7fb7400b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 --2- 172.21.15.157:0/1351519565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7401f5ab0 0x7fb7401f5e90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 >> 172.21.15.157:0/1351519565 conn(0x7fb7400b12d0 msgr2=0x7fb74015d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:51.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 shutdown_connections 2024-04-18T03:40:51.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.451+0000 7fb73ffff700 1 -- 172.21.15.157:0/1351519565 wait complete. 2024-04-18T03:40:51.473 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:40:51.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.587+0000 7f9e41af9700 1 Processor -- start 2024-04-18T03:40:51.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.587+0000 7f9e41af9700 1 -- start start 2024-04-18T03:40:51.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.587+0000 7f9e41af9700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e3c161660 0x7f9e3c06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.587+0000 7f9e41af9700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9e3c0d12b0 0x7f9e3c0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.587+0000 7f9e41af9700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c06a770 con 0x7f9e3c071080 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.587+0000 7f9e41af9700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c06aa50 con 0x7f9e3c0d12b0 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.587+0000 7f9e41af9700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c06ad30 con 0x7f9e3c161660 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.587+0000 7f9e412f8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9e3c0d12b0 0x7f9e3c0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e40af7700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9e3c071080 0x7f9e3c071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51388/0 (socket says 172.21.15.157:51388) 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e412f8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9e3c0d12b0 0x7f9e3c0d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45414/0 (socket says 172.21.15.157:45414) 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e40af7700 1 -- 172.21.15.157:0/3417440228 learned_addr learned my addr 172.21.15.157:0/3417440228 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e3bfff700 1 --2- 172.21.15.157:0/3417440228 >> v2:172.21.15.175:3300/0 conn(0x7f9e3c161660 0x7f9e3c06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e412f8700 1 -- 172.21.15.157:0/3417440228 >> v2:172.21.15.175:3300/0 conn(0x7f9e3c161660 msgr2=0x7f9e3c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e412f8700 1 --2- 172.21.15.157:0/3417440228 >> v2:172.21.15.175:3300/0 conn(0x7f9e3c161660 0x7f9e3c06c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e412f8700 1 -- 172.21.15.157:0/3417440228 >> v1:172.21.15.157:6789/0 conn(0x7f9e3c071080 legacy=0x7f9e3c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e412f8700 1 -- 172.21.15.157:0/3417440228 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c06b010 con 0x7f9e3c0d12b0 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e412f8700 1 --2- 172.21.15.157:0/3417440228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c0d12b0 0x7f9e3c0d1740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0b7670 tx=0x7f9e34009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e3f4d8f2324354 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e3b7fe700 1 -- 172.21.15.157:0/3417440228 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34011830 con 0x7f9e3c0d12b0 2024-04-18T03:40:51.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e3b7fe700 1 -- 172.21.15.157:0/3417440228 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34011990 con 0x7f9e3c0d12b0 2024-04-18T03:40:51.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e3b7fe700 1 -- 172.21.15.157:0/3417440228 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34011d40 con 0x7f9e3c0d12b0 2024-04-18T03:40:51.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 -- 172.21.15.157:0/3417440228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c0d12b0 msgr2=0x7f9e3c0d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3417440228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c0d12b0 0x7f9e3c0d1740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0b7670 tx=0x7f9e34009b30 comp rx=0 tx=0).stop 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 -- 172.21.15.157:0/3417440228 shutdown_connections 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3417440228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c0d12b0 0x7f9e3c0d1740 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3417440228 >> v2:172.21.15.175:3300/0 conn(0x7f9e3c161660 0x7f9e3c06c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 -- 172.21.15.157:0/3417440228 >> 172.21.15.157:0/3417440228 conn(0x7f9e3c06e020 msgr2=0x7f9e3c06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 -- 172.21.15.157:0/3417440228 shutdown_connections 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 -- 172.21.15.157:0/3417440228 wait complete. 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 Processor -- start 2024-04-18T03:40:51.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.591+0000 7f9e41af9700 1 -- start start 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c071080 0x7f9e3c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3c0d12b0 0x7f9e3c15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e3c161660 0x7f9e3c144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1423c0 con 0x7f9e3c071080 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1550f0 con 0x7f9e3c0d12b0 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1553d0 con 0x7f9e3c161660 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c071080 0x7f9e3c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c071080 0x7f9e3c152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45430/0 (socket says 172.21.15.157:45430) 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 -- 172.21.15.157:0/3938554567 learned_addr learned my addr 172.21.15.157:0/3938554567 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e412f8700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e3c161660 0x7f9e3c144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e3bfff700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3c0d12b0 0x7f9e3c15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 -- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e3c161660 msgr2=0x7f9e3c144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e3c161660 0x7f9e3c144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 -- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3c0d12b0 msgr2=0x7f9e3c15ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3c0d12b0 0x7f9e3c15ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 -- 172.21.15.157:0/3938554567 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340094b0 con 0x7f9e3c071080 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e3bfff700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3c0d12b0 0x7f9e3c15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e40af7700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c071080 0x7f9e3c152400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000c700 tx=0x7f9e3000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e397fa700 1 -- 172.21.15.157:0/3938554567 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30005d90 con 0x7f9e3c071080 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e397fa700 1 -- 172.21.15.157:0/3938554567 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e300070d0 con 0x7f9e3c071080 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c142630 con 0x7f9e3c071080 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e397fa700 1 -- 172.21.15.157:0/3938554567 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30007440 con 0x7f9e3c071080 2024-04-18T03:40:51.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c152940 con 0x7f9e3c071080 2024-04-18T03:40:51.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c04e650 con 0x7f9e3c071080 2024-04-18T03:40:51.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e397fa700 1 -- 172.21.15.157:0/3938554567 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e300075a0 con 0x7f9e3c071080 2024-04-18T03:40:51.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.595+0000 7f9e397fa700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9e28066730 0x7f9e28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.599+0000 7f9e397fa700 1 -- 172.21.15.157:0/3938554567 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e30083860 con 0x7f9e3c071080 2024-04-18T03:40:51.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.599+0000 7f9e3bfff700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9e28066730 0x7f9e28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.599+0000 7f9e3bfff700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9e28066730 0x7f9e28068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c15dc70 tx=0x7f9e2c003a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.607+0000 7f9e397fa700 1 -- 172.21.15.157:0/3938554567 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9e300508d0 con 0x7f9e3c071080 2024-04-18T03:40:51.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.775+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e3c06a550 con 0x7f9e3c071080 2024-04-18T03:40:51.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.775+0000 7f9e397fa700 1 -- 172.21.15.157:0/3938554567 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e30053ef0 con 0x7f9e3c071080 2024-04-18T03:40:51.778 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:40:51.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9e28066730 msgr2=0x7f9e28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9e28066730 0x7f9e28068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c15dc70 tx=0x7f9e2c003a80 comp rx=0 tx=0).stop 2024-04-18T03:40:51.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c071080 msgr2=0x7f9e3c152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c071080 0x7f9e3c152400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000c700 tx=0x7f9e3000ca10 comp rx=0 tx=0).stop 2024-04-18T03:40:51.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 shutdown_connections 2024-04-18T03:40:51.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9e28066730 0x7f9e28068bf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e3c0d12b0 0x7f9e3c15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e3c161660 0x7f9e3c144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 --2- 172.21.15.157:0/3938554567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e3c071080 0x7f9e3c152400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 >> 172.21.15.157:0/3938554567 conn(0x7f9e3c06e020 msgr2=0x7f9e3c1580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:51.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 shutdown_connections 2024-04-18T03:40:51.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.779+0000 7f9e41af9700 1 -- 172.21.15.157:0/3938554567 wait complete. 2024-04-18T03:40:51.797 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:40:51.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.911+0000 7f89719d8700 1 Processor -- start 2024-04-18T03:40:51.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.911+0000 7f89719d8700 1 -- start start 2024-04-18T03:40:51.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f896c0cf4a0 0x7f896c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c1614e0 con 0x7f896c1610d0 2024-04-18T03:40:51.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c06b0b0 con 0x7f896c15d210 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c06b390 con 0x7f896c0cf4a0 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f896c0cf4a0 0x7f896c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89711d7700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f896c1610d0 0x7f896c070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:51396/0 (socket says 172.21.15.157:51396) 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f896c0cf4a0 0x7f896c160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45444/0 (socket says 172.21.15.157:45444) 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89711d7700 1 -- 172.21.15.157:0/1864649593 learned_addr learned my addr 172.21.15.157:0/1864649593 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896bfff700 1 -- 172.21.15.157:0/1864649593 >> v1:172.21.15.175:6789/0 conn(0x7f896c15d210 legacy=0x7f896c06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896bfff700 1 -- 172.21.15.157:0/1864649593 >> v1:172.21.15.157:6789/0 conn(0x7f896c1610d0 legacy=0x7f896c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896bfff700 1 -- 172.21.15.157:0/1864649593 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c06b670 con 0x7f896c0cf4a0 2024-04-18T03:40:51.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896bfff700 1 --2- 172.21.15.157:0/1864649593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c160b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8954009850 tx=0x7f8954009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6053ddd7c2c511d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896b7fe700 1 -- 172.21.15.157:0/1864649593 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011830 con 0x7f896c0cf4a0 2024-04-18T03:40:51.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896b7fe700 1 -- 172.21.15.157:0/1864649593 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954011990 con 0x7f896c0cf4a0 2024-04-18T03:40:51.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f896b7fe700 1 -- 172.21.15.157:0/1864649593 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011d20 con 0x7f896c0cf4a0 2024-04-18T03:40:51.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 -- 172.21.15.157:0/1864649593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 msgr2=0x7f896c160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 --2- 172.21.15.157:0/1864649593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c160b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8954009850 tx=0x7f8954009b60 comp rx=0 tx=0).stop 2024-04-18T03:40:51.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 -- 172.21.15.157:0/1864649593 shutdown_connections 2024-04-18T03:40:51.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 --2- 172.21.15.157:0/1864649593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c160b90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 -- 172.21.15.157:0/1864649593 >> 172.21.15.157:0/1864649593 conn(0x7f896c0d0c20 msgr2=0x7f896c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:51.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 -- 172.21.15.157:0/1864649593 shutdown_connections 2024-04-18T03:40:51.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.915+0000 7f89719d8700 1 -- 172.21.15.157:0/1864649593 wait complete. 2024-04-18T03:40:51.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.919+0000 7f89719d8700 1 Processor -- start 2024-04-18T03:40:51.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.919+0000 7f89719d8700 1 -- start start 2024-04-18T03:40:51.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.919+0000 7f89719d8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.919+0000 7f89719d8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f896c15d210 0x7f896c0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.919+0000 7f89719d8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f896c1610d0 0x7f896c0c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.919+0000 7f89719d8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c14b510 con 0x7f896c0cf4a0 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.919+0000 7f89719d8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0b4fb0 con 0x7f896c15d210 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.919+0000 7f89719d8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0b5290 con 0x7f896c1610d0 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c14afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45452/0 (socket says 172.21.15.157:45452) 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 -- 172.21.15.157:0/355457393 learned_addr learned my addr 172.21.15.157:0/355457393 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f896bfff700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f896c15d210 0x7f896c0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89711d7700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f896c1610d0 0x7f896c0c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 -- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f896c1610d0 msgr2=0x7f896c0c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f896c1610d0 0x7f896c0c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 -- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f896c15d210 msgr2=0x7f896c0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:51.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f896c15d210 0x7f896c0b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:51.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 -- 172.21.15.157:0/355457393 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540094b0 con 0x7f896c0cf4a0 2024-04-18T03:40:51.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89711d7700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f896c1610d0 0x7f896c0c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:40:51.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89709d6700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c14afd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c500 tx=0x7f895c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89697fa700 1 -- 172.21.15.157:0/355457393 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0052d0 con 0x7f896c0cf4a0 2024-04-18T03:40:51.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89697fa700 1 -- 172.21.15.157:0/355457393 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c005430 con 0x7f896c0cf4a0 2024-04-18T03:40:51.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c0b5570 con 0x7f896c0cf4a0 2024-04-18T03:40:51.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89697fa700 1 -- 172.21.15.157:0/355457393 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0055a0 con 0x7f896c0cf4a0 2024-04-18T03:40:51.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c0b5b30 con 0x7f896c0cf4a0 2024-04-18T03:40:51.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c04e650 con 0x7f896c0cf4a0 2024-04-18T03:40:51.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.923+0000 7f89697fa700 1 -- 172.21.15.157:0/355457393 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f895c0036a0 con 0x7f896c0cf4a0 2024-04-18T03:40:51.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.927+0000 7f89697fa700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f894c066730 0x7f894c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:51.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.927+0000 7f89697fa700 1 -- 172.21.15.157:0/355457393 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f895c083810 con 0x7f896c0cf4a0 2024-04-18T03:40:51.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.927+0000 7f896bfff700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f894c066730 0x7f894c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:51.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.927+0000 7f896bfff700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f894c066730 0x7f894c068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8954009fd0 tx=0x7f8954008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:51.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:51.931+0000 7f89697fa700 1 -- 172.21.15.157:0/355457393 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f895c050740 con 0x7f896c0cf4a0 2024-04-18T03:40:52.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.099+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f896c06ec40 con 0x7f896c0cf4a0 2024-04-18T03:40:52.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.099+0000 7f89697fa700 1 -- 172.21.15.157:0/355457393 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f895c053d60 con 0x7f896c0cf4a0 2024-04-18T03:40:52.105 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f894c066730 msgr2=0x7f894c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f894c066730 0x7f894c068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8954009fd0 tx=0x7f8954008030 comp rx=0 tx=0).stop 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 msgr2=0x7f896c14afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c14afd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f895c00c500 tx=0x7f895c00c810 comp rx=0 tx=0).stop 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 shutdown_connections 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f894c066730 0x7f894c068bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f896c15d210 0x7f896c0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f896c1610d0 0x7f896c0c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 --2- 172.21.15.157:0/355457393 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f896c0cf4a0 0x7f896c14afd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 >> 172.21.15.157:0/355457393 conn(0x7f896c0d0c20 msgr2=0x7f896c0b26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:52.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 shutdown_connections 2024-04-18T03:40:52.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.103+0000 7f89719d8700 1 -- 172.21.15.157:0/355457393 wait complete. 2024-04-18T03:40:52.120 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:40:52.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 Processor -- start 2024-04-18T03:40:52.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 -- start start 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fecec0cc000 0x7fecec1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fecec15a690 0x7fecec06e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 0x7fecec0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0b3890 con 0x7fecec15a690 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0b40a0 con 0x7fecec0cc000 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec15ab10 con 0x7fecec0b2c80 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fecec15a690 0x7fecec06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fecec15a690 0x7fecec06e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34498/0 (socket says 172.21.15.157:34498) 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 -- 172.21.15.157:0/3710288111 learned_addr learned my addr 172.21.15.157:0/3710288111 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:52.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecebfff700 1 --2- 172.21.15.157:0/3710288111 >> v2:172.21.15.175:3300/0 conn(0x7fecec0cc000 0x7fecec1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf0bad700 1 --2- 172.21.15.157:0/3710288111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 0x7fecec0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 -- 172.21.15.157:0/3710288111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 msgr2=0x7fecec0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 --2- 172.21.15.157:0/3710288111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 0x7fecec0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 -- 172.21.15.157:0/3710288111 >> v2:172.21.15.175:3300/0 conn(0x7fecec0cc000 msgr2=0x7fecec1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 --2- 172.21.15.157:0/3710288111 >> v2:172.21.15.175:3300/0 conn(0x7fecec0cc000 0x7fecec1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 -- 172.21.15.157:0/3710288111 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0b3ae0 con 0x7fecec15a690 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceb7fe700 1 --2- 172.21.15.157:0/3710288111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec06e810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fecec06f1c0 tx=0x7fecd4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfa2a685a05831f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceaffd700 1 -- 172.21.15.157:0/3710288111 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011830 con 0x7fecec15a690 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceaffd700 1 -- 172.21.15.157:0/3710288111 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4011990 con 0x7fecec15a690 2024-04-18T03:40:52.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7feceaffd700 1 -- 172.21.15.157:0/3710288111 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011d20 con 0x7fecec15a690 2024-04-18T03:40:52.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 -- 172.21.15.157:0/3710288111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 msgr2=0x7fecec06e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:52.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.231+0000 7fecf13ae700 1 --2- 172.21.15.157:0/3710288111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec06e810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fecec06f1c0 tx=0x7fecd4009bf0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 -- 172.21.15.157:0/3710288111 shutdown_connections 2024-04-18T03:40:52.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 --2- 172.21.15.157:0/3710288111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 0x7fecec0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 --2- 172.21.15.157:0/3710288111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec06e810 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 --2- 172.21.15.157:0/3710288111 >> v2:172.21.15.175:3300/0 conn(0x7fecec0cc000 0x7fecec1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 -- 172.21.15.157:0/3710288111 >> 172.21.15.157:0/3710288111 conn(0x7fecec0b12d0 msgr2=0x7fecec06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:52.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 -- 172.21.15.157:0/3710288111 shutdown_connections 2024-04-18T03:40:52.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 -- 172.21.15.157:0/3710288111 wait complete. 2024-04-18T03:40:52.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 Processor -- start 2024-04-18T03:40:52.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 -- start start 2024-04-18T03:40:52.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 0x7fecec155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:52.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.235+0000 7fecf13ae700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecec0cc000 0x7fecec150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:52.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf13ae700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec0add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:52.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf13ae700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec140f90 con 0x7fecec15a690 2024-04-18T03:40:52.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf13ae700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec1400c0 con 0x7fecec0cc000 2024-04-18T03:40:52.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf13ae700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec140310 con 0x7fecec0b2c80 2024-04-18T03:40:52.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec0add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:52.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec0add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34514/0 (socket says 172.21.15.157:34514) 2024-04-18T03:40:52.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 -- 172.21.15.157:0/1081716790 learned_addr learned my addr 172.21.15.157:0/1081716790 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:52.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7feceb7fe700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecec0cc000 0x7fecec150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:52.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecebfff700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 0x7fecec155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:52.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 -- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 msgr2=0x7fecec155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:52.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 0x7fecec155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 -- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecec0cc000 msgr2=0x7fecec150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:52.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecec0cc000 0x7fecec150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 -- 172.21.15.157:0/1081716790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4009570 con 0x7fecec15a690 2024-04-18T03:40:52.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf0bad700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec0add60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00e780 tx=0x7fecdc00ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:52.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fece8ff9700 1 -- 172.21.15.157:0/1081716790 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc013680 con 0x7fecec15a690 2024-04-18T03:40:52.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fece8ff9700 1 -- 172.21.15.157:0/1081716790 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc0137e0 con 0x7fecec15a690 2024-04-18T03:40:52.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecec1405f0 con 0x7fecec15a690 2024-04-18T03:40:52.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fece8ff9700 1 -- 172.21.15.157:0/1081716790 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc013b70 con 0x7fecec15a690 2024-04-18T03:40:52.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec140bb0 con 0x7fecec15a690 2024-04-18T03:40:52.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.239+0000 7fece8ff9700 1 -- 172.21.15.157:0/1081716790 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fecdc013cd0 con 0x7fecec15a690 2024-04-18T03:40:52.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.243+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec04e650 con 0x7fecec15a690 2024-04-18T03:40:52.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.243+0000 7fece8ff9700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecd0066760 0x7fecd0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:52.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.243+0000 7fece8ff9700 1 -- 172.21.15.157:0/1081716790 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fecdc084300 con 0x7fecec15a690 2024-04-18T03:40:52.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.243+0000 7fecebfff700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecd0066760 0x7fecd0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:52.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.243+0000 7fecebfff700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecd0066760 0x7fecd0068c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecec0ae840 tx=0x7fece400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:52.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.247+0000 7fece8ff9700 1 -- 172.21.15.157:0/1081716790 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fecdc051230 con 0x7fecec15a690 2024-04-18T03:40:52.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.423+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fecec0b1f00 con 0x7fecec15a690 2024-04-18T03:40:52.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.423+0000 7fece8ff9700 1 -- 172.21.15.157:0/1081716790 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fecdc054850 con 0x7fecec15a690 2024-04-18T03:40:52.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecd0066760 msgr2=0x7fecd0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:52.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecd0066760 0x7fecd0068c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecec0ae840 tx=0x7fece400b040 comp rx=0 tx=0).stop 2024-04-18T03:40:52.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 msgr2=0x7fecec0add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:52.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec0add60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00e780 tx=0x7fecdc00ea90 comp rx=0 tx=0).stop 2024-04-18T03:40:52.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 shutdown_connections 2024-04-18T03:40:52.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fecd0066760 0x7fecd0068c20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecec0cc000 0x7fecec150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecec15a690 0x7fecec0add60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 --2- 172.21.15.157:0/1081716790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecec0b2c80 0x7fecec155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:52.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 >> 172.21.15.157:0/1081716790 conn(0x7fecec0b12d0 msgr2=0x7fecec0cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:52.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 shutdown_connections 2024-04-18T03:40:52.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:52.427+0000 7fecf13ae700 1 -- 172.21.15.157:0/1081716790 wait complete. 2024-04-18T03:40:52.430 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:40:52.441 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi157.front.sepia.ceph.com... 2024-04-18T03:40:52.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:40:52.442 DEBUG:teuthology.orchestra.run.smithi157:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-18T03:40:52.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi157.stderr:ceph-fuse[32743]: fuse finished with error 0 and tester_r 0 2024-04-18T03:40:52.457 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:40:58.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:40:58.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:40:58.559 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-18T03:40:58.566 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:40:58.567 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:40:58.572 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:40:58.572 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:40:58.624 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:40:58.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04effff700 1 Processor -- start 2024-04-18T03:40:58.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04effff700 1 -- start start 2024-04-18T03:40:58.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04effff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04f00afb20 0x7f04f00aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:58.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04effff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00cb560 0x7f04f00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:58.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04effff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f00ce7f0 con 0x7f04f015aef0 2024-04-18T03:40:58.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04effff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00b4330 con 0x7f04f00afb20 2024-04-18T03:40:58.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04effff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00b04d0 con 0x7f04f00cb560 2024-04-18T03:40:58.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04eeffd700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f04f015aef0 0x7f04f00b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47998/0 (socket says 172.21.15.157:47998) 2024-04-18T03:40:58.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04eeffd700 1 -- 172.21.15.157:0/531709608 learned_addr learned my addr 172.21.15.157:0/531709608 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:58.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04ef7fe700 1 --2- 172.21.15.157:0/531709608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00cb560 0x7f04f00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:58.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04ee7fc700 1 --2- 172.21.15.157:0/531709608 >> v2:172.21.15.175:3300/0 conn(0x7f04f00afb20 0x7f04f00aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:58.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04edffb700 1 -- 172.21.15.157:0/531709608 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626904881 0 0) 0x7f04f00ce7f0 con 0x7f04f015aef0 2024-04-18T03:40:58.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04edffb700 1 -- 172.21.15.157:0/531709608 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04dc0035d0 con 0x7f04f015aef0 2024-04-18T03:40:58.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04ef7fe700 1 -- 172.21.15.157:0/531709608 >> v2:172.21.15.175:3300/0 conn(0x7f04f00afb20 msgr2=0x7f04f00aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:58.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04ef7fe700 1 --2- 172.21.15.157:0/531709608 >> v2:172.21.15.175:3300/0 conn(0x7f04f00afb20 0x7f04f00aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04ef7fe700 1 -- 172.21.15.157:0/531709608 >> v1:172.21.15.157:6789/0 conn(0x7f04f015aef0 legacy=0x7f04f00b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:58.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04ef7fe700 1 -- 172.21.15.157:0/531709608 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00cea40 con 0x7f04f00cb560 2024-04-18T03:40:58.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04ef7fe700 1 --2- 172.21.15.157:0/531709608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00cb560 0x7f04f00cb9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04f00b4470 tx=0x7f04e0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf66b960e4910a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:58.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04edffb700 1 -- 172.21.15.157:0/531709608 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0004020 con 0x7f04f00cb560 2024-04-18T03:40:58.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04edffb700 1 -- 172.21.15.157:0/531709608 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0004180 con 0x7f04f00cb560 2024-04-18T03:40:58.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.743+0000 7f04edffb700 1 -- 172.21.15.157:0/531709608 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0004530 con 0x7f04f00cb560 2024-04-18T03:40:58.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 -- 172.21.15.157:0/531709608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00cb560 msgr2=0x7f04f00cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:58.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 --2- 172.21.15.157:0/531709608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00cb560 0x7f04f00cb9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04f00b4470 tx=0x7f04e0009b30 comp rx=0 tx=0).stop 2024-04-18T03:40:58.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 -- 172.21.15.157:0/531709608 shutdown_connections 2024-04-18T03:40:58.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 --2- 172.21.15.157:0/531709608 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00cb560 0x7f04f00cb9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 --2- 172.21.15.157:0/531709608 >> v2:172.21.15.175:3300/0 conn(0x7f04f00afb20 0x7f04f00aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 -- 172.21.15.157:0/531709608 >> 172.21.15.157:0/531709608 conn(0x7f04f00d0c20 msgr2=0x7f04f00d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:58.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 -- 172.21.15.157:0/531709608 shutdown_connections 2024-04-18T03:40:58.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 -- 172.21.15.157:0/531709608 wait complete. 2024-04-18T03:40:58.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 Processor -- start 2024-04-18T03:40:58.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.747+0000 7f04effff700 1 -- start start 2024-04-18T03:40:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04effff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00afb20 0x7f04f00b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04effff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f00cb560 0x7f04f00b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04effff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f015aef0 0x7f04f00b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:58.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04effff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00b1be0 con 0x7f04f00afb20 2024-04-18T03:40:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04effff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00b2000 con 0x7f04f00cb560 2024-04-18T03:40:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04effff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00b0f60 con 0x7f04f015aef0 2024-04-18T03:40:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00afb20 0x7f04f00b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00afb20 0x7f04f00b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34520/0 (socket says 172.21.15.157:34520) 2024-04-18T03:40:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 -- 172.21.15.157:0/2482113512 learned_addr learned my addr 172.21.15.157:0/2482113512 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04ef7fe700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f015aef0 0x7f04f00b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:58.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04ee7fc700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f00cb560 0x7f04f00b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 -- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f015aef0 msgr2=0x7f04f00b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f015aef0 0x7f04f00b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 -- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f00cb560 msgr2=0x7f04f00b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f00cb560 0x7f04f00b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 -- 172.21.15.157:0/2482113512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e00094b0 con 0x7f04f00afb20 2024-04-18T03:40:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04eeffd700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00afb20 0x7f04f00b0610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c4d0 tx=0x7f04d800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:58.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04e77fe700 1 -- 172.21.15.157:0/2482113512 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8005d90 con 0x7f04f00afb20 2024-04-18T03:40:58.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04e77fe700 1 -- 172.21.15.157:0/2482113512 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d80070d0 con 0x7f04f00afb20 2024-04-18T03:40:58.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f00b1240 con 0x7f04f00afb20 2024-04-18T03:40:58.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04e77fe700 1 -- 172.21.15.157:0/2482113512 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8007480 con 0x7f04f00afb20 2024-04-18T03:40:58.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.751+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f00b1800 con 0x7f04f00afb20 2024-04-18T03:40:58.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.755+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f004e650 con 0x7f04f00afb20 2024-04-18T03:40:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.755+0000 7f04e77fe700 1 -- 172.21.15.157:0/2482113512 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04d80075e0 con 0x7f04f00afb20 2024-04-18T03:40:58.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.755+0000 7f04e77fe700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d0066730 0x7f04d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:58.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.755+0000 7f04e77fe700 1 -- 172.21.15.157:0/2482113512 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f04d8083980 con 0x7f04f00afb20 2024-04-18T03:40:58.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.755+0000 7f04ee7fc700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d0066730 0x7f04d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:58.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.755+0000 7f04ee7fc700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d0066730 0x7f04d0068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f04f0067cb0 tx=0x7f04e800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:58.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.763+0000 7f04e77fe700 1 -- 172.21.15.157:0/2482113512 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f04d80508a0 con 0x7f04f00afb20 2024-04-18T03:40:58.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.927+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04f006ec40 con 0x7f04f00afb20 2024-04-18T03:40:58.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.931+0000 7f04e77fe700 1 -- 172.21.15.157:0/2482113512 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f04d8053ec0 con 0x7f04f00afb20 2024-04-18T03:40:58.936 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:40:58.936 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:40:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d0066730 msgr2=0x7f04d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d0066730 0x7f04d0068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f04f0067cb0 tx=0x7f04e800b040 comp rx=0 tx=0).stop 2024-04-18T03:40:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00afb20 msgr2=0x7f04f00b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00afb20 0x7f04f00b0610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c4d0 tx=0x7f04d800c7e0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 shutdown_connections 2024-04-18T03:40:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d0066730 0x7f04d0068bf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f00cb560 0x7f04f00b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f015aef0 0x7f04f00b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 --2- 172.21.15.157:0/2482113512 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f00afb20 0x7f04f00b0610 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 >> 172.21.15.157:0/2482113512 conn(0x7f04f00d0c20 msgr2=0x7f04f015d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 shutdown_connections 2024-04-18T03:40:58.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:58.935+0000 7f04effff700 1 -- 172.21.15.157:0/2482113512 wait complete. 2024-04-18T03:40:58.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:40:58.952 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:40:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b12140700 1 Processor -- start 2024-04-18T03:40:59.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b12140700 1 -- start start 2024-04-18T03:40:59.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b12140700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3b0c071080 0x7f3b0c071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b12140700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3b0c161660 0x7f3b0c06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b12140700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c0719a0 con 0x7f3b0c0b5f90 2024-04-18T03:40:59.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b12140700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c06a770 con 0x7f3b0c161660 2024-04-18T03:40:59.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b12140700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c06aa50 con 0x7f3b0c071080 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b1093d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3b0c161660 0x7f3b0c06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b1193f700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3b0c0b5f90 0x7f3b0c0b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:48008/0 (socket says 172.21.15.157:48008) 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.063+0000 7f3b1193f700 1 -- 172.21.15.157:0/577713338 learned_addr learned my addr 172.21.15.157:0/577713338 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b1113e700 1 --2- 172.21.15.157:0/577713338 >> v2:172.21.15.175:3300/0 conn(0x7f3b0c071080 0x7f3b0c071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b1093d700 1 -- 172.21.15.157:0/577713338 >> v2:172.21.15.175:3300/0 conn(0x7f3b0c071080 msgr2=0x7f3b0c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b1093d700 1 --2- 172.21.15.157:0/577713338 >> v2:172.21.15.175:3300/0 conn(0x7f3b0c071080 0x7f3b0c071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b1093d700 1 -- 172.21.15.157:0/577713338 >> v1:172.21.15.157:6789/0 conn(0x7f3b0c0b5f90 legacy=0x7f3b0c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b0bfff700 1 -- 172.21.15.157:0/577713338 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223730246 0 0) 0x7f3b0c0719a0 con 0x7f3b0c0b5f90 2024-04-18T03:40:59.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b1093d700 1 -- 172.21.15.157:0/577713338 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c06ad30 con 0x7f3b0c161660 2024-04-18T03:40:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b1093d700 1 --2- 172.21.15.157:0/577713338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c06c3a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0cff60 tx=0x7f3b00009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e968009b30633f5b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b0bfff700 1 -- 172.21.15.157:0/577713338 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00011830 con 0x7f3b0c161660 2024-04-18T03:40:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b0bfff700 1 -- 172.21.15.157:0/577713338 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00011990 con 0x7f3b0c161660 2024-04-18T03:40:59.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b0bfff700 1 -- 172.21.15.157:0/577713338 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00011d20 con 0x7f3b0c161660 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 -- 172.21.15.157:0/577713338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 msgr2=0x7f3b0c06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 --2- 172.21.15.157:0/577713338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c06c3a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0cff60 tx=0x7f3b00009b30 comp rx=0 tx=0).stop 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 -- 172.21.15.157:0/577713338 shutdown_connections 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 --2- 172.21.15.157:0/577713338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c06c3a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 --2- 172.21.15.157:0/577713338 >> v2:172.21.15.175:3300/0 conn(0x7f3b0c071080 0x7f3b0c071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 -- 172.21.15.157:0/577713338 >> 172.21.15.157:0/577713338 conn(0x7f3b0c06e020 msgr2=0x7f3b0c06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 -- 172.21.15.157:0/577713338 shutdown_connections 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 -- 172.21.15.157:0/577713338 wait complete. 2024-04-18T03:40:59.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 Processor -- start 2024-04-18T03:40:59.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.067+0000 7f3b12140700 1 -- start start 2024-04-18T03:40:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b0c071080 0x7f3b0c1e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c0b5f90 0x7f3b0c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1e90c0 con 0x7f3b0c161660 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1e82a0 con 0x7f3b0c0b5f90 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1e8540 con 0x7f3b0c071080 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34540/0 (socket says 172.21.15.157:34540) 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 -- 172.21.15.157:0/729725499 learned_addr learned my addr 172.21.15.157:0/729725499 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1113e700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b0c071080 0x7f3b0c1e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1093d700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c0b5f90 0x7f3b0c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 -- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b0c071080 msgr2=0x7f3b0c1e7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b0c071080 0x7f3b0c1e7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 -- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c0b5f90 msgr2=0x7f3b0c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c0b5f90 0x7f3b0c0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 -- 172.21.15.157:0/729725499 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000094b0 con 0x7f3b0c161660 2024-04-18T03:40:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1093d700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c0b5f90 0x7f3b0c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:40:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b1193f700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c157550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00cb60 tx=0x7f3afc00ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b09ffb700 1 -- 172.21.15.157:0/729725499 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00aaa0 con 0x7f3b0c161660 2024-04-18T03:40:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b09ffb700 1 -- 172.21.15.157:0/729725499 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc00ac00 con 0x7f3b0c161660 2024-04-18T03:40:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c1e8820 con 0x7f3b0c161660 2024-04-18T03:40:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b09ffb700 1 -- 172.21.15.157:0/729725499 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0070d0 con 0x7f3b0c161660 2024-04-18T03:40:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c1e8de0 con 0x7f3b0c161660 2024-04-18T03:40:59.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.071+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c04e650 con 0x7f3b0c161660 2024-04-18T03:40:59.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.075+0000 7f3b09ffb700 1 -- 172.21.15.157:0/729725499 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3afc007230 con 0x7f3b0c161660 2024-04-18T03:40:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.075+0000 7f3b09ffb700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3af8066730 0x7f3af8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.075+0000 7f3b09ffb700 1 -- 172.21.15.157:0/729725499 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3afc0841d0 con 0x7f3b0c161660 2024-04-18T03:40:59.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.075+0000 7f3b1113e700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3af8066730 0x7f3af8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.075+0000 7f3b1113e700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3af8066730 0x7f3af8068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c15d120 tx=0x7f3b04009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.083+0000 7f3b09ffb700 1 -- 172.21.15.157:0/729725499 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f3afc051210 con 0x7f3b0c161660 2024-04-18T03:40:59.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.251+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b0c06a550 con 0x7f3b0c161660 2024-04-18T03:40:59.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.251+0000 7f3b09ffb700 1 -- 172.21.15.157:0/729725499 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3afc054830 con 0x7f3b0c161660 2024-04-18T03:40:59.256 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3af8066730 msgr2=0x7f3af8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3af8066730 0x7f3af8068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c15d120 tx=0x7f3b04009240 comp rx=0 tx=0).stop 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 msgr2=0x7f3b0c157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c157550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00cb60 tx=0x7f3afc00ce70 comp rx=0 tx=0).stop 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 shutdown_connections 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3af8066730 0x7f3af8068bf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b0c0b5f90 0x7f3b0c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b0c161660 0x7f3b0c157550 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 --2- 172.21.15.157:0/729725499 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b0c071080 0x7f3b0c1e7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 >> 172.21.15.157:0/729725499 conn(0x7f3b0c06e020 msgr2=0x7f3b0c0d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 shutdown_connections 2024-04-18T03:40:59.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.255+0000 7f3b12140700 1 -- 172.21.15.157:0/729725499 wait complete. 2024-04-18T03:40:59.271 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:40:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.383+0000 7f83698e8700 1 Processor -- start 2024-04-18T03:40:59.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- start start 2024-04-18T03:40:59.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8364161660 0x7f836406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836406a770 con 0x7f8364071080 2024-04-18T03:40:59.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836406aa50 con 0x7f83640d12b0 2024-04-18T03:40:59.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836406ad30 con 0x7f8364161660 2024-04-18T03:40:59.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f8363fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8364161660 0x7f836406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83688e6700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8364071080 0x7f8364071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:48016/0 (socket says 172.21.15.157:48016) 2024-04-18T03:40:59.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83688e6700 1 -- 172.21.15.157:0/4234848390 learned_addr learned my addr 172.21.15.157:0/4234848390 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f8363fff700 1 -- 172.21.15.157:0/4234848390 >> v1:172.21.15.175:6789/0 conn(0x7f83640d12b0 legacy=0x7f83640d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83637fe700 1 -- 172.21.15.157:0/4234848390 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178064114 0 0) 0x7f836406a770 con 0x7f8364071080 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f8363fff700 1 -- 172.21.15.157:0/4234848390 >> v1:172.21.15.157:6789/0 conn(0x7f8364071080 legacy=0x7f8364071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f8363fff700 1 -- 172.21.15.157:0/4234848390 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836406b010 con 0x7f8364161660 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f8363fff700 1 --2- 172.21.15.157:0/4234848390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f836406c3a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f834c009850 tx=0x7f834c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98f94a79c96c2b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83637fe700 1 -- 172.21.15.157:0/4234848390 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c011830 con 0x7f8364161660 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83637fe700 1 -- 172.21.15.157:0/4234848390 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c011990 con 0x7f8364161660 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83637fe700 1 -- 172.21.15.157:0/4234848390 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c011d20 con 0x7f8364161660 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- 172.21.15.157:0/4234848390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 msgr2=0x7f836406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 --2- 172.21.15.157:0/4234848390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f836406c3a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f834c009850 tx=0x7f834c009b60 comp rx=0 tx=0).stop 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- 172.21.15.157:0/4234848390 shutdown_connections 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 --2- 172.21.15.157:0/4234848390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f836406c3a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- 172.21.15.157:0/4234848390 >> 172.21.15.157:0/4234848390 conn(0x7f836406e020 msgr2=0x7f836406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:59.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- 172.21.15.157:0/4234848390 shutdown_connections 2024-04-18T03:40:59.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.387+0000 7f83698e8700 1 -- 172.21.15.157:0/4234848390 wait complete. 2024-04-18T03:40:59.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83698e8700 1 Processor -- start 2024-04-18T03:40:59.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83698e8700 1 -- start start 2024-04-18T03:40:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83698e8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8364071080 0x7f836415de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83698e8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83640d12b0 0x7f8364156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83698e8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f83641e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83698e8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83641f2c30 con 0x7f8364161660 2024-04-18T03:40:59.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83698e8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836415efb0 con 0x7f83640d12b0 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83698e8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836415e710 con 0x7f8364071080 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83690e7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f83641e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83690e7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f83641e8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34560/0 (socket says 172.21.15.157:34560) 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83690e7700 1 -- 172.21.15.157:0/1849862145 learned_addr learned my addr 172.21.15.157:0/1849862145 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f83688e6700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8364071080 0x7f836415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.391+0000 7f8363fff700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83640d12b0 0x7f8364156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83690e7700 1 -- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8364071080 msgr2=0x7f836415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83690e7700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8364071080 0x7f836415de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83690e7700 1 -- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83640d12b0 msgr2=0x7f8364156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83690e7700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83640d12b0 0x7f8364156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83690e7700 1 -- 172.21.15.157:0/1849862145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0094b0 con 0x7f8364161660 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83690e7700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f83641e8320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f835c00cc50 tx=0x7f835c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83617fa700 1 -- 172.21.15.157:0/1849862145 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c003c20 con 0x7f8364161660 2024-04-18T03:40:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83617fa700 1 -- 172.21.15.157:0/1849862145 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c003d80 con 0x7f8364161660 2024-04-18T03:40:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836415e9f0 con 0x7f8364161660 2024-04-18T03:40:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83617fa700 1 -- 172.21.15.157:0/1849862145 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00aab0 con 0x7f8364161660 2024-04-18T03:40:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83641f2e10 con 0x7f8364161660 2024-04-18T03:40:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836404e650 con 0x7f8364161660 2024-04-18T03:40:59.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83617fa700 1 -- 172.21.15.157:0/1849862145 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f835c00ac10 con 0x7f8364161660 2024-04-18T03:40:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.395+0000 7f83617fa700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8344066730 0x7f8344068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.399+0000 7f83617fa700 1 -- 172.21.15.157:0/1849862145 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f835c084500 con 0x7f8364161660 2024-04-18T03:40:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.399+0000 7f83688e6700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8344066730 0x7f8344068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.399+0000 7f83688e6700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8344066730 0x7f8344068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8354007b30 tx=0x7f8354007a80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.407+0000 7f83617fa700 1 -- 172.21.15.157:0/1849862145 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f835c0514b0 con 0x7f8364161660 2024-04-18T03:40:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.575+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f836406a550 con 0x7f8364161660 2024-04-18T03:40:59.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.575+0000 7f83617fa700 1 -- 172.21.15.157:0/1849862145 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f835c054ad0 con 0x7f8364161660 2024-04-18T03:40:59.580 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:40:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8344066730 msgr2=0x7f8344068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8344066730 0x7f8344068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8354007b30 tx=0x7f8354007a80 comp rx=0 tx=0).stop 2024-04-18T03:40:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 msgr2=0x7f83641e8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f83641e8320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f835c00cc50 tx=0x7f835c00cf60 comp rx=0 tx=0).stop 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 shutdown_connections 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8344066730 0x7f8344068bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83640d12b0 0x7f8364156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8364161660 0x7f83641e8320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 --2- 172.21.15.157:0/1849862145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8364071080 0x7f836415de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 >> 172.21.15.157:0/1849862145 conn(0x7f836406e020 msgr2=0x7f8364159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 shutdown_connections 2024-04-18T03:40:59.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.579+0000 7f83698e8700 1 -- 172.21.15.157:0/1849862145 wait complete. 2024-04-18T03:40:59.594 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:40:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.707+0000 7f4f658a0700 1 Processor -- start 2024-04-18T03:40:59.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.707+0000 7f4f658a0700 1 -- start start 2024-04-18T03:40:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4f60161660 0x7f4f6006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6006a770 con 0x7f4f600d12b0 2024-04-18T03:40:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6006aa50 con 0x7f4f60071080 2024-04-18T03:40:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6006ad30 con 0x7f4f60161660 2024-04-18T03:40:59.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4f60161660 0x7f4f6006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4f60161660 0x7f4f6006c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34574/0 (socket says 172.21.15.157:34574) 2024-04-18T03:40:59.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5ffff700 1 -- 172.21.15.157:0/2832598867 learned_addr learned my addr 172.21.15.157:0/2832598867 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5ffff700 1 -- 172.21.15.157:0/2832598867 >> v1:172.21.15.175:6789/0 conn(0x7f4f60071080 legacy=0x7f4f60071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5ffff700 1 -- 172.21.15.157:0/2832598867 >> v1:172.21.15.157:6789/0 conn(0x7f4f600d12b0 legacy=0x7f4f600d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5ffff700 1 -- 172.21.15.157:0/2832598867 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6006b010 con 0x7f4f60161660 2024-04-18T03:40:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5ffff700 1 --2- 172.21.15.157:0/2832598867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60161660 0x7f4f6006c3a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009910 tx=0x7f4f48009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fc7db4dd50aade server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5f7fe700 1 -- 172.21.15.157:0/2832598867 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4800ba60 con 0x7f4f60161660 2024-04-18T03:40:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5f7fe700 1 -- 172.21.15.157:0/2832598867 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4800bbc0 con 0x7f4f60161660 2024-04-18T03:40:59.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f5f7fe700 1 -- 172.21.15.157:0/2832598867 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48009e60 con 0x7f4f60161660 2024-04-18T03:40:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 -- 172.21.15.157:0/2832598867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60161660 msgr2=0x7f4f6006c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 --2- 172.21.15.157:0/2832598867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60161660 0x7f4f6006c3a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009910 tx=0x7f4f48009c20 comp rx=0 tx=0).stop 2024-04-18T03:40:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 -- 172.21.15.157:0/2832598867 shutdown_connections 2024-04-18T03:40:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 --2- 172.21.15.157:0/2832598867 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60161660 0x7f4f6006c3a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 -- 172.21.15.157:0/2832598867 >> 172.21.15.157:0/2832598867 conn(0x7f4f6006e020 msgr2=0x7f4f6006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 -- 172.21.15.157:0/2832598867 shutdown_connections 2024-04-18T03:40:59.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.711+0000 7f4f658a0700 1 -- 172.21.15.157:0/2832598867 wait complete. 2024-04-18T03:40:59.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.715+0000 7f4f658a0700 1 Processor -- start 2024-04-18T03:40:59.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.715+0000 7f4f658a0700 1 -- start start 2024-04-18T03:40:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.715+0000 7f4f658a0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60071080 0x7f4f60157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.715+0000 7f4f658a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f600d12b0 0x7f4f601f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.715+0000 7f4f658a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f60161660 0x7f4f600c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.715+0000 7f4f658a0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6015f3e0 con 0x7f4f60071080 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.715+0000 7f4f658a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6015ea40 con 0x7f4f60161660 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.715+0000 7f4f658a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6015ed20 con 0x7f4f600d12b0 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60071080 0x7f4f60157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60071080 0x7f4f60157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34588/0 (socket says 172.21.15.157:34588) 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 -- 172.21.15.157:0/2153702927 learned_addr learned my addr 172.21.15.157:0/2153702927 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6509f700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f60161660 0x7f4f600c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f5ffff700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f600d12b0 0x7f4f601f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 -- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f600d12b0 msgr2=0x7f4f601f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f600d12b0 0x7f4f601f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 -- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f60161660 msgr2=0x7f4f600c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f60161660 0x7f4f600c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 -- 172.21.15.157:0/2153702927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48009570 con 0x7f4f60071080 2024-04-18T03:40:59.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f6489e700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60071080 0x7f4f60157290 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000c500 tx=0x7f4f5000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f5d7fa700 1 -- 172.21.15.157:0/2153702927 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500052d0 con 0x7f4f60071080 2024-04-18T03:40:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f5d7fa700 1 -- 172.21.15.157:0/2153702927 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f50005430 con 0x7f4f60071080 2024-04-18T03:40:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6015f000 con 0x7f4f60071080 2024-04-18T03:40:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f5d7fa700 1 -- 172.21.15.157:0/2153702927 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500055a0 con 0x7f4f60071080 2024-04-18T03:40:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f601f3450 con 0x7f4f60071080 2024-04-18T03:40:59.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.719+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6004e650 con 0x7f4f60071080 2024-04-18T03:40:59.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.723+0000 7f4f5d7fa700 1 -- 172.21.15.157:0/2153702927 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f500038e0 con 0x7f4f60071080 2024-04-18T03:40:59.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.723+0000 7f4f5d7fa700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4f44066730 0x7f4f44068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:40:59.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.723+0000 7f4f5d7fa700 1 -- 172.21.15.157:0/2153702927 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f500838b0 con 0x7f4f60071080 2024-04-18T03:40:59.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.723+0000 7f4f5ffff700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4f44066730 0x7f4f44068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:40:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.723+0000 7f4f5ffff700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4f44066730 0x7f4f44068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f48006f80 tx=0x7f4f48008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:40:59.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.731+0000 7f4f5d7fa700 1 -- 172.21.15.157:0/2153702927 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4f50050870 con 0x7f4f60071080 2024-04-18T03:40:59.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.895+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f600d1e20 con 0x7f4f60071080 2024-04-18T03:40:59.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.895+0000 7f4f5d7fa700 1 -- 172.21.15.157:0/2153702927 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f50053e90 con 0x7f4f60071080 2024-04-18T03:40:59.900 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4f44066730 msgr2=0x7f4f44068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4f44066730 0x7f4f44068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f48006f80 tx=0x7f4f48008030 comp rx=0 tx=0).stop 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60071080 msgr2=0x7f4f60157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60071080 0x7f4f60157290 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000c500 tx=0x7f4f5000c810 comp rx=0 tx=0).stop 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 shutdown_connections 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4f44066730 0x7f4f44068bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f60161660 0x7f4f600c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4f600d12b0 0x7f4f601f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 --2- 172.21.15.157:0/2153702927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f60071080 0x7f4f60157290 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:40:59.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 >> 172.21.15.157:0/2153702927 conn(0x7f4f6006e020 msgr2=0x7f4f600d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:40:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 shutdown_connections 2024-04-18T03:40:59.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:40:59.899+0000 7f4f658a0700 1 -- 172.21.15.157:0/2153702927 wait complete. 2024-04-18T03:40:59.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:41:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c2cc1700 1 Processor -- start 2024-04-18T03:41:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c2cc1700 1 -- start start 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c2cc1700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f65bc1427f0 0x7f65bc143010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c2cc1700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f65bc0b5f90 0x7f65bc0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c2cc1700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc15e3c0 con 0x7f65bc06e070 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c2cc1700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc15d5c0 con 0x7f65bc0b5f90 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c2cc1700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc15d7b0 con 0x7f65bc1427f0 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c1cbf700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f65bc06e070 0x7f65bc06e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:48022/0 (socket says 172.21.15.157:48022) 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c1cbf700 1 -- 172.21.15.157:0/287120240 learned_addr learned my addr 172.21.15.157:0/287120240 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.027+0000 7f65c24c0700 1 --2- 172.21.15.157:0/287120240 >> v2:172.21.15.157:3300/0 conn(0x7f65bc0b5f90 0x7f65bc0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c14be700 1 --2- 172.21.15.157:0/287120240 >> v2:172.21.15.175:3300/0 conn(0x7f65bc1427f0 0x7f65bc143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c0cbd700 1 -- 172.21.15.157:0/287120240 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472486087 0 0) 0x7f65bc15e3c0 con 0x7f65bc06e070 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c0cbd700 1 -- 172.21.15.157:0/287120240 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a80035d0 con 0x7f65bc06e070 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c24c0700 1 -- 172.21.15.157:0/287120240 >> v2:172.21.15.175:3300/0 conn(0x7f65bc1427f0 msgr2=0x7f65bc143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c24c0700 1 --2- 172.21.15.157:0/287120240 >> v2:172.21.15.175:3300/0 conn(0x7f65bc1427f0 0x7f65bc143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c24c0700 1 -- 172.21.15.157:0/287120240 >> v1:172.21.15.157:6789/0 conn(0x7f65bc06e070 legacy=0x7f65bc06e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c24c0700 1 -- 172.21.15.157:0/287120240 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc15da90 con 0x7f65bc0b5f90 2024-04-18T03:41:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c24c0700 1 --2- 172.21.15.157:0/287120240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0b5f90 0x7f65bc0b6420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0710e0 tx=0x7f65b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2209a902c905ce server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c0cbd700 1 -- 172.21.15.157:0/287120240 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400e070 con 0x7f65bc0b5f90 2024-04-18T03:41:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c0cbd700 1 -- 172.21.15.157:0/287120240 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400bb20 con 0x7f65bc0b5f90 2024-04-18T03:41:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c0cbd700 1 -- 172.21.15.157:0/287120240 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400be90 con 0x7f65bc0b5f90 2024-04-18T03:41:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c2cc1700 1 -- 172.21.15.157:0/287120240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0b5f90 msgr2=0x7f65bc0b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/287120240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0b5f90 0x7f65bc0b6420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0710e0 tx=0x7f65b400b330 comp rx=0 tx=0).stop 2024-04-18T03:41:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c2cc1700 1 -- 172.21.15.157:0/287120240 shutdown_connections 2024-04-18T03:41:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/287120240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0b5f90 0x7f65bc0b6420 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/287120240 >> v2:172.21.15.175:3300/0 conn(0x7f65bc1427f0 0x7f65bc143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c2cc1700 1 -- 172.21.15.157:0/287120240 >> 172.21.15.157:0/287120240 conn(0x7f65bc0d3240 msgr2=0x7f65bc0d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c2cc1700 1 -- 172.21.15.157:0/287120240 shutdown_connections 2024-04-18T03:41:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.031+0000 7f65c2cc1700 1 -- 172.21.15.157:0/287120240 wait complete. 2024-04-18T03:41:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 Processor -- start 2024-04-18T03:41:00.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 -- start start 2024-04-18T03:41:00.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc06e070 0x7f65bc156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65bc0b5f90 0x7f65bc0d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc1427f0 0x7f65bc0d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc158590 con 0x7f65bc06e070 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc13d700 con 0x7f65bc1427f0 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1587e0 con 0x7f65bc0b5f90 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc06e070 0x7f65bc156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc06e070 0x7f65bc156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34604/0 (socket says 172.21.15.157:34604) 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 -- 172.21.15.157:0/1451459839 learned_addr learned my addr 172.21.15.157:0/1451459839 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c14be700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65bc0b5f90 0x7f65bc0d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c24c0700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc1427f0 0x7f65bc0d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 -- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65bc0b5f90 msgr2=0x7f65bc0d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65bc0b5f90 0x7f65bc0d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 -- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc1427f0 msgr2=0x7f65bc0d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc1427f0 0x7f65bc0d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 -- 172.21.15.157:0/1451459839 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4009a70 con 0x7f65bc06e070 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c24c0700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc1427f0 0x7f65bc0d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c1cbf700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc06e070 0x7f65bc156300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c4d0 tx=0x7f65ac00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65b27fc700 1 -- 172.21.15.157:0/1451459839 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac005d90 con 0x7f65bc06e070 2024-04-18T03:41:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65b27fc700 1 -- 172.21.15.157:0/1451459839 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac0070d0 con 0x7f65bc06e070 2024-04-18T03:41:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc158ac0 con 0x7f65bc06e070 2024-04-18T03:41:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65b27fc700 1 -- 172.21.15.157:0/1451459839 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac007440 con 0x7f65bc06e070 2024-04-18T03:41:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.035+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc159080 con 0x7f65bc06e070 2024-04-18T03:41:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.039+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc04e650 con 0x7f65bc06e070 2024-04-18T03:41:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.039+0000 7f65b27fc700 1 -- 172.21.15.157:0/1451459839 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65ac0075a0 con 0x7f65bc06e070 2024-04-18T03:41:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.039+0000 7f65b27fc700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f65a0066730 0x7f65a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.039+0000 7f65b27fc700 1 -- 172.21.15.157:0/1451459839 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f65ac083760 con 0x7f65bc06e070 2024-04-18T03:41:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.039+0000 7f65c14be700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f65a0066730 0x7f65a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.039+0000 7f65c14be700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f65a0066730 0x7f65a0068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0d2350 tx=0x7f65b8009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.043+0000 7f65b27fc700 1 -- 172.21.15.157:0/1451459839 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f65ac050850 con 0x7f65bc06e070 2024-04-18T03:41:00.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.215+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f65bc143500 con 0x7f65bc06e070 2024-04-18T03:41:00.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65b27fc700 1 -- 172.21.15.157:0/1451459839 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f65ac017020 con 0x7f65bc06e070 2024-04-18T03:41:00.221 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f65a0066730 msgr2=0x7f65a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f65a0066730 0x7f65a0068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0d2350 tx=0x7f65b8009240 comp rx=0 tx=0).stop 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc06e070 msgr2=0x7f65bc156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc06e070 0x7f65bc156300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c4d0 tx=0x7f65ac00c7e0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 shutdown_connections 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f65a0066730 0x7f65a0068bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65bc1427f0 0x7f65bc0d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65bc0b5f90 0x7f65bc0d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 --2- 172.21.15.157:0/1451459839 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc06e070 0x7f65bc156300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 >> 172.21.15.157:0/1451459839 conn(0x7f65bc0d3240 msgr2=0x7f65bc140730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:00.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 shutdown_connections 2024-04-18T03:41:00.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.219+0000 7f65c2cc1700 1 -- 172.21.15.157:0/1451459839 wait complete. 2024-04-18T03:41:00.235 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:41:00.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.339+0000 7fc4458a0700 1 Processor -- start 2024-04-18T03:41:00.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.339+0000 7fc4458a0700 1 -- start start 2024-04-18T03:41:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc4400b4610 0x7fc44015b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc44015ba40 0x7fc44015c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44006a3a0 con 0x7fc440144580 2024-04-18T03:41:00.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44015c250 con 0x7fc4400b4610 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44006a660 con 0x7fc44015ba40 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43e7fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc4400b4610 0x7fc44015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43e7fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc4400b4610 0x7fc44015b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34610/0 (socket says 172.21.15.157:34610) 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43e7fc700 1 -- 172.21.15.157:0/1495036886 learned_addr learned my addr 172.21.15.157:0/1495036886 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43f7fe700 1 --2- 172.21.15.157:0/1495036886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc44015ba40 0x7fc44015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43e7fc700 1 -- 172.21.15.157:0/1495036886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc44015ba40 msgr2=0x7fc44015c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43e7fc700 1 --2- 172.21.15.157:0/1495036886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc44015ba40 0x7fc44015c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43e7fc700 1 -- 172.21.15.157:0/1495036886 >> v1:172.21.15.175:6789/0 conn(0x7fc440144580 legacy=0x7fc4400b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43e7fc700 1 -- 172.21.15.157:0/1495036886 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44006a940 con 0x7fc4400b4610 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43e7fc700 1 --2- 172.21.15.157:0/1495036886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc44015b500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc430009e50 tx=0x7fc43000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693f45a04cecb473 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43dffb700 1 -- 172.21.15.157:0/1495036886 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000e070 con 0x7fc4400b4610 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43dffb700 1 -- 172.21.15.157:0/1495036886 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43000b9c0 con 0x7fc4400b4610 2024-04-18T03:41:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc43dffb700 1 -- 172.21.15.157:0/1495036886 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000bd70 con 0x7fc4400b4610 2024-04-18T03:41:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 -- 172.21.15.157:0/1495036886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 msgr2=0x7fc44015b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 --2- 172.21.15.157:0/1495036886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc44015b500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc430009e50 tx=0x7fc43000b330 comp rx=0 tx=0).stop 2024-04-18T03:41:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 -- 172.21.15.157:0/1495036886 shutdown_connections 2024-04-18T03:41:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 --2- 172.21.15.157:0/1495036886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc44015ba40 0x7fc44015c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 --2- 172.21.15.157:0/1495036886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc44015b500 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 -- 172.21.15.157:0/1495036886 >> 172.21.15.157:0/1495036886 conn(0x7fc44006f0f0 msgr2=0x7fc440070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 -- 172.21.15.157:0/1495036886 shutdown_connections 2024-04-18T03:41:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.343+0000 7fc4458a0700 1 -- 172.21.15.157:0/1495036886 wait complete. 2024-04-18T03:41:00.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc4458a0700 1 Processor -- start 2024-04-18T03:41:00.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc4458a0700 1 -- start start 2024-04-18T03:41:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc4458a0700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc4400b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc4458a0700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc440144580 0x7fc4401f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc4458a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44015ba40 0x7fc44013e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc4458a0700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400b2ee0 con 0x7fc4400b4610 2024-04-18T03:41:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc4458a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400b3840 con 0x7fc44015ba40 2024-04-18T03:41:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc4458a0700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4400b2260 con 0x7fc440144580 2024-04-18T03:41:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc4400b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc4400b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34618/0 (socket says 172.21.15.157:34618) 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 -- 172.21.15.157:0/871571764 learned_addr learned my addr 172.21.15.157:0/871571764 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43e7fc700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc440144580 0x7fc4401f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43f7fe700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44015ba40 0x7fc44013e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 -- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc440144580 msgr2=0x7fc4401f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc440144580 0x7fc4401f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 -- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44015ba40 msgr2=0x7fc44013e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44015ba40 0x7fc44013e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 -- 172.21.15.157:0/871571764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430009b30 con 0x7fc4400b4610 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43e7fc700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc440144580 0x7fc4401f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc43effd700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc4400b3300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c4e0 tx=0x7fc42800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc437fff700 1 -- 172.21.15.157:0/871571764 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4280052d0 con 0x7fc4400b4610 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.347+0000 7fc437fff700 1 -- 172.21.15.157:0/871571764 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc428005430 con 0x7fc4400b4610 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44015c020 con 0x7fc4400b4610 2024-04-18T03:41:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc437fff700 1 -- 172.21.15.157:0/871571764 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4280055a0 con 0x7fc4400b4610 2024-04-18T03:41:00.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4400b2820 con 0x7fc4400b4610 2024-04-18T03:41:00.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44004e6c0 con 0x7fc4400b4610 2024-04-18T03:41:00.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc437fff700 1 -- 172.21.15.157:0/871571764 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc428003900 con 0x7fc4400b4610 2024-04-18T03:41:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc437fff700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc420066730 0x7fc420068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc437fff700 1 -- 172.21.15.157:0/871571764 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc4280838a0 con 0x7fc4400b4610 2024-04-18T03:41:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc43e7fc700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc420066730 0x7fc420068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.351+0000 7fc43e7fc700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc420066730 0x7fc420068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc43000b370 tx=0x7fc430009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.359+0000 7fc437fff700 1 -- 172.21.15.157:0/871571764 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc4280508e0 con 0x7fc4400b4610 2024-04-18T03:41:00.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4400cbbe0 con 0x7fc4400b4610 2024-04-18T03:41:00.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc437fff700 1 -- 172.21.15.157:0/871571764 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc428053f00 con 0x7fc4400b4610 2024-04-18T03:41:00.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc420066730 msgr2=0x7fc420068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc420066730 0x7fc420068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc43000b370 tx=0x7fc430009000 comp rx=0 tx=0).stop 2024-04-18T03:41:00.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 msgr2=0x7fc4400b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc4400b3300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c4e0 tx=0x7fc42800c7f0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 shutdown_connections 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc420066730 0x7fc420068bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc44015ba40 0x7fc44013e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc440144580 0x7fc4401f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 --2- 172.21.15.157:0/871571764 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4400b4610 0x7fc4400b3300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 >> 172.21.15.157:0/871571764 conn(0x7fc44006f0f0 msgr2=0x7fc4400b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 shutdown_connections 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.543+0000 7fc4458a0700 1 -- 172.21.15.157:0/871571764 wait complete. 2024-04-18T03:41:00.549 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:41:00.560 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-18T03:41:00.560 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:41:00.568 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:41:00.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2e2ef700 1 Processor -- start 2024-04-18T03:41:00.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2e2ef700 1 -- start start 2024-04-18T03:41:00.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2e2ef700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c280cdd20 0x7f0c280ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2e2ef700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0c2806e810 0x7f0c2806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2e2ef700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c280b1c20 con 0x7f0c2814a360 2024-04-18T03:41:00.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2e2ef700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c280b25c0 con 0x7f0c280cdd20 2024-04-18T03:41:00.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2e2ef700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c281621f0 con 0x7f0c2806e810 2024-04-18T03:41:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2caec700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c280cdd20 0x7f0c280ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2caec700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0c280cdd20 0x7f0c280ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34622/0 (socket says 172.21.15.157:34622) 2024-04-18T03:41:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2caec700 1 -- 172.21.15.157:0/2734701655 learned_addr learned my addr 172.21.15.157:0/2734701655 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2daee700 1 --2- 172.21.15.157:0/2734701655 >> v2:172.21.15.175:3300/0 conn(0x7f0c2806e810 0x7f0c2806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2caec700 1 -- 172.21.15.157:0/2734701655 >> v2:172.21.15.175:3300/0 conn(0x7f0c2806e810 msgr2=0x7f0c2806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2caec700 1 --2- 172.21.15.157:0/2734701655 >> v2:172.21.15.175:3300/0 conn(0x7f0c2806e810 0x7f0c2806ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2caec700 1 -- 172.21.15.157:0/2734701655 >> v1:172.21.15.175:6789/0 conn(0x7f0c2814a360 legacy=0x7f0c28161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2caec700 1 -- 172.21.15.157:0/2734701655 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280b1f00 con 0x7f0c280cdd20 2024-04-18T03:41:00.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.679+0000 7f0c2caec700 1 --2- 172.21.15.157:0/2734701655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c280cdd20 0x7f0c280ce1b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0c28071a00 tx=0x7f0c18009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2de40bd6f980c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c1ffff700 1 -- 172.21.15.157:0/2734701655 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18011830 con 0x7f0c280cdd20 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c1ffff700 1 -- 172.21.15.157:0/2734701655 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c18011990 con 0x7f0c280cdd20 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c1ffff700 1 -- 172.21.15.157:0/2734701655 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18011d20 con 0x7f0c280cdd20 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/2734701655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c280cdd20 msgr2=0x7f0c280ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/2734701655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c280cdd20 0x7f0c280ce1b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0c28071a00 tx=0x7f0c18009bf0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/2734701655 shutdown_connections 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/2734701655 >> v2:172.21.15.175:3300/0 conn(0x7f0c2806e810 0x7f0c2806ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/2734701655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c280cdd20 0x7f0c280ce1b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/2734701655 >> 172.21.15.157:0/2734701655 conn(0x7f0c280b1330 msgr2=0x7f0c2806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/2734701655 shutdown_connections 2024-04-18T03:41:00.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/2734701655 wait complete. 2024-04-18T03:41:00.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 Processor -- start 2024-04-18T03:41:00.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.683+0000 7f0c2e2ef700 1 -- start start 2024-04-18T03:41:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2806e810 0x7f0c28160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c280cdd20 0x7f0c28144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2814a360 0x7f0c281356d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28160940 con 0x7f0c2806e810 2024-04-18T03:41:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28139480 con 0x7f0c2814a360 2024-04-18T03:41:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28136280 con 0x7f0c280cdd20 2024-04-18T03:41:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2806e810 0x7f0c28160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2806e810 0x7f0c28160400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34632/0 (socket says 172.21.15.157:34632) 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2caec700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c280cdd20 0x7f0c28144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 -- 172.21.15.157:0/3339532697 learned_addr learned my addr 172.21.15.157:0/3339532697 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2daee700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2814a360 0x7f0c281356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 -- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c280cdd20 msgr2=0x7f0c28144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c280cdd20 0x7f0c28144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 -- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2814a360 msgr2=0x7f0c281356d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2814a360 0x7f0c281356d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 -- 172.21.15.157:0/3339532697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c18009570 con 0x7f0c2806e810 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2daee700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2814a360 0x7f0c281356d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2d2ed700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2806e810 0x7f0c28160400 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0c20001ed0 tx=0x7f0c200021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3339532697 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20003c20 con 0x7f0c2806e810 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3339532697 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c20003d80 con 0x7f0c2806e810 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28136560 con 0x7f0c2806e810 2024-04-18T03:41:00.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3339532697 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2000abf0 con 0x7f0c2806e810 2024-04-18T03:41:00.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2815fc00 con 0x7f0c2806e810 2024-04-18T03:41:00.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.687+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2804e650 con 0x7f0c2806e810 2024-04-18T03:41:00.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.691+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3339532697 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c2000ad50 con 0x7f0c2806e810 2024-04-18T03:41:00.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.691+0000 7f0c1dffb700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0c0c066730 0x7f0c0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.691+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3339532697 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0c20084630 con 0x7f0c2806e810 2024-04-18T03:41:00.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.691+0000 7f0c2caec700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0c0c066730 0x7f0c0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.691+0000 7f0c2caec700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0c0c066730 0x7f0c0c068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c18000c00 tx=0x7f0c18008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.699+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3339532697 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0c200515e0 con 0x7f0c2806e810 2024-04-18T03:41:00.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.855+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c281451a0 con 0x7f0c2806e810 2024-04-18T03:41:00.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c1dffb700 1 -- 172.21.15.157:0/3339532697 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f0c20054c00 con 0x7f0c2806e810 2024-04-18T03:41:00.861 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:00.862 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:41:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0c0c066730 msgr2=0x7f0c0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0c0c066730 0x7f0c0c068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c18000c00 tx=0x7f0c18008030 comp rx=0 tx=0).stop 2024-04-18T03:41:00.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2806e810 msgr2=0x7f0c28160400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2806e810 0x7f0c28160400 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0c20001ed0 tx=0x7f0c200021e0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 shutdown_connections 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0c0c066730 0x7f0c0c068bf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c2814a360 0x7f0c281356d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c280cdd20 0x7f0c28144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 --2- 172.21.15.157:0/3339532697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c2806e810 0x7f0c28160400 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 >> 172.21.15.157:0/3339532697 conn(0x7f0c280b1330 msgr2=0x7f0c28070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 shutdown_connections 2024-04-18T03:41:00.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.859+0000 7f0c2e2ef700 1 -- 172.21.15.157:0/3339532697 wait complete. 2024-04-18T03:41:00.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:41:00.877 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:41:00.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec88bd700 1 Processor -- start 2024-04-18T03:41:00.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec88bd700 1 -- start start 2024-04-18T03:41:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec88bd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ec4161660 0x7f4ec406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec88bd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4ec40d12b0 0x7f4ec40d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec88bd700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec406a770 con 0x7f4ec4071080 2024-04-18T03:41:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec88bd700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec406aa50 con 0x7f4ec40d12b0 2024-04-18T03:41:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec88bd700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec406ad30 con 0x7f4ec4161660 2024-04-18T03:41:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec359e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4ec40d12b0 0x7f4ec40d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec259c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ec4161660 0x7f4ec406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec359e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4ec40d12b0 0x7f4ec40d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34640/0 (socket says 172.21.15.157:34640) 2024-04-18T03:41:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec359e700 1 -- 172.21.15.157:0/1622186279 learned_addr learned my addr 172.21.15.157:0/1622186279 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec359e700 1 -- 172.21.15.157:0/1622186279 >> v2:172.21.15.175:3300/0 conn(0x7f4ec4161660 msgr2=0x7f4ec406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec359e700 1 --2- 172.21.15.157:0/1622186279 >> v2:172.21.15.175:3300/0 conn(0x7f4ec4161660 0x7f4ec406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec359e700 1 -- 172.21.15.157:0/1622186279 >> v1:172.21.15.175:6789/0 conn(0x7f4ec4071080 legacy=0x7f4ec4071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.991+0000 7f4ec359e700 1 -- 172.21.15.157:0/1622186279 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec406b010 con 0x7f4ec40d12b0 2024-04-18T03:41:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec359e700 1 --2- 172.21.15.157:0/1622186279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec40d12b0 0x7f4ec40d1740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40b7670 tx=0x7f4ebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35d54397b1679e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec1d9b700 1 -- 172.21.15.157:0/1622186279 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00e070 con 0x7f4ec40d12b0 2024-04-18T03:41:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec1d9b700 1 -- 172.21.15.157:0/1622186279 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc00b910 con 0x7f4ec40d12b0 2024-04-18T03:41:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec1d9b700 1 -- 172.21.15.157:0/1622186279 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00bcc0 con 0x7f4ec40d12b0 2024-04-18T03:41:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1622186279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec40d12b0 msgr2=0x7f4ec40d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1622186279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec40d12b0 0x7f4ec40d1740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40b7670 tx=0x7f4ebc00b330 comp rx=0 tx=0).stop 2024-04-18T03:41:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1622186279 shutdown_connections 2024-04-18T03:41:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1622186279 >> v2:172.21.15.175:3300/0 conn(0x7f4ec4161660 0x7f4ec406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1622186279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec40d12b0 0x7f4ec40d1740 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1622186279 >> 172.21.15.157:0/1622186279 conn(0x7f4ec406e020 msgr2=0x7f4ec406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1622186279 shutdown_connections 2024-04-18T03:41:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.995+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1622186279 wait complete. 2024-04-18T03:41:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 Processor -- start 2024-04-18T03:41:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 -- start start 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec4071080 0x7f4ec41e8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ec40d12b0 0x7f4ec4156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4161660 0x7f4ec415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41e8e00 con 0x7f4ec4071080 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41e90e0 con 0x7f4ec4161660 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41e93c0 con 0x7f4ec40d12b0 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec4071080 0x7f4ec41e8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec4071080 0x7f4ec41e8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34642/0 (socket says 172.21.15.157:34642) 2024-04-18T03:41:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 -- 172.21.15.157:0/1535278598 learned_addr learned my addr 172.21.15.157:0/1535278598 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec259c700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ec40d12b0 0x7f4ec4156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec359e700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4161660 0x7f4ec415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 -- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ec40d12b0 msgr2=0x7f4ec4156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ec40d12b0 0x7f4ec4156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 -- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4161660 msgr2=0x7f4ec415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4161660 0x7f4ec415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 -- 172.21.15.157:0/1535278598 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc009b30 con 0x7f4ec4071080 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec2d9d700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec4071080 0x7f4ec41e8820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400c500 tx=0x7f4eb400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ebb7fe700 1 -- 172.21.15.157:0/1535278598 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40052d0 con 0x7f4ec4071080 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ebb7fe700 1 -- 172.21.15.157:0/1535278598 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb4005430 con 0x7f4ec4071080 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ebb7fe700 1 -- 172.21.15.157:0/1535278598 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40055a0 con 0x7f4ec4071080 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec41e96a0 con 0x7f4ec4071080 2024-04-18T03:41:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:00.999+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec4157a00 con 0x7f4ec4071080 2024-04-18T03:41:01.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.003+0000 7f4ebb7fe700 1 -- 172.21.15.157:0/1535278598 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4eb40038e0 con 0x7f4ec4071080 2024-04-18T03:41:01.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.003+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec40c8140 con 0x7f4ec4071080 2024-04-18T03:41:01.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.003+0000 7f4ebb7fe700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4ea4066730 0x7f4ea4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.003+0000 7f4ebb7fe700 1 -- 172.21.15.157:0/1535278598 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4eb4083970 con 0x7f4ec4071080 2024-04-18T03:41:01.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.003+0000 7f4ec259c700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4ea4066730 0x7f4ea4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.003+0000 7f4ec259c700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4ea4066730 0x7f4ea4068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009b50 tx=0x7f4eac009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.011+0000 7f4ebb7fe700 1 -- 172.21.15.157:0/1535278598 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4ec40c8140 con 0x7f4ec4071080 2024-04-18T03:41:01.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.175+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ec40c8140 con 0x7f4ec4071080 2024-04-18T03:41:01.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.175+0000 7f4ebb7fe700 1 -- 172.21.15.157:0/1535278598 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ec40c8140 con 0x7f4ec4071080 2024-04-18T03:41:01.180 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:41:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4ea4066730 msgr2=0x7f4ea4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4ea4066730 0x7f4ea4068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009b50 tx=0x7f4eac009240 comp rx=0 tx=0).stop 2024-04-18T03:41:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec4071080 msgr2=0x7f4ec41e8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec4071080 0x7f4ec41e8820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400c500 tx=0x7f4eb400c810 comp rx=0 tx=0).stop 2024-04-18T03:41:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 shutdown_connections 2024-04-18T03:41:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4ea4066730 0x7f4ea4068bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ec4161660 0x7f4ec415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ec40d12b0 0x7f4ec4156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 --2- 172.21.15.157:0/1535278598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ec4071080 0x7f4ec41e8820 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 >> 172.21.15.157:0/1535278598 conn(0x7f4ec406e020 msgr2=0x7f4ec40b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 shutdown_connections 2024-04-18T03:41:01.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.179+0000 7f4ec88bd700 1 -- 172.21.15.157:0/1535278598 wait complete. 2024-04-18T03:41:01.195 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:41:01.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45680f700 1 Processor -- start 2024-04-18T03:41:01.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45680f700 1 -- start start 2024-04-18T03:41:01.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45680f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe45013ff90 0x7fe45015df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45680f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4501425f0 con 0x7fe45015d680 2024-04-18T03:41:01.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45680f700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45015e440 con 0x7fe450071790 2024-04-18T03:41:01.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45680f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe450142890 con 0x7fe45013ff90 2024-04-18T03:41:01.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45500c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe45015d680 0x7fe450071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:48032/0 (socket says 172.21.15.157:48032) 2024-04-18T03:41:01.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45500c700 1 -- 172.21.15.157:0/3319758446 learned_addr learned my addr 172.21.15.157:0/3319758446 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:01.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.315+0000 7fe45580d700 1 --2- 172.21.15.157:0/3319758446 >> v2:172.21.15.175:3300/0 conn(0x7fe45013ff90 0x7fe45015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45480b700 1 -- 172.21.15.157:0/3319758446 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404568591 0 0) 0x7fe4501425f0 con 0x7fe45015d680 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45480b700 1 -- 172.21.15.157:0/3319758446 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe43c0035d0 con 0x7fe45015d680 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45580d700 1 -- 172.21.15.157:0/3319758446 >> v1:172.21.15.175:6789/0 conn(0x7fe450071790 legacy=0x7fe4500d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45580d700 1 -- 172.21.15.157:0/3319758446 >> v1:172.21.15.157:6789/0 conn(0x7fe45015d680 legacy=0x7fe450071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45480b700 1 -- 172.21.15.157:0/3319758446 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2214517810 0 0) 0x7fe43c0035d0 con 0x7fe45015d680 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45580d700 1 -- 172.21.15.157:0/3319758446 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450142b70 con 0x7fe45013ff90 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45580d700 1 --2- 172.21.15.157:0/3319758446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45013ff90 0x7fe45015df00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009850 tx=0x7fe44c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49cfe6d2b99c08 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45480b700 1 -- 172.21.15.157:0/3319758446 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440001670 con 0x7fe45013ff90 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45480b700 1 -- 172.21.15.157:0/3319758446 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c004030 con 0x7fe45013ff90 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45480b700 1 -- 172.21.15.157:0/3319758446 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0043a0 con 0x7fe45013ff90 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 -- 172.21.15.157:0/3319758446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45013ff90 msgr2=0x7fe45015df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 --2- 172.21.15.157:0/3319758446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45013ff90 0x7fe45015df00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009850 tx=0x7fe44c009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 -- 172.21.15.157:0/3319758446 shutdown_connections 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 --2- 172.21.15.157:0/3319758446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45013ff90 0x7fe45015df00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 -- 172.21.15.157:0/3319758446 >> 172.21.15.157:0/3319758446 conn(0x7fe45006e2e0 msgr2=0x7fe45006e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:01.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 -- 172.21.15.157:0/3319758446 shutdown_connections 2024-04-18T03:41:01.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 -- 172.21.15.157:0/3319758446 wait complete. 2024-04-18T03:41:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 Processor -- start 2024-04-18T03:41:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 -- start start 2024-04-18T03:41:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe450071790 0x7fe4501f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe45013ff90 0x7fe4501413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45015d680 0x7fe450141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45013c2c0 con 0x7fe45013ff90 2024-04-18T03:41:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.319+0000 7fe45680f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe450157e90 con 0x7fe45015d680 2024-04-18T03:41:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45680f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4501f3ed0 con 0x7fe450071790 2024-04-18T03:41:01.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe45013ff90 0x7fe4501413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe45013ff90 0x7fe4501413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34650/0 (socket says 172.21.15.157:34650) 2024-04-18T03:41:01.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 -- 172.21.15.157:0/3334686154 learned_addr learned my addr 172.21.15.157:0/3334686154 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:01.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45580d700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe450071790 0x7fe4501f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45600e700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45015d680 0x7fe450141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 -- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe450071790 msgr2=0x7fe4501f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe450071790 0x7fe4501f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 -- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45015d680 msgr2=0x7fe450141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45015d680 0x7fe450141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 -- 172.21.15.157:0/3334686154 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c0094b0 con 0x7fe45013ff90 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45500c700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe45013ff90 0x7fe4501413c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe44000c520 tx=0x7fe44000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe4467fc700 1 -- 172.21.15.157:0/3334686154 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440004ca0 con 0x7fe45013ff90 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe4467fc700 1 -- 172.21.15.157:0/3334686154 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe440004e00 con 0x7fe45013ff90 2024-04-18T03:41:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe450157b40 con 0x7fe45013ff90 2024-04-18T03:41:01.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe4467fc700 1 -- 172.21.15.157:0/3334686154 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440007310 con 0x7fe45013ff90 2024-04-18T03:41:01.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4501f3390 con 0x7fe45013ff90 2024-04-18T03:41:01.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe450158020 con 0x7fe45013ff90 2024-04-18T03:41:01.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.323+0000 7fe4467fc700 1 -- 172.21.15.157:0/3334686154 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe440007470 con 0x7fe45013ff90 2024-04-18T03:41:01.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.327+0000 7fe4467fc700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe434066730 0x7fe434068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.327+0000 7fe4467fc700 1 -- 172.21.15.157:0/3334686154 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe440084170 con 0x7fe45013ff90 2024-04-18T03:41:01.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.327+0000 7fe45580d700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe434066730 0x7fe434068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.327+0000 7fe45580d700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe434066730 0x7fe434068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0090b0 tx=0x7fe44c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.335+0000 7fe4467fc700 1 -- 172.21.15.157:0/3334686154 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe440051120 con 0x7fe45013ff90 2024-04-18T03:41:01.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe450154010 con 0x7fe45013ff90 2024-04-18T03:41:01.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe4467fc700 1 -- 172.21.15.157:0/3334686154 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe440007720 con 0x7fe45013ff90 2024-04-18T03:41:01.502 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe434066730 msgr2=0x7fe434068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe434066730 0x7fe434068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0090b0 tx=0x7fe44c008030 comp rx=0 tx=0).stop 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe45013ff90 msgr2=0x7fe4501413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe45013ff90 0x7fe4501413c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe44000c520 tx=0x7fe44000c830 comp rx=0 tx=0).stop 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 shutdown_connections 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe434066730 0x7fe434068bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45015d680 0x7fe450141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe45013ff90 0x7fe4501413c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 --2- 172.21.15.157:0/3334686154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe450071790 0x7fe4501f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 >> 172.21.15.157:0/3334686154 conn(0x7fe45006e2e0 msgr2=0x7fe4500d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 shutdown_connections 2024-04-18T03:41:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.499+0000 7fe45680f700 1 -- 172.21.15.157:0/3334686154 wait complete. 2024-04-18T03:41:01.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:41:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.631+0000 7f26d359e700 1 Processor -- start 2024-04-18T03:41:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.631+0000 7f26d359e700 1 -- start start 2024-04-18T03:41:01.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f26cc0e0250 0x7f26cc0e4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc0e49a0 con 0x7f26cc006150 2024-04-18T03:41:01.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0540b0 con 0x7f26cc0e0250 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0532f0 con 0x7f26cc0e3b40 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d1d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f26cc0e0250 0x7f26cc0e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d1d9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f26cc0e0250 0x7f26cc0e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34660/0 (socket says 172.21.15.157:34660) 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d1d9b700 1 -- 172.21.15.157:0/2826826443 learned_addr learned my addr 172.21.15.157:0/2826826443 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d259c700 1 --2- 172.21.15.157:0/2826826443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d1d9b700 1 -- 172.21.15.157:0/2826826443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 msgr2=0x7f26cc0e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d1d9b700 1 --2- 172.21.15.157:0/2826826443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d1d9b700 1 -- 172.21.15.157:0/2826826443 >> v1:172.21.15.175:6789/0 conn(0x7f26cc006150 legacy=0x7f26cc038ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d1d9b700 1 -- 172.21.15.157:0/2826826443 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0535d0 con 0x7f26cc0e0250 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d259c700 1 --2- 172.21.15.157:0/2826826443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d1d9b700 1 --2- 172.21.15.157:0/2826826443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc0e0250 0x7f26cc0e4460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009910 tx=0x7f26c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cbd51638f6d990 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d159a700 1 -- 172.21.15.157:0/2826826443 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400ba60 con 0x7f26cc0e0250 2024-04-18T03:41:01.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d159a700 1 -- 172.21.15.157:0/2826826443 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c400bbc0 con 0x7f26cc0e0250 2024-04-18T03:41:01.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d159a700 1 -- 172.21.15.157:0/2826826443 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c4009e60 con 0x7f26cc0e0250 2024-04-18T03:41:01.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 -- 172.21.15.157:0/2826826443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc0e0250 msgr2=0x7f26cc0e4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 --2- 172.21.15.157:0/2826826443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc0e0250 0x7f26cc0e4460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009910 tx=0x7f26c4009c20 comp rx=0 tx=0).stop 2024-04-18T03:41:01.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 -- 172.21.15.157:0/2826826443 shutdown_connections 2024-04-18T03:41:01.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 --2- 172.21.15.157:0/2826826443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc0e0250 0x7f26cc0e4460 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 --2- 172.21.15.157:0/2826826443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 -- 172.21.15.157:0/2826826443 >> 172.21.15.157:0/2826826443 conn(0x7f26cc054b70 msgr2=0x7f26cc054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:01.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 -- 172.21.15.157:0/2826826443 shutdown_connections 2024-04-18T03:41:01.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.635+0000 7f26d359e700 1 -- 172.21.15.157:0/2826826443 wait complete. 2024-04-18T03:41:01.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d359e700 1 Processor -- start 2024-04-18T03:41:01.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d359e700 1 -- start start 2024-04-18T03:41:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc006150 0x7f26cc04af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0d2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26cc0e40e0 0x7f26cc0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc04e9a0 con 0x7f26cc006150 2024-04-18T03:41:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc04dd20 con 0x7f26cc0e40e0 2024-04-18T03:41:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc04e000 con 0x7f26cc0e3b40 2024-04-18T03:41:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.639+0000 7f26d259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc006150 0x7f26cc04af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d259c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc006150 0x7f26cc04af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34674/0 (socket says 172.21.15.157:34674) 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d259c700 1 -- 172.21.15.157:0/2116643132 learned_addr learned my addr 172.21.15.157:0/2116643132 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d1d9b700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d2d9d700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26cc0e40e0 0x7f26cc0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d259c700 1 -- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 msgr2=0x7f26cc0d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d259c700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d259c700 1 -- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26cc0e40e0 msgr2=0x7f26cc0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d259c700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26cc0e40e0 0x7f26cc0d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d259c700 1 -- 172.21.15.157:0/2116643132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c4009570 con 0x7f26cc006150 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d259c700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc006150 0x7f26cc04af00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f26c800e760 tx=0x7f26c800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26c2ffd700 1 -- 172.21.15.157:0/2116643132 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c800c070 con 0x7f26cc006150 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26c2ffd700 1 -- 172.21.15.157:0/2116643132 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c8004250 con 0x7f26cc006150 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc04e2e0 con 0x7f26cc006150 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26c2ffd700 1 -- 172.21.15.157:0/2116643132 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c80036c0 con 0x7f26cc006150 2024-04-18T03:41:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc04b440 con 0x7f26cc006150 2024-04-18T03:41:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.643+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc005440 con 0x7f26cc006150 2024-04-18T03:41:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.647+0000 7f26c2ffd700 1 -- 172.21.15.157:0/2116643132 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26c8003820 con 0x7f26cc006150 2024-04-18T03:41:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.647+0000 7f26c2ffd700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f26b4066760 0x7f26b4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.647+0000 7f26c2ffd700 1 -- 172.21.15.157:0/2116643132 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26c80840b0 con 0x7f26cc006150 2024-04-18T03:41:01.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.647+0000 7f26d1d9b700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f26b4066760 0x7f26b4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.647+0000 7f26d1d9b700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f26b4066760 0x7f26b4068c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26c4000c00 tx=0x7f26c4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.655+0000 7f26c2ffd700 1 -- 172.21.15.157:0/2116643132 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f26c80510f0 con 0x7f26cc006150 2024-04-18T03:41:01.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.823+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26cc050e90 con 0x7f26cc006150 2024-04-18T03:41:01.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.823+0000 7f26c2ffd700 1 -- 172.21.15.157:0/2116643132 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26c80094e0 con 0x7f26cc006150 2024-04-18T03:41:01.828 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:41:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f26b4066760 msgr2=0x7f26b4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f26b4066760 0x7f26b4068c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26c4000c00 tx=0x7f26c4008030 comp rx=0 tx=0).stop 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc006150 msgr2=0x7f26cc04af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc006150 0x7f26cc04af00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f26c800e760 tx=0x7f26c800ea70 comp rx=0 tx=0).stop 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 shutdown_connections 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f26b4066760 0x7f26b4068c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26cc0e40e0 0x7f26cc0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f26cc0e3b40 0x7f26cc0d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 --2- 172.21.15.157:0/2116643132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26cc006150 0x7f26cc04af00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 >> 172.21.15.157:0/2116643132 conn(0x7f26cc054b70 msgr2=0x7f26cc0d7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 shutdown_connections 2024-04-18T03:41:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.827+0000 7f26d359e700 1 -- 172.21.15.157:0/2116643132 wait complete. 2024-04-18T03:41:01.843 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:41:01.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.959+0000 7fdb7b59e700 1 Processor -- start 2024-04-18T03:41:01.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.959+0000 7fdb7b59e700 1 -- start start 2024-04-18T03:41:01.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c159560 0x7fdb7c0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7b59e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c15d3d0 con 0x7fdb7c0cb540 2024-04-18T03:41:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7b59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c15d6b0 con 0x7fdb7c0ce1c0 2024-04-18T03:41:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c15e190 con 0x7fdb7c159560 2024-04-18T03:41:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb79d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fdb7c0cb540 0x7fdb7c0cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:48048/0 (socket says 172.21.15.157:48048) 2024-04-18T03:41:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb79d9b700 1 -- 172.21.15.157:0/2146211783 learned_addr learned my addr 172.21.15.157:0/2146211783 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7a59c700 1 --2- 172.21.15.157:0/2146211783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c159560 0x7fdb7c0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7959a700 1 -- 172.21.15.157:0/2146211783 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520109014 0 0) 0x7fdb7c15d3d0 con 0x7fdb7c0cb540 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7959a700 1 -- 172.21.15.157:0/2146211783 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb640035d0 con 0x7fdb7c0cb540 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7a59c700 1 -- 172.21.15.157:0/2146211783 >> v1:172.21.15.175:6789/0 conn(0x7fdb7c0ce1c0 legacy=0x7fdb7c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7959a700 1 -- 172.21.15.157:0/2146211783 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830325000 0 0) 0x7fdb7c15d6b0 con 0x7fdb7c0ce1c0 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7a59c700 1 -- 172.21.15.157:0/2146211783 >> v1:172.21.15.157:6789/0 conn(0x7fdb7c0cb540 legacy=0x7fdb7c0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7a59c700 1 -- 172.21.15.157:0/2146211783 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c15d990 con 0x7fdb7c159560 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7a59c700 1 --2- 172.21.15.157:0/2146211783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c159560 0x7fdb7c0cc1a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400aed0 tx=0x7fdb7400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8aa01c6e012f55 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7959a700 1 -- 172.21.15.157:0/2146211783 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400f070 con 0x7fdb7c159560 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7959a700 1 -- 172.21.15.157:0/2146211783 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400a2e0 con 0x7fdb7c159560 2024-04-18T03:41:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.963+0000 7fdb7959a700 1 -- 172.21.15.157:0/2146211783 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400cbd0 con 0x7fdb7c159560 2024-04-18T03:41:01.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 -- 172.21.15.157:0/2146211783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c159560 msgr2=0x7fdb7c0cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 --2- 172.21.15.157:0/2146211783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c159560 0x7fdb7c0cc1a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400aed0 tx=0x7fdb7400c330 comp rx=0 tx=0).stop 2024-04-18T03:41:01.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 -- 172.21.15.157:0/2146211783 shutdown_connections 2024-04-18T03:41:01.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 --2- 172.21.15.157:0/2146211783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c159560 0x7fdb7c0cc1a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 -- 172.21.15.157:0/2146211783 >> 172.21.15.157:0/2146211783 conn(0x7fdb7c0b12d0 msgr2=0x7fdb7c06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:01.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 -- 172.21.15.157:0/2146211783 shutdown_connections 2024-04-18T03:41:01.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 -- 172.21.15.157:0/2146211783 wait complete. 2024-04-18T03:41:01.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 Processor -- start 2024-04-18T03:41:01.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.967+0000 7fdb7b59e700 1 -- start start 2024-04-18T03:41:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb7c0cb540 0x7fdb7c14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c0ce1c0 0x7fdb7c0ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7c159560 0x7fdb7c157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0ac8e0 con 0x7fdb7c159560 2024-04-18T03:41:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c158270 con 0x7fdb7c0cb540 2024-04-18T03:41:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c158540 con 0x7fdb7c0ce1c0 2024-04-18T03:41:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7c159560 0x7fdb7c157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb7c0cb540 0x7fdb7c14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7c159560 0x7fdb7c157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34686/0 (socket says 172.21.15.157:34686) 2024-04-18T03:41:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 -- 172.21.15.157:0/984432080 learned_addr learned my addr 172.21.15.157:0/984432080 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb79d9b700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c0ce1c0 0x7fdb7c0ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 -- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c0ce1c0 msgr2=0x7fdb7c0ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c0ce1c0 0x7fdb7c0ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 -- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb7c0cb540 msgr2=0x7fdb7c14bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb7c0cb540 0x7fdb7c14bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 -- 172.21.15.157:0/984432080 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7400ab80 con 0x7fdb7c159560 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7ad9d700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7c159560 0x7fdb7c157d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00c3f0 tx=0x7fdb6c00c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb6affd700 1 -- 172.21.15.157:0/984432080 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0052e0 con 0x7fdb7c159560 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb6affd700 1 -- 172.21.15.157:0/984432080 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c005460 con 0x7fdb7c159560 2024-04-18T03:41:01.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c158820 con 0x7fdb7c159560 2024-04-18T03:41:01.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb6affd700 1 -- 172.21.15.157:0/984432080 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0038e0 con 0x7fdb7c159560 2024-04-18T03:41:01.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c0abba0 con 0x7fdb7c159560 2024-04-18T03:41:01.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c0676b0 con 0x7fdb7c159560 2024-04-18T03:41:01.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.971+0000 7fdb6affd700 1 -- 172.21.15.157:0/984432080 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdb6c003a40 con 0x7fdb7c159560 2024-04-18T03:41:01.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.975+0000 7fdb6affd700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdb5c066730 0x7fdb5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:01.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.975+0000 7fdb6affd700 1 -- 172.21.15.157:0/984432080 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdb6c083d50 con 0x7fdb7c159560 2024-04-18T03:41:01.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.975+0000 7fdb7a59c700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdb5c066730 0x7fdb5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.975+0000 7fdb7a59c700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdb5c066730 0x7fdb5c068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400af80 tx=0x7fdb7400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:01.979+0000 7fdb6affd700 1 -- 172.21.15.157:0/984432080 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fdb6c050c50 con 0x7fdb7c159560 2024-04-18T03:41:02.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.147+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdb7c04e650 con 0x7fdb7c159560 2024-04-18T03:41:02.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.147+0000 7fdb6affd700 1 -- 172.21.15.157:0/984432080 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdb6c017070 con 0x7fdb7c159560 2024-04-18T03:41:02.152 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:02.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdb5c066730 msgr2=0x7fdb5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:02.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdb5c066730 0x7fdb5c068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400af80 tx=0x7fdb7400a000 comp rx=0 tx=0).stop 2024-04-18T03:41:02.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7c159560 msgr2=0x7fdb7c157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:02.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7c159560 0x7fdb7c157d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00c3f0 tx=0x7fdb6c00c700 comp rx=0 tx=0).stop 2024-04-18T03:41:02.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 shutdown_connections 2024-04-18T03:41:02.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fdb5c066730 0x7fdb5c068bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdb7c159560 0x7fdb7c157d30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb7c0ce1c0 0x7fdb7c0ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 --2- 172.21.15.157:0/984432080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb7c0cb540 0x7fdb7c14bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 >> 172.21.15.157:0/984432080 conn(0x7fdb7c0b12d0 msgr2=0x7fdb7c0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:02.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 shutdown_connections 2024-04-18T03:41:02.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.151+0000 7fdb7b59e700 1 -- 172.21.15.157:0/984432080 wait complete. 2024-04-18T03:41:02.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:41:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 Processor -- start 2024-04-18T03:41:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- start start 2024-04-18T03:41:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 0x7fd4b406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd4b4161bb0 0x7fd4b40cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b40b25e0 con 0x7fd4b4162010 2024-04-18T03:41:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b40ce8c0 con 0x7fd4b4161bb0 2024-04-18T03:41:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b406f130 con 0x7fd4b406e810 2024-04-18T03:41:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b8a04700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd4b4161bb0 0x7fd4b40cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b8a04700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd4b4161bb0 0x7fd4b40cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40664/0 (socket says 172.21.15.157:40664) 2024-04-18T03:41:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b8a04700 1 -- 172.21.15.157:0/2711826535 learned_addr learned my addr 172.21.15.157:0/2711826535 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b9205700 1 --2- 172.21.15.157:0/2711826535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 0x7fd4b406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b8a04700 1 -- 172.21.15.157:0/2711826535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 msgr2=0x7fd4b406ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b8a04700 1 --2- 172.21.15.157:0/2711826535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 0x7fd4b406ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b8a04700 1 -- 172.21.15.157:0/2711826535 >> v1:172.21.15.157:6789/0 conn(0x7fd4b4162010 legacy=0x7fd4b40b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b8a04700 1 -- 172.21.15.157:0/2711826535 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b414aa60 con 0x7fd4b4161bb0 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4b8a04700 1 --2- 172.21.15.157:0/2711826535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cdd50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009e50 tx=0x7fd4ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86fd06c27fce14e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4a7fff700 1 -- 172.21.15.157:0/2711826535 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00e070 con 0x7fd4b4161bb0 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4a7fff700 1 -- 172.21.15.157:0/2711826535 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00b9c0 con 0x7fd4b4161bb0 2024-04-18T03:41:02.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4a7fff700 1 -- 172.21.15.157:0/2711826535 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00bd70 con 0x7fd4b4161bb0 2024-04-18T03:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- 172.21.15.157:0/2711826535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 msgr2=0x7fd4b40cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2711826535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cdd50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009e50 tx=0x7fd4ac00b330 comp rx=0 tx=0).stop 2024-04-18T03:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- 172.21.15.157:0/2711826535 shutdown_connections 2024-04-18T03:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2711826535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cdd50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2711826535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 0x7fd4b406ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- 172.21.15.157:0/2711826535 >> 172.21.15.157:0/2711826535 conn(0x7fd4b40b12d0 msgr2=0x7fd4b406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- 172.21.15.157:0/2711826535 shutdown_connections 2024-04-18T03:41:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.279+0000 7fd4ba207700 1 -- 172.21.15.157:0/2711826535 wait complete. 2024-04-18T03:41:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4ba207700 1 Processor -- start 2024-04-18T03:41:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4ba207700 1 -- start start 2024-04-18T03:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4ba207700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 0x7fd4b41fae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4ba207700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4ba207700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b4162010 0x7fd4b4144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4ba207700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40adef0 con 0x7fd4b4161bb0 2024-04-18T03:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4ba207700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40ae1d0 con 0x7fd4b4162010 2024-04-18T03:41:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4ba207700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40ae4b0 con 0x7fd4b406e810 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b8a04700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b8a04700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40668/0 (socket says 172.21.15.157:40668) 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b8a04700 1 -- 172.21.15.157:0/2709901629 learned_addr learned my addr 172.21.15.157:0/2709901629 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b9205700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 0x7fd4b41fae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b9a06700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b4162010 0x7fd4b4144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b8a04700 1 -- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 msgr2=0x7fd4b41fae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b8a04700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 0x7fd4b41fae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b8a04700 1 -- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b4162010 msgr2=0x7fd4b4144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b8a04700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b4162010 0x7fd4b4144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b8a04700 1 -- 172.21.15.157:0/2709901629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac009b30 con 0x7fd4b4161bb0 2024-04-18T03:41:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.283+0000 7fd4b9a06700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b4162010 0x7fd4b4144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4b8a04700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cda10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b370 tx=0x7fd4ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4a5ffb700 1 -- 172.21.15.157:0/2709901629 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0048b0 con 0x7fd4b4161bb0 2024-04-18T03:41:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4a5ffb700 1 -- 172.21.15.157:0/2709901629 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac0092e0 con 0x7fd4b4161bb0 2024-04-18T03:41:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b41fa660 con 0x7fd4b4161bb0 2024-04-18T03:41:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4a5ffb700 1 -- 172.21.15.157:0/2709901629 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac01c680 con 0x7fd4b4161bb0 2024-04-18T03:41:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b41fb3a0 con 0x7fd4b4161bb0 2024-04-18T03:41:02.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4a5ffb700 1 -- 172.21.15.157:0/2709901629 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4ac01c7e0 con 0x7fd4b4161bb0 2024-04-18T03:41:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b404e650 con 0x7fd4b4161bb0 2024-04-18T03:41:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.287+0000 7fd4a5ffb700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd498066730 0x7fd498068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.291+0000 7fd4a5ffb700 1 -- 172.21.15.157:0/2709901629 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd4ac085e10 con 0x7fd4b4161bb0 2024-04-18T03:41:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.291+0000 7fd4b9205700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd498066730 0x7fd498068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.291+0000 7fd4b9205700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd498066730 0x7fd498068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8007a60 tx=0x7fd4a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:02.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.299+0000 7fd4a5ffb700 1 -- 172.21.15.157:0/2709901629 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd4ac052e50 con 0x7fd4b4161bb0 2024-04-18T03:41:02.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.479+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd4b406e5c0 con 0x7fd4b4161bb0 2024-04-18T03:41:02.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.479+0000 7fd4a5ffb700 1 -- 172.21.15.157:0/2709901629 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd4ac056470 con 0x7fd4b4161bb0 2024-04-18T03:41:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd498066730 msgr2=0x7fd498068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd498066730 0x7fd498068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8007a60 tx=0x7fd4a8008040 comp rx=0 tx=0).stop 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 msgr2=0x7fd4b40cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cda10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b370 tx=0x7fd4ac004af0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 shutdown_connections 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd498066730 0x7fd498068bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4b4162010 0x7fd4b4144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4b4161bb0 0x7fd4b40cda10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 --2- 172.21.15.157:0/2709901629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4b406e810 0x7fd4b41fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 >> 172.21.15.157:0/2709901629 conn(0x7fd4b40b12d0 msgr2=0x7fd4b41e8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 shutdown_connections 2024-04-18T03:41:02.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:02.483+0000 7fd4ba207700 1 -- 172.21.15.157:0/2709901629 wait complete. 2024-04-18T03:41:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:41:02.503 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi157.front.sepia.ceph.com... 2024-04-18T03:41:02.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:02.504 DEBUG:teuthology.orchestra.run.smithi157:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-18T03:41:02.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi157.stderr:ceph-fuse[32887]: fuse finished with error 0 and tester_r 0 2024-04-18T03:41:02.519 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:41:08.621 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:41:08.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:08.621 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-18T03:41:08.629 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:41:08.629 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:41:08.637 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:41:08.637 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:41:08.644 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:41:08.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 Processor -- start 2024-04-18T03:41:08.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- start start 2024-04-18T03:41:08.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f040814a360 0x7f0408161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f040806ef20 0x7f04080ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04080b1c20 con 0x7f04080cdd20 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04080b25c0 con 0x7f040806ef20 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04080b1f00 con 0x7f040814a360 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040d396700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f040806ef20 0x7f04080ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040d396700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f040806ef20 0x7f04080ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40672/0 (socket says 172.21.15.157:40672) 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040d396700 1 -- 172.21.15.157:0/3107023341 learned_addr learned my addr 172.21.15.157:0/3107023341 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040cb95700 1 --2- 172.21.15.157:0/3107023341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f040814a360 0x7f0408161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040d396700 1 -- 172.21.15.157:0/3107023341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f040814a360 msgr2=0x7f0408161ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040d396700 1 --2- 172.21.15.157:0/3107023341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f040814a360 0x7f0408161ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040d396700 1 -- 172.21.15.157:0/3107023341 >> v1:172.21.15.175:6789/0 conn(0x7f04080cdd20 legacy=0x7f040806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040d396700 1 -- 172.21.15.157:0/3107023341 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080b21e0 con 0x7f040806ef20 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040d396700 1 --2- 172.21.15.157:0/3107023341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040806ef20 0x7f04080ce180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0400009e50 tx=0x7f040000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e256deade1439b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:08.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f04077fe700 1 -- 172.21.15.157:0/3107023341 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040000e070 con 0x7f040806ef20 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f04077fe700 1 -- 172.21.15.157:0/3107023341 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040000b9c0 con 0x7f040806ef20 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f04077fe700 1 -- 172.21.15.157:0/3107023341 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040000bd70 con 0x7f040806ef20 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- 172.21.15.157:0/3107023341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040806ef20 msgr2=0x7f04080ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 --2- 172.21.15.157:0/3107023341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040806ef20 0x7f04080ce180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0400009e50 tx=0x7f040000b330 comp rx=0 tx=0).stop 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- 172.21.15.157:0/3107023341 shutdown_connections 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 --2- 172.21.15.157:0/3107023341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040806ef20 0x7f04080ce180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 --2- 172.21.15.157:0/3107023341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f040814a360 0x7f0408161ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- 172.21.15.157:0/3107023341 >> 172.21.15.157:0/3107023341 conn(0x7f04080b1330 msgr2=0x7f040806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- 172.21.15.157:0/3107023341 shutdown_connections 2024-04-18T03:41:08.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.791+0000 7f040db97700 1 -- 172.21.15.157:0/3107023341 wait complete. 2024-04-18T03:41:08.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 Processor -- start 2024-04-18T03:41:08.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 -- start start 2024-04-18T03:41:08.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040806ef20 0x7f0408141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:08.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080cdd20 0x7f04080c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:08.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040814a360 0x7f04080c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:08.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040815e0c0 con 0x7f040814a360 2024-04-18T03:41:08.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040815e3a0 con 0x7f040806ef20 2024-04-18T03:41:08.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040815e680 con 0x7f04080cdd20 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040814a360 0x7f04080c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040814a360 0x7f04080c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40686/0 (socket says 172.21.15.157:40686) 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 -- 172.21.15.157:0/1189938819 learned_addr learned my addr 172.21.15.157:0/1189938819 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040cb95700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040806ef20 0x7f0408141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f0407fff700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080cdd20 0x7f04080c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 -- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080cdd20 msgr2=0x7f04080c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080cdd20 0x7f04080c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 -- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040806ef20 msgr2=0x7f0408141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040806ef20 0x7f0408141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 -- 172.21.15.157:0/1189938819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400009b30 con 0x7f040814a360 2024-04-18T03:41:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040cb95700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040806ef20 0x7f0408141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f0407fff700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080cdd20 0x7f04080c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040d396700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040814a360 0x7f04080c4be0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f040806c4c0 tx=0x7f0400004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f04057fa700 1 -- 172.21.15.157:0/1189938819 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400004960 con 0x7f040814a360 2024-04-18T03:41:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f04057fa700 1 -- 172.21.15.157:0/1189938819 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04000099b0 con 0x7f040814a360 2024-04-18T03:41:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04081621a0 con 0x7f040814a360 2024-04-18T03:41:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.795+0000 7f04057fa700 1 -- 172.21.15.157:0/1189938819 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040001c680 con 0x7f040814a360 2024-04-18T03:41:08.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.799+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040815ec40 con 0x7f040814a360 2024-04-18T03:41:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.799+0000 7f04057fa700 1 -- 172.21.15.157:0/1189938819 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f040001c7e0 con 0x7f040814a360 2024-04-18T03:41:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.799+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040804e650 con 0x7f040814a360 2024-04-18T03:41:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.799+0000 7f04057fa700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f03f4066730 0x7f03f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.799+0000 7f04057fa700 1 -- 172.21.15.157:0/1189938819 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f04000861d0 con 0x7f040814a360 2024-04-18T03:41:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.799+0000 7f040cb95700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f03f4066730 0x7f03f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:08.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.799+0000 7f040cb95700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f03f4066730 0x7f03f4068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007a70 tx=0x7f03fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:08.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.807+0000 7f04057fa700 1 -- 172.21.15.157:0/1189938819 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0400053210 con 0x7f040814a360 2024-04-18T03:41:08.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.979+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0408070f00 con 0x7f040814a360 2024-04-18T03:41:08.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.983+0000 7f04057fa700 1 -- 172.21.15.157:0/1189938819 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f0400056830 con 0x7f040814a360 2024-04-18T03:41:08.987 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:08.987 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:41:08.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.983+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f03f4066730 msgr2=0x7f03f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:08.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f03f4066730 0x7f03f4068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007a70 tx=0x7f03fc008040 comp rx=0 tx=0).stop 2024-04-18T03:41:08.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040814a360 msgr2=0x7f04080c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:08.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040814a360 0x7f04080c4be0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f040806c4c0 tx=0x7f0400004af0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 shutdown_connections 2024-04-18T03:41:08.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f03f4066730 0x7f03f4068bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f040814a360 0x7f04080c4be0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04080cdd20 0x7f04080c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 --2- 172.21.15.157:0/1189938819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f040806ef20 0x7f0408141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:08.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 >> 172.21.15.157:0/1189938819 conn(0x7f04080b1330 msgr2=0x7f0408070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:08.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 shutdown_connections 2024-04-18T03:41:08.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:08.987+0000 7f040db97700 1 -- 172.21.15.157:0/1189938819 wait complete. 2024-04-18T03:41:09.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:41:09.002 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:41:09.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe8f2e700 1 Processor -- start 2024-04-18T03:41:09.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe8f2e700 1 -- start start 2024-04-18T03:41:09.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe8f2e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe4146170 0x7febe4146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe8f2e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7febe406ba20 0x7febe4070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe8f2e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe4146a90 con 0x7febe40b7600 2024-04-18T03:41:09.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe8f2e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40d2980 con 0x7febe406ba20 2024-04-18T03:41:09.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe8f2e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40d2c60 con 0x7febe4146170 2024-04-18T03:41:09.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe4146170 0x7febe4146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe2d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7febe406ba20 0x7febe4070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe4146170 0x7febe4146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:59702/0 (socket says 172.21.15.157:59702) 2024-04-18T03:41:09.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe259c700 1 -- 172.21.15.157:0/919430543 learned_addr learned my addr 172.21.15.157:0/919430543 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:09.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe259c700 1 -- 172.21.15.157:0/919430543 >> v2:172.21.15.175:3300/0 conn(0x7febe406ba20 msgr2=0x7febe4070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:09.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe259c700 1 --2- 172.21.15.157:0/919430543 >> v2:172.21.15.175:3300/0 conn(0x7febe406ba20 0x7febe4070430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe259c700 1 -- 172.21.15.157:0/919430543 >> v1:172.21.15.175:6789/0 conn(0x7febe40b7600 legacy=0x7febe406b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe259c700 1 -- 172.21.15.157:0/919430543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4161a20 con 0x7febe4146170 2024-04-18T03:41:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe2d9d700 1 --2- 172.21.15.157:0/919430543 >> v2:172.21.15.175:3300/0 conn(0x7febe406ba20 0x7febe4070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.119+0000 7febe259c700 1 --2- 172.21.15.157:0/919430543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe4146170 0x7febe4146550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febd4009910 tx=0x7febd4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=464c7e9ff6e9c8f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe159a700 1 -- 172.21.15.157:0/919430543 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011830 con 0x7febe4146170 2024-04-18T03:41:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe159a700 1 -- 172.21.15.157:0/919430543 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4011990 con 0x7febe4146170 2024-04-18T03:41:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe159a700 1 -- 172.21.15.157:0/919430543 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011d40 con 0x7febe4146170 2024-04-18T03:41:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 -- 172.21.15.157:0/919430543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe4146170 msgr2=0x7febe4146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 --2- 172.21.15.157:0/919430543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe4146170 0x7febe4146550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febd4009910 tx=0x7febd4009c20 comp rx=0 tx=0).stop 2024-04-18T03:41:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 -- 172.21.15.157:0/919430543 shutdown_connections 2024-04-18T03:41:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 --2- 172.21.15.157:0/919430543 >> v2:172.21.15.175:3300/0 conn(0x7febe406ba20 0x7febe4070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 --2- 172.21.15.157:0/919430543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe4146170 0x7febe4146550 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 -- 172.21.15.157:0/919430543 >> 172.21.15.157:0/919430543 conn(0x7febe40b4e00 msgr2=0x7febe40b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 -- 172.21.15.157:0/919430543 shutdown_connections 2024-04-18T03:41:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 -- 172.21.15.157:0/919430543 wait complete. 2024-04-18T03:41:09.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 Processor -- start 2024-04-18T03:41:09.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.123+0000 7febe8f2e700 1 -- start start 2024-04-18T03:41:09.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe8f2e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe406ba20 0x7febe415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe8f2e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b7600 0x7febe40c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe8f2e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe4146170 0x7febe41f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe8f2e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40c9420 con 0x7febe40b7600 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe8f2e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4144a50 con 0x7febe4146170 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe8f2e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe4143e40 con 0x7febe406ba20 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b7600 0x7febe40c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b7600 0x7febe40c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40690/0 (socket says 172.21.15.157:40690) 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 -- 172.21.15.157:0/2412517774 learned_addr learned my addr 172.21.15.157:0/2412517774 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe2d9d700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe4146170 0x7febe41f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe259c700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe406ba20 0x7febe415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 -- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe406ba20 msgr2=0x7febe415c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe406ba20 0x7febe415c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 -- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe4146170 msgr2=0x7febe41f2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe4146170 0x7febe41f2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 -- 172.21.15.157:0/2412517774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc009a70 con 0x7febe40b7600 2024-04-18T03:41:09.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe1d9b700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b7600 0x7febe40c87a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7febd800c500 tx=0x7febd800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febd2ffd700 1 -- 172.21.15.157:0/2412517774 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80052d0 con 0x7febe40b7600 2024-04-18T03:41:09.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febd2ffd700 1 -- 172.21.15.157:0/2412517774 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8005430 con 0x7febe40b7600 2024-04-18T03:41:09.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd4009570 con 0x7febe40b7600 2024-04-18T03:41:09.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febd2ffd700 1 -- 172.21.15.157:0/2412517774 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80055a0 con 0x7febe40b7600 2024-04-18T03:41:09.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.127+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe4144400 con 0x7febe40b7600 2024-04-18T03:41:09.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.131+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe404e6c0 con 0x7febe40b7600 2024-04-18T03:41:09.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.131+0000 7febd2ffd700 1 -- 172.21.15.157:0/2412517774 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7febd80038c0 con 0x7febe40b7600 2024-04-18T03:41:09.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.131+0000 7febd2ffd700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7febc4066730 0x7febc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.131+0000 7febd2ffd700 1 -- 172.21.15.157:0/2412517774 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7febd80837f0 con 0x7febe40b7600 2024-04-18T03:41:09.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.131+0000 7febe259c700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7febc4066730 0x7febc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.131+0000 7febe259c700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7febc4066730 0x7febc4068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febd4000c00 tx=0x7febd4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.139+0000 7febd2ffd700 1 -- 172.21.15.157:0/2412517774 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7febd8050830 con 0x7febe40b7600 2024-04-18T03:41:09.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.303+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febe40b6ed0 con 0x7febe40b7600 2024-04-18T03:41:09.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febd2ffd700 1 -- 172.21.15.157:0/2412517774 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7febd8017020 con 0x7febe40b7600 2024-04-18T03:41:09.309 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7febc4066730 msgr2=0x7febc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7febc4066730 0x7febc4068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febd4000c00 tx=0x7febd4008030 comp rx=0 tx=0).stop 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b7600 msgr2=0x7febe40c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b7600 0x7febe40c87a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7febd800c500 tx=0x7febd800c810 comp rx=0 tx=0).stop 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 shutdown_connections 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7febc4066730 0x7febc4068bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febe4146170 0x7febe41f2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7febe40b7600 0x7febe40c87a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 --2- 172.21.15.157:0/2412517774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febe406ba20 0x7febe415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 >> 172.21.15.157:0/2412517774 conn(0x7febe40b4e00 msgr2=0x7febe40d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 shutdown_connections 2024-04-18T03:41:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.307+0000 7febe8f2e700 1 -- 172.21.15.157:0/2412517774 wait complete. 2024-04-18T03:41:09.324 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:41:09.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f22751d8700 1 Processor -- start 2024-04-18T03:41:09.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f22751d8700 1 -- start start 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f22751d8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22700717e0 0x7f2270141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f22751d8700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f227006e810 0x7f227006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f22751d8700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2270142140 con 0x7f22701414e0 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f22751d8700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227006f1c0 con 0x7f227006e810 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f22751d8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2270071c40 con 0x7f22700717e0 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f226f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22700717e0 0x7f2270141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f22749d7700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f227006e810 0x7f227006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f226f7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22700717e0 0x7f2270141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:59714/0 (socket says 172.21.15.157:59714) 2024-04-18T03:41:09.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f226f7fe700 1 -- 172.21.15.157:0/1960167031 learned_addr learned my addr 172.21.15.157:0/1960167031 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:09.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f226f7fe700 1 -- 172.21.15.157:0/1960167031 >> v2:172.21.15.175:3300/0 conn(0x7f227006e810 msgr2=0x7f227006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:09.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f226f7fe700 1 --2- 172.21.15.157:0/1960167031 >> v2:172.21.15.175:3300/0 conn(0x7f227006e810 0x7f227006ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f226f7fe700 1 -- 172.21.15.157:0/1960167031 >> v1:172.21.15.175:6789/0 conn(0x7f22701414e0 legacy=0x7f227015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f226f7fe700 1 -- 172.21.15.157:0/1960167031 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270142f80 con 0x7f22700717e0 2024-04-18T03:41:09.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.439+0000 7f226f7fe700 1 --2- 172.21.15.157:0/1960167031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22700717e0 0x7f2270141c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2258009e50 tx=0x7f225800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91cd1cdc9b118e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f226effd700 1 -- 172.21.15.157:0/1960167031 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800e070 con 0x7f22700717e0 2024-04-18T03:41:09.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f226effd700 1 -- 172.21.15.157:0/1960167031 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225800b910 con 0x7f22700717e0 2024-04-18T03:41:09.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f226effd700 1 -- 172.21.15.157:0/1960167031 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800bcc0 con 0x7f22700717e0 2024-04-18T03:41:09.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 -- 172.21.15.157:0/1960167031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22700717e0 msgr2=0x7f2270141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 --2- 172.21.15.157:0/1960167031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22700717e0 0x7f2270141c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2258009e50 tx=0x7f225800b330 comp rx=0 tx=0).stop 2024-04-18T03:41:09.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 -- 172.21.15.157:0/1960167031 shutdown_connections 2024-04-18T03:41:09.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 --2- 172.21.15.157:0/1960167031 >> v2:172.21.15.175:3300/0 conn(0x7f227006e810 0x7f227006ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 --2- 172.21.15.157:0/1960167031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22700717e0 0x7f2270141c00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 -- 172.21.15.157:0/1960167031 >> 172.21.15.157:0/1960167031 conn(0x7f22700b12d0 msgr2=0x7f227006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:09.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 -- 172.21.15.157:0/1960167031 shutdown_connections 2024-04-18T03:41:09.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 -- 172.21.15.157:0/1960167031 wait complete. 2024-04-18T03:41:09.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.443+0000 7f22751d8700 1 Processor -- start 2024-04-18T03:41:09.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 -- start start 2024-04-18T03:41:09.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f227006e810 0x7f227015a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22700717e0 0x7f2270136bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22701414e0 0x7f2270137100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270134a40 con 0x7f22700717e0 2024-04-18T03:41:09.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227015ad50 con 0x7f22701414e0 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227013a7b0 con 0x7f227006e810 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22700717e0 0x7f2270136bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f227006e810 0x7f227015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22700717e0 0x7f2270136bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40706/0 (socket says 172.21.15.157:40706) 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 -- 172.21.15.157:0/937080642 learned_addr learned my addr 172.21.15.157:0/937080642 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22749d7700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22701414e0 0x7f2270137100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 -- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f227006e810 msgr2=0x7f227015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f227006e810 0x7f227015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 -- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22701414e0 msgr2=0x7f2270137100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22701414e0 0x7f2270137100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 -- 172.21.15.157:0/937080642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2258009b30 con 0x7f22700717e0 2024-04-18T03:41:09.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226f7fe700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22700717e0 0x7f2270136bc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f225800b370 tx=0x7f2258004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226cff9700 1 -- 172.21.15.157:0/937080642 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258004800 con 0x7f22700717e0 2024-04-18T03:41:09.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226cff9700 1 -- 172.21.15.157:0/937080642 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22580092e0 con 0x7f22700717e0 2024-04-18T03:41:09.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2270134cb0 con 0x7f22700717e0 2024-04-18T03:41:09.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f226cff9700 1 -- 172.21.15.157:0/937080642 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225801c680 con 0x7f22700717e0 2024-04-18T03:41:09.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.447+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227013aa90 con 0x7f22700717e0 2024-04-18T03:41:09.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.451+0000 7f226cff9700 1 -- 172.21.15.157:0/937080642 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f225801c7e0 con 0x7f22700717e0 2024-04-18T03:41:09.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.451+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227004e650 con 0x7f22700717e0 2024-04-18T03:41:09.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.451+0000 7f226cff9700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2254066730 0x7f2254068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.451+0000 7f226cff9700 1 -- 172.21.15.157:0/937080642 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f22580860b0 con 0x7f22700717e0 2024-04-18T03:41:09.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.451+0000 7f226ffff700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2254066730 0x7f2254068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.451+0000 7f226ffff700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2254066730 0x7f2254068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f227006b8c0 tx=0x7f2260009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.459+0000 7f226cff9700 1 -- 172.21.15.157:0/937080642 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f22580530f0 con 0x7f22700717e0 2024-04-18T03:41:09.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22700cdc30 con 0x7f22700717e0 2024-04-18T03:41:09.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f226cff9700 1 -- 172.21.15.157:0/937080642 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2258056710 con 0x7f22700717e0 2024-04-18T03:41:09.630 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:09.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2254066730 msgr2=0x7f2254068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2254066730 0x7f2254068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f227006b8c0 tx=0x7f2260009040 comp rx=0 tx=0).stop 2024-04-18T03:41:09.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22700717e0 msgr2=0x7f2270136bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22700717e0 0x7f2270136bc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f225800b370 tx=0x7f2258004af0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 shutdown_connections 2024-04-18T03:41:09.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2254066730 0x7f2254068bf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22701414e0 0x7f2270137100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22700717e0 0x7f2270136bc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 --2- 172.21.15.157:0/937080642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f227006e810 0x7f227015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 >> 172.21.15.157:0/937080642 conn(0x7f22700b12d0 msgr2=0x7f227015d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:09.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 shutdown_connections 2024-04-18T03:41:09.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.627+0000 7f22751d8700 1 -- 172.21.15.157:0/937080642 wait complete. 2024-04-18T03:41:09.650 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:41:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 Processor -- start 2024-04-18T03:41:09.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- start start 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4033fb0 0x7f0fb40eb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0fb4048210 0x7f0fb40eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb404fe20 con 0x7f0fb4047cc0 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb404fb80 con 0x7f0fb4048210 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40502b0 con 0x7f0fb4033fb0 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbbfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0fb4048210 0x7f0fb40eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbbfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0fb4048210 0x7f0fb40eb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40722/0 (socket says 172.21.15.157:40722) 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbbfff700 1 -- 172.21.15.157:0/3550415256 learned_addr learned my addr 172.21.15.157:0/3550415256 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:09.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc0e83700 1 --2- 172.21.15.157:0/3550415256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4033fb0 0x7f0fb40eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbbfff700 1 -- 172.21.15.157:0/3550415256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4033fb0 msgr2=0x7f0fb40eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbbfff700 1 --2- 172.21.15.157:0/3550415256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4033fb0 0x7f0fb40eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbbfff700 1 -- 172.21.15.157:0/3550415256 >> v1:172.21.15.157:6789/0 conn(0x7f0fb4047cc0 legacy=0x7f0fb4005f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbbfff700 1 -- 172.21.15.157:0/3550415256 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40ec0c0 con 0x7f0fb4048210 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc0e83700 1 --2- 172.21.15.157:0/3550415256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4033fb0 0x7f0fb40eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbbfff700 1 --2- 172.21.15.157:0/3550415256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4048210 0x7f0fb40eb760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009940 tx=0x7f0fb0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa504fed54201d65 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbb7fe700 1 -- 172.21.15.157:0/3550415256 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000ba20 con 0x7f0fb4048210 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbb7fe700 1 -- 172.21.15.157:0/3550415256 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb0009e90 con 0x7f0fb4048210 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fbb7fe700 1 -- 172.21.15.157:0/3550415256 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000bda0 con 0x7f0fb4048210 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- 172.21.15.157:0/3550415256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4048210 msgr2=0x7f0fb40eb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/3550415256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4048210 0x7f0fb40eb760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009940 tx=0x7f0fb0009c50 comp rx=0 tx=0).stop 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- 172.21.15.157:0/3550415256 shutdown_connections 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/3550415256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4048210 0x7f0fb40eb760 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/3550415256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4033fb0 0x7f0fb40eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- 172.21.15.157:0/3550415256 >> 172.21.15.157:0/3550415256 conn(0x7f0fb4054b70 msgr2=0x7f0fb4054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:09.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- 172.21.15.157:0/3550415256 shutdown_connections 2024-04-18T03:41:09.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.759+0000 7f0fc1e85700 1 -- 172.21.15.157:0/3550415256 wait complete. 2024-04-18T03:41:09.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 Processor -- start 2024-04-18T03:41:09.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 -- start start 2024-04-18T03:41:09.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4033fb0 0x7f0fb4181000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4047cc0 0x7f0fb417c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb4048210 0x7f0fb4049c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40e8690 con 0x7f0fb4033fb0 2024-04-18T03:41:09.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4181540 con 0x7f0fb4048210 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40e7a80 con 0x7f0fb4047cc0 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4033fb0 0x7f0fb4181000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4033fb0 0x7f0fb4181000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40728/0 (socket says 172.21.15.157:40728) 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 -- 172.21.15.157:0/2884074121 learned_addr learned my addr 172.21.15.157:0/2884074121 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fbbfff700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4047cc0 0x7f0fb417c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1684700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb4048210 0x7f0fb4049c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 -- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4047cc0 msgr2=0x7f0fb417c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4047cc0 0x7f0fb417c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 -- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb4048210 msgr2=0x7f0fb4049c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb4048210 0x7f0fb4049c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 -- 172.21.15.157:0/2884074121 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb0009570 con 0x7f0fb4033fb0 2024-04-18T03:41:09.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1684700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb4048210 0x7f0fb4049c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:09.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc0e83700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4033fb0 0x7f0fb4181000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800c7a0 tx=0x7f0fa800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fb97fa700 1 -- 172.21.15.157:0/2884074121 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8011800 con 0x7f0fb4033fb0 2024-04-18T03:41:09.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fb97fa700 1 -- 172.21.15.157:0/2884074121 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8011960 con 0x7f0fb4033fb0 2024-04-18T03:41:09.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb40e7d60 con 0x7f0fb4033fb0 2024-04-18T03:41:09.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fb97fa700 1 -- 172.21.15.157:0/2884074121 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8011d10 con 0x7f0fb4033fb0 2024-04-18T03:41:09.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.763+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb40e8320 con 0x7f0fb4033fb0 2024-04-18T03:41:09.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.767+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb40e8840 con 0x7f0fb4033fb0 2024-04-18T03:41:09.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.767+0000 7f0fb97fa700 1 -- 172.21.15.157:0/2884074121 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0fa8018360 con 0x7f0fb4033fb0 2024-04-18T03:41:09.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.767+0000 7f0fb97fa700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0fa0066730 0x7f0fa0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:09.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.767+0000 7f0fb97fa700 1 -- 172.21.15.157:0/2884074121 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0fa80845f0 con 0x7f0fb4033fb0 2024-04-18T03:41:09.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.767+0000 7f0fbbfff700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0fa0066730 0x7f0fa0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:09.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.767+0000 7f0fbbfff700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0fa0066730 0x7f0fa0068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009940 tx=0x7f0fb0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:09.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.775+0000 7f0fb97fa700 1 -- 172.21.15.157:0/2884074121 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f0fb40e8840 con 0x7f0fb4033fb0 2024-04-18T03:41:09.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.947+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fb4039890 con 0x7f0fb4033fb0 2024-04-18T03:41:09.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.947+0000 7f0fb97fa700 1 -- 172.21.15.157:0/2884074121 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fa8051500 con 0x7f0fb4033fb0 2024-04-18T03:41:09.952 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:41:09.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0fa0066730 msgr2=0x7f0fa0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0fa0066730 0x7f0fa0068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009940 tx=0x7f0fb0008030 comp rx=0 tx=0).stop 2024-04-18T03:41:09.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4033fb0 msgr2=0x7f0fb4181000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:09.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4033fb0 0x7f0fb4181000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800c7a0 tx=0x7f0fa800cab0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 shutdown_connections 2024-04-18T03:41:09.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0fa0066730 0x7f0fa0068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb4048210 0x7f0fb4049c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb4047cc0 0x7f0fb417c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 --2- 172.21.15.157:0/2884074121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0fb4033fb0 0x7f0fb4181000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:09.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 >> 172.21.15.157:0/2884074121 conn(0x7f0fb4054b70 msgr2=0x7f0fb40e5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:09.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 shutdown_connections 2024-04-18T03:41:09.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:09.951+0000 7f0fc1e85700 1 -- 172.21.15.157:0/2884074121 wait complete. 2024-04-18T03:41:09.967 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:41:10.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.083+0000 7f1adffff700 1 Processor -- start 2024-04-18T03:41:10.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.083+0000 7f1adffff700 1 -- start start 2024-04-18T03:41:10.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1ad80e33a0 0x7f1ad8058950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1ad803ebd0 0x7f1ad8056fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad803c050 0x7f1ad803c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80578b0 con 0x7f1ad803ebd0 2024-04-18T03:41:10.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad8057b90 con 0x7f1ad80e33a0 2024-04-18T03:41:10.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8057e70 con 0x7f1ad803c050 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1ad803ebd0 0x7f1ad8056fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1ad803ebd0 0x7f1ad8056fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40738/0 (socket says 172.21.15.157:40738) 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 -- 172.21.15.157:0/2464163523 learned_addr learned my addr 172.21.15.157:0/2464163523 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adf7fe700 1 --2- 172.21.15.157:0/2464163523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad803c050 0x7f1ad803c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adeffd700 1 --2- 172.21.15.157:0/2464163523 >> v2:172.21.15.175:3300/0 conn(0x7f1ad80e33a0 0x7f1ad8058950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 -- 172.21.15.157:0/2464163523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad803c050 msgr2=0x7f1ad803c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 --2- 172.21.15.157:0/2464163523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad803c050 0x7f1ad803c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 -- 172.21.15.157:0/2464163523 >> v2:172.21.15.175:3300/0 conn(0x7f1ad80e33a0 msgr2=0x7f1ad8058950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 --2- 172.21.15.157:0/2464163523 >> v2:172.21.15.175:3300/0 conn(0x7f1ad80e33a0 0x7f1ad8058950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 -- 172.21.15.157:0/2464163523 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8058150 con 0x7f1ad803ebd0 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1ade7fc700 1 --2- 172.21.15.157:0/2464163523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad8056fb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800e250 tx=0x7f1ad4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94ff18ed9ba798d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1addffb700 1 -- 172.21.15.157:0/2464163523 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4011830 con 0x7f1ad803ebd0 2024-04-18T03:41:10.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1addffb700 1 -- 172.21.15.157:0/2464163523 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad4011990 con 0x7f1ad803ebd0 2024-04-18T03:41:10.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1addffb700 1 -- 172.21.15.157:0/2464163523 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4011d20 con 0x7f1ad803ebd0 2024-04-18T03:41:10.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 -- 172.21.15.157:0/2464163523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 msgr2=0x7f1ad8056fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 --2- 172.21.15.157:0/2464163523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad8056fb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800e250 tx=0x7f1ad4009bf0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 -- 172.21.15.157:0/2464163523 shutdown_connections 2024-04-18T03:41:10.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 --2- 172.21.15.157:0/2464163523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad803c050 0x7f1ad803c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 --2- 172.21.15.157:0/2464163523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad8056fb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 --2- 172.21.15.157:0/2464163523 >> v2:172.21.15.175:3300/0 conn(0x7f1ad80e33a0 0x7f1ad8058950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 -- 172.21.15.157:0/2464163523 >> 172.21.15.157:0/2464163523 conn(0x7f1ad8055a10 msgr2=0x7f1ad8055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:10.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 -- 172.21.15.157:0/2464163523 shutdown_connections 2024-04-18T03:41:10.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.087+0000 7f1adffff700 1 -- 172.21.15.157:0/2464163523 wait complete. 2024-04-18T03:41:10.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adffff700 1 Processor -- start 2024-04-18T03:41:10.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adffff700 1 -- start start 2024-04-18T03:41:10.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad803c050 0x7f1ad80e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad802fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad80e33a0 0x7f1ad80302d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adffff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8052a10 con 0x7f1ad803ebd0 2024-04-18T03:41:10.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adffff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8051e90 con 0x7f1ad803c050 2024-04-18T03:41:10.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adffff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8052170 con 0x7f1ad80e33a0 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad802fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adeffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad803c050 0x7f1ad80e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad802fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40748/0 (socket says 172.21.15.157:40748) 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1adf7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad80e33a0 0x7f1ad80302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 -- 172.21.15.157:0/438153759 learned_addr learned my addr 172.21.15.157:0/438153759 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 -- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad80e33a0 msgr2=0x7f1ad80302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad80e33a0 0x7f1ad80302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 -- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad803c050 msgr2=0x7f1ad80e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad803c050 0x7f1ad80e2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 -- 172.21.15.157:0/438153759 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4009570 con 0x7f1ad803ebd0 2024-04-18T03:41:10.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.091+0000 7f1ade7fc700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad802fd90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8008690 tx=0x7f1ad4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1ac77fe700 1 -- 172.21.15.157:0/438153759 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4004240 con 0x7f1ad803ebd0 2024-04-18T03:41:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1ac77fe700 1 -- 172.21.15.157:0/438153759 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad401f070 con 0x7f1ad803ebd0 2024-04-18T03:41:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad8052450 con 0x7f1ad803ebd0 2024-04-18T03:41:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1ac77fe700 1 -- 172.21.15.157:0/438153759 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40045c0 con 0x7f1ad803ebd0 2024-04-18T03:41:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad80e2760 con 0x7f1ad803ebd0 2024-04-18T03:41:10.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad80e28f0 con 0x7f1ad803ebd0 2024-04-18T03:41:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1ac77fe700 1 -- 172.21.15.157:0/438153759 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ad4021030 con 0x7f1ad803ebd0 2024-04-18T03:41:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1ac77fe700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1acc066730 0x7f1acc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1ac77fe700 1 -- 172.21.15.157:0/438153759 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1ad4085620 con 0x7f1ad803ebd0 2024-04-18T03:41:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.095+0000 7f1adeffd700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1acc066730 0x7f1acc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.099+0000 7f1adeffd700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1acc066730 0x7f1acc068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0007a60 tx=0x7f1ad0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.103+0000 7f1ac77fe700 1 -- 172.21.15.157:0/438153759 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1ad4052660 con 0x7f1ad803ebd0 2024-04-18T03:41:10.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1ad8005440 con 0x7f1ad803ebd0 2024-04-18T03:41:10.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1ac77fe700 1 -- 172.21.15.157:0/438153759 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1ad4055c80 con 0x7f1ad803ebd0 2024-04-18T03:41:10.278 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1acc066730 msgr2=0x7f1acc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1acc066730 0x7f1acc068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0007a60 tx=0x7f1ad0008040 comp rx=0 tx=0).stop 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 msgr2=0x7f1ad802fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad802fd90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8008690 tx=0x7f1ad4004770 comp rx=0 tx=0).stop 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 shutdown_connections 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1acc066730 0x7f1acc068bf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad80e33a0 0x7f1ad80302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ad803ebd0 0x7f1ad802fd90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 --2- 172.21.15.157:0/438153759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad803c050 0x7f1ad80e2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 >> 172.21.15.157:0/438153759 conn(0x7f1ad8055a10 msgr2=0x7f1ad80061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 shutdown_connections 2024-04-18T03:41:10.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.275+0000 7f1adffff700 1 -- 172.21.15.157:0/438153759 wait complete. 2024-04-18T03:41:10.293 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:41:10.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 Processor -- start 2024-04-18T03:41:10.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- start start 2024-04-18T03:41:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78040b0200 0x7f78040cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f7804165060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78040ccf50 con 0x7f78040cc5a0 2024-04-18T03:41:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78040cd510 con 0x7f78040b0200 2024-04-18T03:41:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78040cd230 con 0x7f780406afe0 2024-04-18T03:41:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7808efd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f7804165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7808efd700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f7804165060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:59774/0 (socket says 172.21.15.157:59774) 2024-04-18T03:41:10.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7803fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78040b0200 0x7f78040cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78037fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f78040cc5a0 0x7f780406a8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:54436/0 (socket says 172.21.15.157:54436) 2024-04-18T03:41:10.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7808efd700 1 -- 172.21.15.157:0/3215295697 learned_addr learned my addr 172.21.15.157:0/3215295697 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:10.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7808efd700 1 -- 172.21.15.157:0/3215295697 >> v2:172.21.15.175:3300/0 conn(0x7f78040b0200 msgr2=0x7f78040cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:10.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7808efd700 1 --2- 172.21.15.157:0/3215295697 >> v2:172.21.15.175:3300/0 conn(0x7f78040b0200 0x7f78040cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7808efd700 1 -- 172.21.15.157:0/3215295697 >> v1:172.21.15.175:6789/0 conn(0x7f78040cc5a0 legacy=0x7f780406a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7808efd700 1 -- 172.21.15.157:0/3215295697 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040cf330 con 0x7f780406afe0 2024-04-18T03:41:10.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7808efd700 1 --2- 172.21.15.157:0/3215295697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f7804165060 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009e50 tx=0x7f77fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee58695e23b1e7c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7802ffd700 1 -- 172.21.15.157:0/3215295697 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00e070 con 0x7f780406afe0 2024-04-18T03:41:10.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7802ffd700 1 -- 172.21.15.157:0/3215295697 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00b910 con 0x7f780406afe0 2024-04-18T03:41:10.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f7802ffd700 1 -- 172.21.15.157:0/3215295697 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00bcc0 con 0x7f780406afe0 2024-04-18T03:41:10.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- 172.21.15.157:0/3215295697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 msgr2=0x7f7804165060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 --2- 172.21.15.157:0/3215295697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f7804165060 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009e50 tx=0x7f77fc00b330 comp rx=0 tx=0).stop 2024-04-18T03:41:10.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- 172.21.15.157:0/3215295697 shutdown_connections 2024-04-18T03:41:10.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 --2- 172.21.15.157:0/3215295697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f7804165060 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 --2- 172.21.15.157:0/3215295697 >> v2:172.21.15.175:3300/0 conn(0x7f78040b0200 0x7f78040cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- 172.21.15.157:0/3215295697 >> 172.21.15.157:0/3215295697 conn(0x7f78040d0c20 msgr2=0x7f78040d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:10.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- 172.21.15.157:0/3215295697 shutdown_connections 2024-04-18T03:41:10.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.403+0000 7f78096fe700 1 -- 172.21.15.157:0/3215295697 wait complete. 2024-04-18T03:41:10.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 Processor -- start 2024-04-18T03:41:10.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 -- start start 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f780415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78040b0200 0x7f780415f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78040b1a70 0x7f78041ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780415d200 con 0x7f78040b1a70 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780415f100 con 0x7f78040b0200 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78041eb8c0 con 0x7f780406afe0 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78040b1a70 0x7f78041ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78040b1a70 0x7f78041ec680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40752/0 (socket says 172.21.15.157:40752) 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 -- 172.21.15.157:0/1706716235 learned_addr learned my addr 172.21.15.157:0/1706716235 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78037fe700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78040b0200 0x7f780415f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7803fff700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f780415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 -- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 msgr2=0x7f780415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f780415eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 -- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78040b0200 msgr2=0x7f780415f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78040b0200 0x7f780415f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 -- 172.21.15.157:0/1706716235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc009b30 con 0x7f78040b1a70 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7803fff700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f780415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7808efd700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78040b1a70 0x7f78041ec680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f78040cd370 tx=0x7f77fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7800ff9700 1 -- 172.21.15.157:0/1706716235 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0048c0 con 0x7f78040b1a70 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78041ebba0 con 0x7f78040b1a70 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7800ff9700 1 -- 172.21.15.157:0/1706716235 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0099b0 con 0x7f78040b1a70 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78041ebf30 con 0x7f78040b1a70 2024-04-18T03:41:10.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.407+0000 7f7800ff9700 1 -- 172.21.15.157:0/1706716235 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc025650 con 0x7f78040b1a70 2024-04-18T03:41:10.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.411+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780404e650 con 0x7f78040b1a70 2024-04-18T03:41:10.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.411+0000 7f7800ff9700 1 -- 172.21.15.157:0/1706716235 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f77fc0257b0 con 0x7f78040b1a70 2024-04-18T03:41:10.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.411+0000 7f7800ff9700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f77f0066730 0x7f77f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.411+0000 7f7800ff9700 1 -- 172.21.15.157:0/1706716235 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f77fc086090 con 0x7f78040b1a70 2024-04-18T03:41:10.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.411+0000 7f7803fff700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f77f0066730 0x7f77f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.415+0000 7f7803fff700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f77f0066730 0x7f77f0068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f780415e8f0 tx=0x7f77f8009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.419+0000 7f7800ff9700 1 -- 172.21.15.157:0/1706716235 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f77fc053050 con 0x7f78040b1a70 2024-04-18T03:41:10.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:41:10.604 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:41:10.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78040cf110 con 0x7f78040b1a70 2024-04-18T03:41:10.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f7800ff9700 1 -- 172.21.15.157:0/1706716235 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f77fc056670 con 0x7f78040b1a70 2024-04-18T03:41:10.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f77f0066730 msgr2=0x7f77f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f77f0066730 0x7f77f0068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f780415e8f0 tx=0x7f77f8009240 comp rx=0 tx=0).stop 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78040b1a70 msgr2=0x7f78041ec680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78040b1a70 0x7f78041ec680 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f78040cd370 tx=0x7f77fc004af0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 shutdown_connections 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f77f0066730 0x7f77f0068bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78040b0200 0x7f780415f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78040b1a70 0x7f78041ec680 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 --2- 172.21.15.157:0/1706716235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f780406afe0 0x7f780415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 >> 172.21.15.157:0/1706716235 conn(0x7f78040d0c20 msgr2=0x7f7804072c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 shutdown_connections 2024-04-18T03:41:10.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.603+0000 7f78096fe700 1 -- 172.21.15.157:0/1706716235 wait complete. 2024-04-18T03:41:10.610 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:41:10.624 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:41:10.624 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:41:10.632 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:41:10.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 Processor -- start 2024-04-18T03:41:10.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 -- start start 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f729c0b0390 0x7f729c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c0ceaf0 0x7f729c06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f729c06caf0 0x7f729c165260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c06cfa0 con 0x7f729c06caf0 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c0cb7c0 con 0x7f729c0b0390 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0cf400 con 0x7f729c0ceaf0 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f729c06caf0 0x7f729c165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f729c06caf0 0x7f729c165260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40768/0 (socket says 172.21.15.157:40768) 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 -- 172.21.15.157:0/2246739781 learned_addr learned my addr 172.21.15.157:0/2246739781 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:10.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2190700 1 --2- 172.21.15.157:0/2246739781 >> v2:172.21.15.175:3300/0 conn(0x7f729c0b0390 0x7f729c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a198f700 1 --2- 172.21.15.157:0/2246739781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c0ceaf0 0x7f729c06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 -- 172.21.15.157:0/2246739781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c0ceaf0 msgr2=0x7f729c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 --2- 172.21.15.157:0/2246739781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c0ceaf0 0x7f729c06c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 -- 172.21.15.157:0/2246739781 >> v2:172.21.15.175:3300/0 conn(0x7f729c0b0390 msgr2=0x7f729c070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 --2- 172.21.15.157:0/2246739781 >> v2:172.21.15.175:3300/0 conn(0x7f729c0b0390 0x7f729c070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 -- 172.21.15.157:0/2246739781 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0cfca0 con 0x7f729c06caf0 2024-04-18T03:41:10.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a2991700 1 --2- 172.21.15.157:0/2246739781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c06caf0 0x7f729c165260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f729c06d930 tx=0x7f7298009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84387c6720330ca server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a118e700 1 -- 172.21.15.157:0/2246739781 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298011830 con 0x7f729c06caf0 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a118e700 1 -- 172.21.15.157:0/2246739781 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298011990 con 0x7f729c06caf0 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a118e700 1 -- 172.21.15.157:0/2246739781 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298011d20 con 0x7f729c06caf0 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 -- 172.21.15.157:0/2246739781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c06caf0 msgr2=0x7f729c165260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.743+0000 7f72a43f4700 1 --2- 172.21.15.157:0/2246739781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c06caf0 0x7f729c165260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f729c06d930 tx=0x7f7298009bf0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 -- 172.21.15.157:0/2246739781 shutdown_connections 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 --2- 172.21.15.157:0/2246739781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c06caf0 0x7f729c165260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 --2- 172.21.15.157:0/2246739781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c0ceaf0 0x7f729c06c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 --2- 172.21.15.157:0/2246739781 >> v2:172.21.15.175:3300/0 conn(0x7f729c0b0390 0x7f729c070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 -- 172.21.15.157:0/2246739781 >> 172.21.15.157:0/2246739781 conn(0x7f729c0d1000 msgr2=0x7f729c0d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 -- 172.21.15.157:0/2246739781 shutdown_connections 2024-04-18T03:41:10.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 -- 172.21.15.157:0/2246739781 wait complete. 2024-04-18T03:41:10.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 Processor -- start 2024-04-18T03:41:10.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 -- start start 2024-04-18T03:41:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c06caf0 0x7f729c0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c0b0390 0x7f729c163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f729c0ceaf0 0x7f729c1fa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1fb170 con 0x7f729c0b0390 2024-04-18T03:41:10.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1635f0 con 0x7f729c0ceaf0 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a43f4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0b4d80 con 0x7f729c06caf0 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a198f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c0b0390 0x7f729c163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a198f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c0b0390 0x7f729c163bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40778/0 (socket says 172.21.15.157:40778) 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a198f700 1 -- 172.21.15.157:0/1239681031 learned_addr learned my addr 172.21.15.157:0/1239681031 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a2190700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c06caf0 0x7f729c0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a2991700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f729c0ceaf0 0x7f729c1fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a198f700 1 -- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c06caf0 msgr2=0x7f729c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a198f700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c06caf0 0x7f729c0b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a198f700 1 -- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f729c0ceaf0 msgr2=0x7f729c1fa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a198f700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f729c0ceaf0 0x7f729c1fa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a198f700 1 -- 172.21.15.157:0/1239681031 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7298009570 con 0x7f729c0b0390 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.747+0000 7f72a2991700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f729c0ceaf0 0x7f729c1fa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:10.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f72a198f700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c0b0390 0x7f729c163bc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d30 tx=0x7f729400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f7292ffd700 1 -- 172.21.15.157:0/1239681031 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400cdc0 con 0x7f729c0b0390 2024-04-18T03:41:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f7292ffd700 1 -- 172.21.15.157:0/1239681031 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729400f040 con 0x7f729c0b0390 2024-04-18T03:41:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c164ae0 con 0x7f729c0b0390 2024-04-18T03:41:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f7292ffd700 1 -- 172.21.15.157:0/1239681031 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72940146c0 con 0x7f729c0b0390 2024-04-18T03:41:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c0b5990 con 0x7f729c0b0390 2024-04-18T03:41:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c0676b0 con 0x7f729c0b0390 2024-04-18T03:41:10.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f7292ffd700 1 -- 172.21.15.157:0/1239681031 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7294014820 con 0x7f729c0b0390 2024-04-18T03:41:10.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f7292ffd700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7280066730 0x7f7280068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:10.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f7292ffd700 1 -- 172.21.15.157:0/1239681031 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7294084dc0 con 0x7f729c0b0390 2024-04-18T03:41:10.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.751+0000 7f72a2190700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7280066730 0x7f7280068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:10.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.755+0000 7f72a2190700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7280066730 0x7f7280068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f728c009b70 tx=0x7f728c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:10.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.759+0000 7f7292ffd700 1 -- 172.21.15.157:0/1239681031 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7294051d70 con 0x7f729c0b0390 2024-04-18T03:41:10.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.927+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f729c04e6c0 con 0x7f729c0b0390 2024-04-18T03:41:10.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.931+0000 7f7292ffd700 1 -- 172.21.15.157:0/1239681031 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7f7294018020 con 0x7f729c0b0390 2024-04-18T03:41:10.936 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:10.936 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:41:10.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7280066730 msgr2=0x7f7280068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7280066730 0x7f7280068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f728c009b70 tx=0x7f728c009240 comp rx=0 tx=0).stop 2024-04-18T03:41:10.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c0b0390 msgr2=0x7f729c163bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c0b0390 0x7f729c163bc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d30 tx=0x7f729400c3a0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 shutdown_connections 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7280066730 0x7f7280068bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f729c0ceaf0 0x7f729c1fa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f729c0b0390 0x7f729c163bc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 --2- 172.21.15.157:0/1239681031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f729c06caf0 0x7f729c0b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 >> 172.21.15.157:0/1239681031 conn(0x7f729c0d1000 msgr2=0x7f729c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 shutdown_connections 2024-04-18T03:41:10.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:10.935+0000 7f72a43f4700 1 -- 172.21.15.157:0/1239681031 wait complete. 2024-04-18T03:41:10.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:41:10.952 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:41:11.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.067+0000 7f6d83fff700 1 Processor -- start 2024-04-18T03:41:11.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.067+0000 7f6d83fff700 1 -- start start 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d840adf00 0x7f6d84071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d8415a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8415bef0 con 0x7f6d8415aaa0 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d84071b40 con 0x7f6d840adf00 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840ae2e0 con 0x7f6d840716c0 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d837fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6d8415aaa0 0x7f6d8415db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47032/0 (socket says 172.21.15.157:47032) 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d837fe700 1 -- 172.21.15.157:0/2045972876 learned_addr learned my addr 172.21.15.157:0/2045972876 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d7a7fc700 1 --2- 172.21.15.157:0/2045972876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d8415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d82ffd700 1 --2- 172.21.15.157:0/2045972876 >> v2:172.21.15.175:3300/0 conn(0x7f6d840adf00 0x7f6d84071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d827fc700 1 -- 172.21.15.157:0/2045972876 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007125252 0 0) 0x7f6d8415bef0 con 0x7f6d8415aaa0 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d827fc700 1 -- 172.21.15.157:0/2045972876 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d700035d0 con 0x7f6d8415aaa0 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d7a7fc700 1 -- 172.21.15.157:0/2045972876 >> v2:172.21.15.175:3300/0 conn(0x7f6d840adf00 msgr2=0x7f6d84071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d7a7fc700 1 --2- 172.21.15.157:0/2045972876 >> v2:172.21.15.175:3300/0 conn(0x7f6d840adf00 0x7f6d84071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d7a7fc700 1 -- 172.21.15.157:0/2045972876 >> v1:172.21.15.157:6789/0 conn(0x7f6d8415aaa0 legacy=0x7f6d8415db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d7a7fc700 1 -- 172.21.15.157:0/2045972876 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8415b2c0 con 0x7f6d840716c0 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d82ffd700 1 --2- 172.21.15.157:0/2045972876 >> v2:172.21.15.175:3300/0 conn(0x7f6d840adf00 0x7f6d84071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d7a7fc700 1 --2- 172.21.15.157:0/2045972876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d8415a560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c009850 tx=0x7f6d6c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=421daff54da0863c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d827fc700 1 -- 172.21.15.157:0/2045972876 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c011830 con 0x7f6d840716c0 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d827fc700 1 -- 172.21.15.157:0/2045972876 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c011990 con 0x7f6d840716c0 2024-04-18T03:41:11.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d827fc700 1 -- 172.21.15.157:0/2045972876 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c011d40 con 0x7f6d840716c0 2024-04-18T03:41:11.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 -- 172.21.15.157:0/2045972876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 msgr2=0x7f6d8415a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 --2- 172.21.15.157:0/2045972876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d8415a560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c009850 tx=0x7f6d6c009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 -- 172.21.15.157:0/2045972876 shutdown_connections 2024-04-18T03:41:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 --2- 172.21.15.157:0/2045972876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d8415a560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 --2- 172.21.15.157:0/2045972876 >> v2:172.21.15.175:3300/0 conn(0x7f6d840adf00 0x7f6d84071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 -- 172.21.15.157:0/2045972876 >> 172.21.15.157:0/2045972876 conn(0x7f6d840b12d0 msgr2=0x7f6d8406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.071+0000 7f6d83fff700 1 -- 172.21.15.157:0/2045972876 shutdown_connections 2024-04-18T03:41:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 -- 172.21.15.157:0/2045972876 wait complete. 2024-04-18T03:41:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 Processor -- start 2024-04-18T03:41:11.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 -- start start 2024-04-18T03:41:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d84151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840adf00 0x7f6d841558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d8415aaa0 0x7f6d841f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d841f3c10 con 0x7f6d8415aaa0 2024-04-18T03:41:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d84155fb0 con 0x7f6d840adf00 2024-04-18T03:41:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d84156290 con 0x7f6d840716c0 2024-04-18T03:41:11.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d8415aaa0 0x7f6d841f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d8415aaa0 0x7f6d841f36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40782/0 (socket says 172.21.15.157:40782) 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 -- 172.21.15.157:0/3947502161 learned_addr learned my addr 172.21.15.157:0/3947502161 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d82ffd700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d84151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d7a7fc700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840adf00 0x7f6d841558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 -- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 msgr2=0x7f6d84151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d84151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 -- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840adf00 msgr2=0x7f6d841558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840adf00 0x7f6d841558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 -- 172.21.15.157:0/3947502161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740094b0 con 0x7f6d8415aaa0 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d837fe700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d8415aaa0 0x7f6d841f36d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00caa0 tx=0x7f6d7c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d80ff9700 1 -- 172.21.15.157:0/3947502161 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c007480 con 0x7f6d8415aaa0 2024-04-18T03:41:11.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d80ff9700 1 -- 172.21.15.157:0/3947502161 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0075e0 con 0x7f6d8415aaa0 2024-04-18T03:41:11.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d80ff9700 1 -- 172.21.15.157:0/3947502161 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c007970 con 0x7f6d8415aaa0 2024-04-18T03:41:11.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c0094b0 con 0x7f6d8415aaa0 2024-04-18T03:41:11.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.075+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d84156850 con 0x7f6d8415aaa0 2024-04-18T03:41:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.079+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8404e650 con 0x7f6d8415aaa0 2024-04-18T03:41:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.079+0000 7f6d80ff9700 1 -- 172.21.15.157:0/3947502161 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d7c01b3b0 con 0x7f6d8415aaa0 2024-04-18T03:41:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.079+0000 7f6d80ff9700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d64066730 0x7f6d64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.079+0000 7f6d80ff9700 1 -- 172.21.15.157:0/3947502161 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d7c083f40 con 0x7f6d8415aaa0 2024-04-18T03:41:11.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.079+0000 7f6d82ffd700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d64066730 0x7f6d64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.079+0000 7f6d82ffd700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d64066730 0x7f6d64068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009d80 tx=0x7f6d74009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.087+0000 7f6d80ff9700 1 -- 172.21.15.157:0/3947502161 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6d7c050de0 con 0x7f6d8415aaa0 2024-04-18T03:41:11.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.251+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d8406f040 con 0x7f6d8415aaa0 2024-04-18T03:41:11.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.255+0000 7f6d80ff9700 1 -- 172.21.15.157:0/3947502161 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d7c017020 con 0x7f6d8415aaa0 2024-04-18T03:41:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:41:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d64066730 msgr2=0x7f6d64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d64066730 0x7f6d64068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009d80 tx=0x7f6d74009240 comp rx=0 tx=0).stop 2024-04-18T03:41:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d8415aaa0 msgr2=0x7f6d841f36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d8415aaa0 0x7f6d841f36d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00caa0 tx=0x7f6d7c00cad0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 shutdown_connections 2024-04-18T03:41:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d64066730 0x7f6d64068bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840adf00 0x7f6d841558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d8415aaa0 0x7f6d841f36d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 --2- 172.21.15.157:0/3947502161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d840716c0 0x7f6d84151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 >> 172.21.15.157:0/3947502161 conn(0x7f6d840b12d0 msgr2=0x7f6d840accb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 shutdown_connections 2024-04-18T03:41:11.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.259+0000 7f6d83fff700 1 -- 172.21.15.157:0/3947502161 wait complete. 2024-04-18T03:41:11.277 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:41:11.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.387+0000 7f6e8a873700 1 Processor -- start 2024-04-18T03:41:11.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.387+0000 7f6e8a873700 1 -- start start 2024-04-18T03:41:11.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.387+0000 7f6e8a873700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 0x7f6e8406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.387+0000 7f6e8a873700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e84162010 0x7f6e840b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.387+0000 7f6e8a873700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e840b25e0 con 0x7f6e84161bb0 2024-04-18T03:41:11.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.387+0000 7f6e8a873700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e840ce8c0 con 0x7f6e84162010 2024-04-18T03:41:11.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.387+0000 7f6e8a873700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8406f130 con 0x7f6e8406e810 2024-04-18T03:41:11.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6e84161bb0 0x7f6e840cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47040/0 (socket says 172.21.15.157:47040) 2024-04-18T03:41:11.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 -- 172.21.15.157:0/354220775 learned_addr learned my addr 172.21.15.157:0/354220775 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a072700 1 --2- 172.21.15.157:0/354220775 >> v2:172.21.15.175:3300/0 conn(0x7f6e84162010 0x7f6e840b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89871700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 0x7f6e8406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249451999 0 0) 0x7f6e840b25e0 con 0x7f6e84161bb0 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e700035d0 con 0x7f6e84161bb0 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1580081176 0 0) 0x7f6e700035d0 con 0x7f6e84161bb0 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 msgr2=0x7f6e8406ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 0x7f6e8406ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 >> v2:172.21.15.175:3300/0 conn(0x7f6e84162010 msgr2=0x7f6e840b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:11.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 --2- 172.21.15.157:0/354220775 >> v2:172.21.15.175:3300/0 conn(0x7f6e84162010 0x7f6e840b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8414aa60 con 0x7f6e84161bb0 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7f6e80001670 con 0x7f6e84161bb0 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 >> v1:172.21.15.157:6789/0 conn(0x7f6e84161bb0 legacy=0x7f6e840cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e70003a20 0x7f6e70003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e70004870 0x7f6e70004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 0x7f6e70005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840ce8c0 con 0x7f6e70004870 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8406f130 con 0x7f6e70003a20 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7000ba30 con 0x7f6e8406e810 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e70004870 0x7f6e70004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a072700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 0x7f6e70005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89871700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e70003a20 0x7f6e70003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 -- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 msgr2=0x7f6e70005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 0x7f6e70005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 -- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e70003a20 msgr2=0x7f6e70003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e70003a20 0x7f6e70003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 -- 172.21.15.157:0/354220775 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e700035d0 con 0x7f6e70004870 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a072700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e8406e810 0x7f6e70005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89871700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e70003a20 0x7f6e70003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e89070700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e70004870 0x7f6e70004cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000c350 tx=0x7f6e700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db5014e35fff981 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8000ce50 con 0x7f6e70004870 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80005980 con 0x7f6e70004870 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8886f700 1 -- 172.21.15.157:0/354220775 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80005d30 con 0x7f6e70004870 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a873700 1 -- 172.21.15.157:0/354220775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e70004870 msgr2=0x7f6e70004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a873700 1 --2- 172.21.15.157:0/354220775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e70004870 0x7f6e70004cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000c350 tx=0x7f6e700058a0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a072700 1 -- 172.21.15.157:0/354220775 reap_dead start 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a873700 1 -- 172.21.15.157:0/354220775 shutdown_connections 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a873700 1 -- 172.21.15.157:0/354220775 >> 172.21.15.157:0/354220775 conn(0x7f6e840b12d0 msgr2=0x7f6e8406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a873700 1 -- 172.21.15.157:0/354220775 shutdown_connections 2024-04-18T03:41:11.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.391+0000 7f6e8a873700 1 -- 172.21.15.157:0/354220775 wait complete. 2024-04-18T03:41:11.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 Processor -- start 2024-04-18T03:41:11.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 -- start start 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e70004870 0x7f6e84160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e84160d20 0x7f6e840cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e8413e750 0x7f6e8413ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8413e190 con 0x7f6e84160d20 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8413f110 con 0x7f6e8413e750 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840cb830 con 0x7f6e70004870 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e84160d20 0x7f6e840cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e84160d20 0x7f6e840cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40804/0 (socket says 172.21.15.157:40804) 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 -- 172.21.15.157:0/2193872455 learned_addr learned my addr 172.21.15.157:0/2193872455 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89871700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e70004870 0x7f6e84160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a072700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e8413e750 0x7f6e8413ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 -- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e70004870 msgr2=0x7f6e84160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e70004870 0x7f6e84160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 -- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e8413e750 msgr2=0x7f6e8413ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e8413e750 0x7f6e8413ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 -- 172.21.15.157:0/2193872455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e841611a0 con 0x7f6e84160d20 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e89070700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e84160d20 0x7f6e840cb2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6e80008fd0 tx=0x7f6e80001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e7a7fc700 1 -- 172.21.15.157:0/2193872455 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80001660 con 0x7f6e84160d20 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e7a7fc700 1 -- 172.21.15.157:0/2193872455 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80004aa0 con 0x7f6e84160d20 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e840cba60 con 0x7f6e84160d20 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e7a7fc700 1 -- 172.21.15.157:0/2193872455 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80004e50 con 0x7f6e84160d20 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e84140b50 con 0x7f6e84160d20 2024-04-18T03:41:11.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.395+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8404e650 con 0x7f6e84160d20 2024-04-18T03:41:11.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.399+0000 7f6e7a7fc700 1 -- 172.21.15.157:0/2193872455 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e800070d0 con 0x7f6e84160d20 2024-04-18T03:41:11.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.399+0000 7f6e7a7fc700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6e68066760 0x7f6e68068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.399+0000 7f6e7a7fc700 1 -- 172.21.15.157:0/2193872455 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6e80085b00 con 0x7f6e84160d20 2024-04-18T03:41:11.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.399+0000 7f6e89871700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6e68066760 0x7f6e68068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.399+0000 7f6e89871700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6e68066760 0x7f6e68068c20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009a70 tx=0x7f6e74008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.407+0000 7f6e7a7fc700 1 -- 172.21.15.157:0/2193872455 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6e80087e60 con 0x7f6e84160d20 2024-04-18T03:41:11.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.571+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e84148610 con 0x7f6e84160d20 2024-04-18T03:41:11.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e7a7fc700 1 -- 172.21.15.157:0/2193872455 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e80052bc0 con 0x7f6e84160d20 2024-04-18T03:41:11.578 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:11.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6e68066760 msgr2=0x7f6e68068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6e68066760 0x7f6e68068c20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009a70 tx=0x7f6e74008040 comp rx=0 tx=0).stop 2024-04-18T03:41:11.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e84160d20 msgr2=0x7f6e840cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e84160d20 0x7f6e840cb2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6e80008fd0 tx=0x7f6e80001a00 comp rx=0 tx=0).stop 2024-04-18T03:41:11.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 shutdown_connections 2024-04-18T03:41:11.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6e68066760 0x7f6e68068c20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e8413e750 0x7f6e8413ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e84160d20 0x7f6e840cb2f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 --2- 172.21.15.157:0/2193872455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e70004870 0x7f6e84160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 >> 172.21.15.157:0/2193872455 conn(0x7f6e840b12d0 msgr2=0x7f6e84147b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:11.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 shutdown_connections 2024-04-18T03:41:11.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.575+0000 7f6e8a873700 1 -- 172.21.15.157:0/2193872455 wait complete. 2024-04-18T03:41:11.592 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:41:11.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.707+0000 7efdab59e700 1 Processor -- start 2024-04-18T03:41:11.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.707+0000 7efdab59e700 1 -- start start 2024-04-18T03:41:11.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efdac165da0 0x7efdac168190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac06a770 con 0x7efdac161660 2024-04-18T03:41:11.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac06aa50 con 0x7efdac071080 2024-04-18T03:41:11.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdac06ad30 con 0x7efdac165da0 2024-04-18T03:41:11.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdaad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efdac165da0 0x7efdac168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efda9d9b700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7efdac161660 0x7efdac06c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47050/0 (socket says 172.21.15.157:47050) 2024-04-18T03:41:11.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efda9d9b700 1 -- 172.21.15.157:0/4238703995 learned_addr learned my addr 172.21.15.157:0/4238703995 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:11.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdaad9d700 1 -- 172.21.15.157:0/4238703995 >> v1:172.21.15.175:6789/0 conn(0x7efdac071080 legacy=0x7efdac071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdaad9d700 1 -- 172.21.15.157:0/4238703995 >> v1:172.21.15.157:6789/0 conn(0x7efdac161660 legacy=0x7efdac06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdaad9d700 1 -- 172.21.15.157:0/4238703995 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac06b010 con 0x7efdac165da0 2024-04-18T03:41:11.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdaad9d700 1 --2- 172.21.15.157:0/4238703995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac165da0 0x7efdac168190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efda4009d90 tx=0x7efda400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d4f373be247b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efda959a700 1 -- 172.21.15.157:0/4238703995 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda400e070 con 0x7efdac165da0 2024-04-18T03:41:11.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efda959a700 1 -- 172.21.15.157:0/4238703995 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda400bbd0 con 0x7efdac165da0 2024-04-18T03:41:11.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efda959a700 1 -- 172.21.15.157:0/4238703995 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4012430 con 0x7efdac165da0 2024-04-18T03:41:11.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 -- 172.21.15.157:0/4238703995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac165da0 msgr2=0x7efdac168190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 --2- 172.21.15.157:0/4238703995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac165da0 0x7efdac168190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efda4009d90 tx=0x7efda400b330 comp rx=0 tx=0).stop 2024-04-18T03:41:11.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 -- 172.21.15.157:0/4238703995 shutdown_connections 2024-04-18T03:41:11.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 --2- 172.21.15.157:0/4238703995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac165da0 0x7efdac168190 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 -- 172.21.15.157:0/4238703995 >> 172.21.15.157:0/4238703995 conn(0x7efdac06e020 msgr2=0x7efdac06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:11.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 -- 172.21.15.157:0/4238703995 shutdown_connections 2024-04-18T03:41:11.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.711+0000 7efdab59e700 1 -- 172.21.15.157:0/4238703995 wait complete. 2024-04-18T03:41:11.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdab59e700 1 Processor -- start 2024-04-18T03:41:11.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdab59e700 1 -- start start 2024-04-18T03:41:11.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdab59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac071080 0x7efdac168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdab59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdac161660 0x7efdac14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdab59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdac165da0 0x7efdac150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdab59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac15e380 con 0x7efdac071080 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdab59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1671d0 con 0x7efdac161660 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdab59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1674b0 con 0x7efdac165da0 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.715+0000 7efdaa59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac071080 0x7efdac168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaa59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac071080 0x7efdac168060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40820/0 (socket says 172.21.15.157:40820) 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaa59c700 1 -- 172.21.15.157:0/3206206379 learned_addr learned my addr 172.21.15.157:0/3206206379 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efda9d9b700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdac161660 0x7efdac14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaad9d700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdac165da0 0x7efdac150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaa59c700 1 -- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdac165da0 msgr2=0x7efdac150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaa59c700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdac165da0 0x7efdac150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaa59c700 1 -- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdac161660 msgr2=0x7efdac14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaa59c700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdac161660 0x7efdac14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaa59c700 1 -- 172.21.15.157:0/3206206379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda4009a70 con 0x7efdac071080 2024-04-18T03:41:11.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdaa59c700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac071080 0x7efdac168060 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efda000c410 tx=0x7efda000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efd9affd700 1 -- 172.21.15.157:0/3206206379 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00052d0 con 0x7efdac071080 2024-04-18T03:41:11.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efd9affd700 1 -- 172.21.15.157:0/3206206379 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0005450 con 0x7efdac071080 2024-04-18T03:41:11.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac167790 con 0x7efdac071080 2024-04-18T03:41:11.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efd9affd700 1 -- 172.21.15.157:0/3206206379 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00038e0 con 0x7efdac071080 2024-04-18T03:41:11.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac150c80 con 0x7efdac071080 2024-04-18T03:41:11.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.719+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac15de70 con 0x7efdac071080 2024-04-18T03:41:11.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.723+0000 7efd9affd700 1 -- 172.21.15.157:0/3206206379 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efda0003a40 con 0x7efdac071080 2024-04-18T03:41:11.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.723+0000 7efd9affd700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efd8c066730 0x7efd8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:11.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.723+0000 7efd9affd700 1 -- 172.21.15.157:0/3206206379 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efda0083850 con 0x7efdac071080 2024-04-18T03:41:11.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.723+0000 7efda9d9b700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efd8c066730 0x7efd8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:11.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.723+0000 7efda9d9b700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efd8c066730 0x7efd8c068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efdac1686a0 tx=0x7efd9c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:11.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.731+0000 7efd9affd700 1 -- 172.21.15.157:0/3206206379 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7efdac15de70 con 0x7efdac071080 2024-04-18T03:41:11.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.899+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efdac15de70 con 0x7efdac071080 2024-04-18T03:41:11.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.899+0000 7efd9affd700 1 -- 172.21.15.157:0/3206206379 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdac15de70 con 0x7efdac071080 2024-04-18T03:41:11.904 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:41:11.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efd8c066730 msgr2=0x7efd8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efd8c066730 0x7efd8c068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efdac1686a0 tx=0x7efd9c009040 comp rx=0 tx=0).stop 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac071080 msgr2=0x7efdac168060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac071080 0x7efdac168060 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efda000c410 tx=0x7efda000c720 comp rx=0 tx=0).stop 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 shutdown_connections 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7efd8c066730 0x7efd8c068bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdac161660 0x7efdac14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdac165da0 0x7efdac150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 --2- 172.21.15.157:0/3206206379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efdac071080 0x7efdac168060 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 >> 172.21.15.157:0/3206206379 conn(0x7efdac06e020 msgr2=0x7efdac06e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 shutdown_connections 2024-04-18T03:41:11.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:11.903+0000 7efdab59e700 1 -- 172.21.15.157:0/3206206379 wait complete. 2024-04-18T03:41:11.919 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:41:12.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe93caa4700 1 Processor -- start 2024-04-18T03:41:12.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe93caa4700 1 -- start start 2024-04-18T03:41:12.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe93caa4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe9380cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe93caa4700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93815d3d0 con 0x7fe938159560 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe93caa4700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93815d6b0 con 0x7fe9380cb540 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe93caa4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93815e190 con 0x7fe9380ce1c0 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe9377fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe938159560 0x7fe9380cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:47058/0 (socket says 172.21.15.157:47058) 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe9377fe700 1 -- 172.21.15.157:0/2638206522 learned_addr learned my addr 172.21.15.157:0/2638206522 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe92ffff700 1 --2- 172.21.15.157:0/2638206522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe9380cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe936ffd700 1 -- 172.21.15.157:0/2638206522 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628935609 0 0) 0x7fe93815d3d0 con 0x7fe938159560 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe936ffd700 1 -- 172.21.15.157:0/2638206522 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9180057e0 con 0x7fe938159560 2024-04-18T03:41:12.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe92ffff700 1 -- 172.21.15.157:0/2638206522 >> v1:172.21.15.175:6789/0 conn(0x7fe9380cb540 legacy=0x7fe938070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe936ffd700 1 -- 172.21.15.157:0/2638206522 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246448746 0 0) 0x7fe93815d6b0 con 0x7fe9380cb540 2024-04-18T03:41:12.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe92ffff700 1 -- 172.21.15.157:0/2638206522 >> v1:172.21.15.157:6789/0 conn(0x7fe938159560 legacy=0x7fe9380cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe92ffff700 1 -- 172.21.15.157:0/2638206522 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93815d990 con 0x7fe9380ce1c0 2024-04-18T03:41:12.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe92ffff700 1 --2- 172.21.15.157:0/2638206522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe9380cc1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe920009880 tx=0x7fe920009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5bb8bbe00bb6686 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:12.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe936ffd700 1 -- 172.21.15.157:0/2638206522 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920011830 con 0x7fe9380ce1c0 2024-04-18T03:41:12.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe936ffd700 1 -- 172.21.15.157:0/2638206522 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920011990 con 0x7fe9380ce1c0 2024-04-18T03:41:12.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.031+0000 7fe936ffd700 1 -- 172.21.15.157:0/2638206522 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920011d20 con 0x7fe9380ce1c0 2024-04-18T03:41:12.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 -- 172.21.15.157:0/2638206522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 msgr2=0x7fe9380cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 --2- 172.21.15.157:0/2638206522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe9380cc1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe920009880 tx=0x7fe920009b90 comp rx=0 tx=0).stop 2024-04-18T03:41:12.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 -- 172.21.15.157:0/2638206522 shutdown_connections 2024-04-18T03:41:12.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 --2- 172.21.15.157:0/2638206522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe9380cc1a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 -- 172.21.15.157:0/2638206522 >> 172.21.15.157:0/2638206522 conn(0x7fe9380b12d0 msgr2=0x7fe93806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:12.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 -- 172.21.15.157:0/2638206522 shutdown_connections 2024-04-18T03:41:12.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 -- 172.21.15.157:0/2638206522 wait complete. 2024-04-18T03:41:12.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 Processor -- start 2024-04-18T03:41:12.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.035+0000 7fe93caa4700 1 -- start start 2024-04-18T03:41:12.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9380cb540 0x7fe938151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe93814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe938159560 0x7fe93814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93815b310 con 0x7fe9380cb540 2024-04-18T03:41:12.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93815bbb0 con 0x7fe938159560 2024-04-18T03:41:12.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93814ed30 con 0x7fe9380ce1c0 2024-04-18T03:41:12.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9380cb540 0x7fe938151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9380cb540 0x7fe938151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:40836/0 (socket says 172.21.15.157:40836) 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 -- 172.21.15.157:0/1586492602 learned_addr learned my addr 172.21.15.157:0/1586492602 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe92ffff700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe93814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe937fff700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe938159560 0x7fe93814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 -- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 msgr2=0x7fe93814c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe93814c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 -- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe938159560 msgr2=0x7fe93814e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe938159560 0x7fe93814e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 -- 172.21.15.157:0/1586492602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9200094b0 con 0x7fe9380cb540 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe9377fe700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9380cb540 0x7fe938151020 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c4d0 tx=0x7fe92800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe934ff9700 1 -- 172.21.15.157:0/1586492602 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928005d90 con 0x7fe9380cb540 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe934ff9700 1 -- 172.21.15.157:0/1586492602 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92800ce80 con 0x7fe9380cb540 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93815b560 con 0x7fe9380cb540 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe934ff9700 1 -- 172.21.15.157:0/1586492602 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280072d0 con 0x7fe9380cb540 2024-04-18T03:41:12.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe938151560 con 0x7fe9380cb540 2024-04-18T03:41:12.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.039+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9380676b0 con 0x7fe9380cb540 2024-04-18T03:41:12.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.043+0000 7fe934ff9700 1 -- 172.21.15.157:0/1586492602 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe928007430 con 0x7fe9380cb540 2024-04-18T03:41:12.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.043+0000 7fe934ff9700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe91c066730 0x7fe91c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.043+0000 7fe934ff9700 1 -- 172.21.15.157:0/1586492602 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe928083c10 con 0x7fe9380cb540 2024-04-18T03:41:12.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.043+0000 7fe92ffff700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe91c066730 0x7fe91c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.043+0000 7fe92ffff700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe91c066730 0x7fe91c068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe9200090b0 tx=0x7fe92001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:12.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.047+0000 7fe934ff9700 1 -- 172.21.15.157:0/1586492602 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe928050cc0 con 0x7fe9380cb540 2024-04-18T03:41:12.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe93804e650 con 0x7fe9380cb540 2024-04-18T03:41:12.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe934ff9700 1 -- 172.21.15.157:0/1586492602 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe9280170a0 con 0x7fe9380cb540 2024-04-18T03:41:12.218 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:12.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe91c066730 msgr2=0x7fe91c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe91c066730 0x7fe91c068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe9200090b0 tx=0x7fe92001c040 comp rx=0 tx=0).stop 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9380cb540 msgr2=0x7fe938151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9380cb540 0x7fe938151020 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c4d0 tx=0x7fe92800c7e0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 shutdown_connections 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe91c066730 0x7fe91c068bf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe938159560 0x7fe93814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9380ce1c0 0x7fe93814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 --2- 172.21.15.157:0/1586492602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9380cb540 0x7fe938151020 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 >> 172.21.15.157:0/1586492602 conn(0x7fe9380b12d0 msgr2=0x7fe93806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 shutdown_connections 2024-04-18T03:41:12.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.215+0000 7fe93caa4700 1 -- 172.21.15.157:0/1586492602 wait complete. 2024-04-18T03:41:12.233 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:41:12.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6902308700 1 Processor -- start 2024-04-18T03:41:12.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6902308700 1 -- start start 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6902308700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc13ff90 0x7f68fc15df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6902308700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68fc15d680 0x7f68fc071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6902308700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc0719f0 con 0x7f68fc0715c0 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6902308700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc1425f0 con 0x7f68fc15d680 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6902308700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15e440 con 0x7f68fc13ff90 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6900b05700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68fc15d680 0x7f68fc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6900b05700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68fc15d680 0x7f68fc071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47204/0 (socket says 172.21.15.157:47204) 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6900b05700 1 -- 172.21.15.157:0/4239000596 learned_addr learned my addr 172.21.15.157:0/4239000596 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6901306700 1 --2- 172.21.15.157:0/4239000596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc13ff90 0x7f68fc15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6900b05700 1 -- 172.21.15.157:0/4239000596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc13ff90 msgr2=0x7f68fc15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6900b05700 1 --2- 172.21.15.157:0/4239000596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc13ff90 0x7f68fc15df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6900b05700 1 -- 172.21.15.157:0/4239000596 >> v1:172.21.15.175:6789/0 conn(0x7f68fc0715c0 legacy=0x7f68fc160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6900b05700 1 -- 172.21.15.157:0/4239000596 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc142890 con 0x7f68fc15d680 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.343+0000 7f6900b05700 1 --2- 172.21.15.157:0/4239000596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc071080 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009910 tx=0x7f68f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff54d6e0389b8f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f68f3fff700 1 -- 172.21.15.157:0/4239000596 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8011830 con 0x7f68fc15d680 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f68f3fff700 1 -- 172.21.15.157:0/4239000596 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f8011990 con 0x7f68fc15d680 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f68f3fff700 1 -- 172.21.15.157:0/4239000596 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8011d40 con 0x7f68fc15d680 2024-04-18T03:41:12.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 -- 172.21.15.157:0/4239000596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 msgr2=0x7f68fc071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 --2- 172.21.15.157:0/4239000596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc071080 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009910 tx=0x7f68f8009c20 comp rx=0 tx=0).stop 2024-04-18T03:41:12.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 -- 172.21.15.157:0/4239000596 shutdown_connections 2024-04-18T03:41:12.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 --2- 172.21.15.157:0/4239000596 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc071080 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 --2- 172.21.15.157:0/4239000596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc13ff90 0x7f68fc15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 -- 172.21.15.157:0/4239000596 >> 172.21.15.157:0/4239000596 conn(0x7f68fc06e2e0 msgr2=0x7f68fc06e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:12.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 -- 172.21.15.157:0/4239000596 shutdown_connections 2024-04-18T03:41:12.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 -- 172.21.15.157:0/4239000596 wait complete. 2024-04-18T03:41:12.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 Processor -- start 2024-04-18T03:41:12.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.347+0000 7f6902308700 1 -- start start 2024-04-18T03:41:12.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6902308700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0715c0 0x7f68fc1f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6902308700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc13ff90 0x7f68fc15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6902308700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6902308700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15fce0 con 0x7f68fc15d680 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6902308700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15f0d0 con 0x7f68fc13ff90 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6902308700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15f3b0 con 0x7f68fc0715c0 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47212/0 (socket says 172.21.15.157:47212) 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6900b05700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc13ff90 0x7f68fc15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901306700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0715c0 0x7f68fc1f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 -- 172.21.15.157:0/3943382616 learned_addr learned my addr 172.21.15.157:0/3943382616 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 -- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0715c0 msgr2=0x7f68fc1f31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0715c0 0x7f68fc1f31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 -- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc13ff90 msgr2=0x7f68fc15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc13ff90 0x7f68fc15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 -- 172.21.15.157:0/3943382616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8009570 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901306700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0715c0 0x7f68fc1f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6901b07700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc140bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f68f400cc50 tx=0x7f68f400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f68f1ffb700 1 -- 172.21.15.157:0/3943382616 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4003c20 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f68f1ffb700 1 -- 172.21.15.157:0/3943382616 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4003d80 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc15f690 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f68f1ffb700 1 -- 172.21.15.157:0/3943382616 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400aab0 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.351+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc1f2aa0 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.355+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc15fe50 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.355+0000 7f68f1ffb700 1 -- 172.21.15.157:0/3943382616 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68f400ac10 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.355+0000 7f68f1ffb700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68e0066730 0x7f68e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.355+0000 7f68f1ffb700 1 -- 172.21.15.157:0/3943382616 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f68f40844d0 con 0x7f68fc15d680 2024-04-18T03:41:12.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.355+0000 7f6901306700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68e0066730 0x7f68e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:12.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.355+0000 7f6901306700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68e0066730 0x7f68e0068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0112c0 tx=0x7f68ec009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:12.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.363+0000 7f68f1ffb700 1 -- 172.21.15.157:0/3943382616 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f68f4051480 con 0x7f68fc15d680 2024-04-18T03:41:12.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f68fc04e650 con 0x7f68fc15d680 2024-04-18T03:41:12.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f68f1ffb700 1 -- 172.21.15.157:0/3943382616 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f68f4054aa0 con 0x7f68fc15d680 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68e0066730 msgr2=0x7f68e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68e0066730 0x7f68e0068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0112c0 tx=0x7f68ec009240 comp rx=0 tx=0).stop 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 msgr2=0x7f68fc140bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc140bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f68f400cc50 tx=0x7f68f400cf60 comp rx=0 tx=0).stop 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 shutdown_connections 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f68e0066730 0x7f68e0068bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc13ff90 0x7f68fc15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68fc15d680 0x7f68fc140bf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 --2- 172.21.15.157:0/3943382616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0715c0 0x7f68fc1f31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.551+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 >> 172.21.15.157:0/3943382616 conn(0x7f68fc06e2e0 msgr2=0x7f68fc070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.555+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 shutdown_connections 2024-04-18T03:41:12.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:12.555+0000 7f6902308700 1 -- 172.21.15.157:0/3943382616 wait complete. 2024-04-18T03:41:12.558 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:41:12.569 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2024-04-18T03:41:12.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:12.570 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-18T03:41:12.601 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[31127]: fuse finished with error 0 and tester_r 0 2024-04-18T03:41:12.603 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:41:18.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:41:18.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:18.705 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-18T03:41:18.724 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:41:18.724 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:41:18.775 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:41:18.775 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:41:18.783 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:41:18.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71dde6700 1 Processor -- start 2024-04-18T03:41:18.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71dde6700 1 -- start start 2024-04-18T03:41:18.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71dde6700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb718159680 0x7fb7180cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:18.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71dde6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7180cc020 0x7fb7180cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:18.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71dde6700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb718071180 con 0x7fb7180cdfd0 2024-04-18T03:41:18.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71dde6700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71806ef20 con 0x7fb718159680 2024-04-18T03:41:18.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71dde6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180b2f20 con 0x7fb7180cc020 2024-04-18T03:41:18.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71d5e5700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb7180cdfd0 0x7fb71806e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34676/0 (socket says 172.21.15.157:34676) 2024-04-18T03:41:18.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71d5e5700 1 -- 172.21.15.157:0/991889716 learned_addr learned my addr 172.21.15.157:0/991889716 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:18.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb71cde4700 1 --2- 172.21.15.157:0/991889716 >> v2:172.21.15.175:3300/0 conn(0x7fb718159680 0x7fb7180cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:18.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.903+0000 7fb717fff700 1 --2- 172.21.15.157:0/991889716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7180cc020 0x7fb7180cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:18.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb7177fe700 1 -- 172.21.15.157:0/991889716 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778753796 0 0) 0x7fb718071180 con 0x7fb7180cdfd0 2024-04-18T03:41:18.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb7177fe700 1 -- 172.21.15.157:0/991889716 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7080035d0 con 0x7fb7180cdfd0 2024-04-18T03:41:18.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb717fff700 1 -- 172.21.15.157:0/991889716 >> v2:172.21.15.175:3300/0 conn(0x7fb718159680 msgr2=0x7fb7180cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:18.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb717fff700 1 --2- 172.21.15.157:0/991889716 >> v2:172.21.15.175:3300/0 conn(0x7fb718159680 0x7fb7180cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:18.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb717fff700 1 -- 172.21.15.157:0/991889716 >> v1:172.21.15.157:6789/0 conn(0x7fb7180cdfd0 legacy=0x7fb71806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:18.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb717fff700 1 -- 172.21.15.157:0/991889716 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180b2310 con 0x7fb7180cc020 2024-04-18T03:41:18.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71cde4700 1 --2- 172.21.15.157:0/991889716 >> v2:172.21.15.175:3300/0 conn(0x7fb718159680 0x7fb7180cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:18.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb717fff700 1 --2- 172.21.15.157:0/991889716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7180cc020 0x7fb7180cda90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009850 tx=0x7fb70c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a33cb37541253f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:18.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb7177fe700 1 -- 172.21.15.157:0/991889716 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c011830 con 0x7fb7180cc020 2024-04-18T03:41:18.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb7177fe700 1 -- 172.21.15.157:0/991889716 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c011990 con 0x7fb7180cc020 2024-04-18T03:41:18.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb7177fe700 1 -- 172.21.15.157:0/991889716 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c011d40 con 0x7fb7180cc020 2024-04-18T03:41:18.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 -- 172.21.15.157:0/991889716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7180cc020 msgr2=0x7fb7180cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:18.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 --2- 172.21.15.157:0/991889716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7180cc020 0x7fb7180cda90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009850 tx=0x7fb70c009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:18.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 -- 172.21.15.157:0/991889716 shutdown_connections 2024-04-18T03:41:18.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 --2- 172.21.15.157:0/991889716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7180cc020 0x7fb7180cda90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:18.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 --2- 172.21.15.157:0/991889716 >> v2:172.21.15.175:3300/0 conn(0x7fb718159680 0x7fb7180cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:18.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 -- 172.21.15.157:0/991889716 >> 172.21.15.157:0/991889716 conn(0x7fb7180b1330 msgr2=0x7fb71806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:18.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 -- 172.21.15.157:0/991889716 shutdown_connections 2024-04-18T03:41:18.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 -- 172.21.15.157:0/991889716 wait complete. 2024-04-18T03:41:18.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 Processor -- start 2024-04-18T03:41:18.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.907+0000 7fb71dde6700 1 -- start start 2024-04-18T03:41:18.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71dde6700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7180cc020 0x7fb71813f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:18.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71dde6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7180cdfd0 0x7fb718159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:18.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71dde6700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb718159680 0x7fb71815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:18.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71dde6700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71813eb90 con 0x7fb7180cc020 2024-04-18T03:41:18.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71dde6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71815ab80 con 0x7fb7180cdfd0 2024-04-18T03:41:18.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71dde6700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71815ae60 con 0x7fb718159680 2024-04-18T03:41:18.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7180cc020 0x7fb71813f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:18.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7180cc020 0x7fb71813f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47222/0 (socket says 172.21.15.157:47222) 2024-04-18T03:41:18.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 -- 172.21.15.157:0/1237638779 learned_addr learned my addr 172.21.15.157:0/1237638779 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:18.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71d5e5700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb718159680 0x7fb71815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:18.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb717fff700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7180cdfd0 0x7fb718159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:18.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 -- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb718159680 msgr2=0x7fb71815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:18.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb718159680 0x7fb71815a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:18.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 -- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7180cdfd0 msgr2=0x7fb718159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:18.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7180cdfd0 0x7fb718159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:18.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 -- 172.21.15.157:0/1237638779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7040094b0 con 0x7fb7180cc020 2024-04-18T03:41:18.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71cde4700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7180cc020 0x7fb71813f0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb70400ebe0 tx=0x7fb704009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:18.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb7157fa700 1 -- 172.21.15.157:0/1237638779 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400c8b0 con 0x7fb7180cc020 2024-04-18T03:41:18.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb7157fa700 1 -- 172.21.15.157:0/1237638779 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70400ca10 con 0x7fb7180cc020 2024-04-18T03:41:18.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c0094b0 con 0x7fb7180cc020 2024-04-18T03:41:18.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb7157fa700 1 -- 172.21.15.157:0/1237638779 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400cda0 con 0x7fb7180cc020 2024-04-18T03:41:18.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.911+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71815b420 con 0x7fb7180cc020 2024-04-18T03:41:18.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.915+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71804e650 con 0x7fb7180cc020 2024-04-18T03:41:18.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.915+0000 7fb7157fa700 1 -- 172.21.15.157:0/1237638779 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb704013470 con 0x7fb7180cc020 2024-04-18T03:41:18.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.915+0000 7fb7157fa700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb6fc066730 0x7fb6fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:18.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.915+0000 7fb7157fa700 1 -- 172.21.15.157:0/1237638779 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb704084650 con 0x7fb7180cc020 2024-04-18T03:41:18.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.915+0000 7fb717fff700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb6fc066730 0x7fb6fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:18.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.915+0000 7fb717fff700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb6fc066730 0x7fb6fc068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0090b0 tx=0x7fb70c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:18.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:18.923+0000 7fb7157fa700 1 -- 172.21.15.157:0/1237638779 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb7040515f0 con 0x7fb7180cc020 2024-04-18T03:41:19.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.095+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7180acde0 con 0x7fb7180cc020 2024-04-18T03:41:19.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb7157fa700 1 -- 172.21.15.157:0/1237638779 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7fb704054c10 con 0x7fb7180cc020 2024-04-18T03:41:19.102 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:19.102 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:41:19.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb6fc066730 msgr2=0x7fb6fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb6fc066730 0x7fb6fc068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0090b0 tx=0x7fb70c008030 comp rx=0 tx=0).stop 2024-04-18T03:41:19.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7180cc020 msgr2=0x7fb71813f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7180cc020 0x7fb71813f0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb70400ebe0 tx=0x7fb704009e30 comp rx=0 tx=0).stop 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 shutdown_connections 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb6fc066730 0x7fb6fc068bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7180cdfd0 0x7fb718159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb718159680 0x7fb71815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 --2- 172.21.15.157:0/1237638779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb7180cc020 0x7fb71813f0a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 >> 172.21.15.157:0/1237638779 conn(0x7fb7180b1330 msgr2=0x7fb718071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 shutdown_connections 2024-04-18T03:41:19.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.099+0000 7fb71dde6700 1 -- 172.21.15.157:0/1237638779 wait complete. 2024-04-18T03:41:19.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:41:19.119 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:41:19.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2983184700 1 Processor -- start 2024-04-18T03:41:19.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2983184700 1 -- start start 2024-04-18T03:41:19.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2983184700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f297c15cee0 0x7f297c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2983184700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c0b3590 con 0x7f297c15d2c0 2024-04-18T03:41:19.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2983184700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c0b3860 con 0x7f297c06bcf0 2024-04-18T03:41:19.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2983184700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297c0b4900 con 0x7f297c15cee0 2024-04-18T03:41:19.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981981700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f297c15d2c0 0x7f297c06b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34678/0 (socket says 172.21.15.157:34678) 2024-04-18T03:41:19.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981981700 1 -- 172.21.15.157:0/3349618473 learned_addr learned my addr 172.21.15.157:0/3349618473 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:19.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982182700 1 --2- 172.21.15.157:0/3349618473 >> v2:172.21.15.175:3300/0 conn(0x7f297c15cee0 0x7f297c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025518653 0 0) 0x7f297c0b3590 con 0x7f297c15d2c0 2024-04-18T03:41:19.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29640035d0 con 0x7f297c15d2c0 2024-04-18T03:41:19.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 917660346 0 0) 0x7f29640035d0 con 0x7f297c15d2c0 2024-04-18T03:41:19.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 >> v2:172.21.15.175:3300/0 conn(0x7f297c15cee0 msgr2=0x7f297c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:19.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 --2- 172.21.15.157:0/3349618473 >> v2:172.21.15.175:3300/0 conn(0x7f297c15cee0 0x7f297c0b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 >> v1:172.21.15.175:6789/0 conn(0x7f297c06bcf0 legacy=0x7f297c166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0b3b40 con 0x7f297c15d2c0 2024-04-18T03:41:19.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7f29700019f0 con 0x7f297c15d2c0 2024-04-18T03:41:19.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 >> v1:172.21.15.157:6789/0 conn(0x7f297c15d2c0 legacy=0x7f297c06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2964003a20 0x7f2964003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964004870 0x7f2964004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2964005230 0x7f296400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c0b4900 con 0x7f2964005230 2024-04-18T03:41:19.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296400c1d0 con 0x7f2964004870 2024-04-18T03:41:19.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296400c390 con 0x7f2964003a20 2024-04-18T03:41:19.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982983700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2964005230 0x7f296400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981981700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964004870 0x7f2964004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982182700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2964003a20 0x7f2964003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982983700 1 -- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2964003a20 msgr2=0x7f2964003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:19.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982983700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2964003a20 0x7f2964003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982983700 1 -- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964004870 msgr2=0x7f2964004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:19.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982983700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964004870 0x7f2964004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982983700 1 -- 172.21.15.157:0/3349618473 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29640035d0 con 0x7f2964005230 2024-04-18T03:41:19.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982182700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2964003a20 0x7f2964003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:19.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982983700 1 -- 172.21.15.157:0/3349618473 reap_dead start 2024-04-18T03:41:19.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2982983700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2964005230 0x7f296400ba30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f296c0017e0 tx=0x7f29640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eacb8400036c616 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.235+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c0052d0 con 0x7f2964005230 2024-04-18T03:41:19.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c005430 con 0x7f2964005230 2024-04-18T03:41:19.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2981180700 1 -- 172.21.15.157:0/3349618473 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c0055a0 con 0x7f2964005230 2024-04-18T03:41:19.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- 172.21.15.157:0/3349618473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2964005230 msgr2=0x7f296400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2964005230 0x7f296400ba30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f296c0017e0 tx=0x7f29640058a0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- 172.21.15.157:0/3349618473 shutdown_connections 2024-04-18T03:41:19.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 --2- 172.21.15.157:0/3349618473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2964005230 0x7f296400ba30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- 172.21.15.157:0/3349618473 >> 172.21.15.157:0/3349618473 conn(0x7f297c0b1920 msgr2=0x7f297c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:19.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- 172.21.15.157:0/3349618473 shutdown_connections 2024-04-18T03:41:19.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- 172.21.15.157:0/3349618473 wait complete. 2024-04-18T03:41:19.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 Processor -- start 2024-04-18T03:41:19.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- start start 2024-04-18T03:41:19.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964005230 0x7f297c1418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c1f1e30 0x7f297c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c151040 0x7f297c140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c141e20 con 0x7f297c1f1e30 2024-04-18T03:41:19.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c13f290 con 0x7f2964005230 2024-04-18T03:41:19.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2983184700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297c13f570 con 0x7f297c151040 2024-04-18T03:41:19.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2981981700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c1f1e30 0x7f297c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2982983700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c151040 0x7f297c140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2982182700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964005230 0x7f297c1418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2982182700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964005230 0x7f297c1418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:51966/0 (socket says 172.21.15.157:51966) 2024-04-18T03:41:19.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2982182700 1 -- 172.21.15.157:0/2694628640 learned_addr learned my addr 172.21.15.157:0/2694628640 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:19.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2981981700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c1f1e30 0x7f297c150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47236/0 (socket says 172.21.15.157:47236) 2024-04-18T03:41:19.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.239+0000 7f2982983700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c151040 0x7f297c140330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:36414/0 (socket says 172.21.15.157:36414) 2024-04-18T03:41:19.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2981981700 1 -- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c151040 msgr2=0x7f297c140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2981981700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c151040 0x7f297c140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2981981700 1 -- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964005230 msgr2=0x7f297c1418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2981981700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964005230 0x7f297c1418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2981981700 1 -- 172.21.15.157:0/2694628640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c13f850 con 0x7f297c1f1e30 2024-04-18T03:41:19.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2981981700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c1f1e30 0x7f297c150b00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2970000f80 tx=0x7f2970001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f297affd700 1 -- 172.21.15.157:0/2694628640 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000aa70 con 0x7f297c1f1e30 2024-04-18T03:41:19.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f297affd700 1 -- 172.21.15.157:0/2694628640 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000abd0 con 0x7f297c1f1e30 2024-04-18T03:41:19.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c13fb30 con 0x7f297c1f1e30 2024-04-18T03:41:19.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f297affd700 1 -- 172.21.15.157:0/2694628640 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29700133f0 con 0x7f297c1f1e30 2024-04-18T03:41:19.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c15b860 con 0x7f297c1f1e30 2024-04-18T03:41:19.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c06d7a0 con 0x7f297c1f1e30 2024-04-18T03:41:19.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f297affd700 1 -- 172.21.15.157:0/2694628640 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2970013550 con 0x7f297c1f1e30 2024-04-18T03:41:19.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.243+0000 7f297affd700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2968066760 0x7f2968068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.247+0000 7f297affd700 1 -- 172.21.15.157:0/2694628640 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2970084e80 con 0x7f297c1f1e30 2024-04-18T03:41:19.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.247+0000 7f2982182700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2968066760 0x7f2968068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.247+0000 7f2982182700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2968066760 0x7f2968068c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2974009210 tx=0x7f2974008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.251+0000 7f297affd700 1 -- 172.21.15.157:0/2694628640 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2970051e30 con 0x7f297c1f1e30 2024-04-18T03:41:19.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.423+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f297c04e650 con 0x7f297c1f1e30 2024-04-18T03:41:19.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.423+0000 7f297affd700 1 -- 172.21.15.157:0/2694628640 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2970017070 con 0x7f297c1f1e30 2024-04-18T03:41:19.428 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:41:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2968066760 msgr2=0x7f2968068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2968066760 0x7f2968068c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2974009210 tx=0x7f2974008040 comp rx=0 tx=0).stop 2024-04-18T03:41:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c1f1e30 msgr2=0x7f297c150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c1f1e30 0x7f297c150b00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2970000f80 tx=0x7f2970001a00 comp rx=0 tx=0).stop 2024-04-18T03:41:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 shutdown_connections 2024-04-18T03:41:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2968066760 0x7f2968068c20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c151040 0x7f297c140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f297c1f1e30 0x7f297c150b00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 --2- 172.21.15.157:0/2694628640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2964005230 0x7f297c1418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 >> 172.21.15.157:0/2694628640 conn(0x7f297c0b1920 msgr2=0x7f297c157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:19.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 shutdown_connections 2024-04-18T03:41:19.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.427+0000 7f2983184700 1 -- 172.21.15.157:0/2694628640 wait complete. 2024-04-18T03:41:19.443 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:41:19.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.559+0000 7fe6d3fff700 1 Processor -- start 2024-04-18T03:41:19.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.559+0000 7fe6d3fff700 1 -- start start 2024-04-18T03:41:19.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6d4143500 0x7fe6d40b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe6d406ef20 0x7fe6d40abd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d40b2690 con 0x7fe6d40ab8c0 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d40ad530 con 0x7fe6d406ef20 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d415dcb0 con 0x7fe6d4143500 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d37fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe6d406ef20 0x7fe6d40abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d37fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe6d406ef20 0x7fe6d40abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47240/0 (socket says 172.21.15.157:47240) 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d37fe700 1 -- 172.21.15.157:0/4089093521 learned_addr learned my addr 172.21.15.157:0/4089093521 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d2ffd700 1 --2- 172.21.15.157:0/4089093521 >> v2:172.21.15.175:3300/0 conn(0x7fe6d4143500 0x7fe6d40b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d37fe700 1 -- 172.21.15.157:0/4089093521 >> v2:172.21.15.175:3300/0 conn(0x7fe6d4143500 msgr2=0x7fe6d40b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d37fe700 1 --2- 172.21.15.157:0/4089093521 >> v2:172.21.15.175:3300/0 conn(0x7fe6d4143500 0x7fe6d40b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d37fe700 1 -- 172.21.15.157:0/4089093521 >> v1:172.21.15.175:6789/0 conn(0x7fe6d40ab8c0 legacy=0x7fe6d406e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d37fe700 1 -- 172.21.15.157:0/4089093521 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d415df90 con 0x7fe6d406ef20 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d37fe700 1 --2- 172.21.15.157:0/4089093521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d40abd70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe6d406f3a0 tx=0x7fe6cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec61014bf7ccce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d1ffb700 1 -- 172.21.15.157:0/4089093521 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00e070 con 0x7fe6d406ef20 2024-04-18T03:41:19.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d1ffb700 1 -- 172.21.15.157:0/4089093521 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc003a40 con 0x7fe6d406ef20 2024-04-18T03:41:19.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d1ffb700 1 -- 172.21.15.157:0/4089093521 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc003df0 con 0x7fe6d406ef20 2024-04-18T03:41:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 -- 172.21.15.157:0/4089093521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 msgr2=0x7fe6d40abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/4089093521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d40abd70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe6d406f3a0 tx=0x7fe6cc00b330 comp rx=0 tx=0).stop 2024-04-18T03:41:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 -- 172.21.15.157:0/4089093521 shutdown_connections 2024-04-18T03:41:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/4089093521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d40abd70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/4089093521 >> v2:172.21.15.175:3300/0 conn(0x7fe6d4143500 0x7fe6d40b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 -- 172.21.15.157:0/4089093521 >> 172.21.15.157:0/4089093521 conn(0x7fe6d40b12d0 msgr2=0x7fe6d406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 -- 172.21.15.157:0/4089093521 shutdown_connections 2024-04-18T03:41:19.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.563+0000 7fe6d3fff700 1 -- 172.21.15.157:0/4089093521 wait complete. 2024-04-18T03:41:19.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d3fff700 1 Processor -- start 2024-04-18T03:41:19.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d3fff700 1 -- start start 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d41f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d40ab8c0 0x7fe6d41575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d4143500 0x7fe6d41418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d3fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d40c4940 con 0x7fe6d406ef20 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d3fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d415aa10 con 0x7fe6d4143500 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d3fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d41f3390 con 0x7fe6d40ab8c0 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.567+0000 7fe6d2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d41f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d2ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d41f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47246/0 (socket says 172.21.15.157:47246) 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d2ffd700 1 -- 172.21.15.157:0/282588690 learned_addr learned my addr 172.21.15.157:0/282588690 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:19.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d27fc700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d40ab8c0 0x7fe6d41575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d37fe700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d4143500 0x7fe6d41418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d2ffd700 1 -- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d40ab8c0 msgr2=0x7fe6d41575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d2ffd700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d40ab8c0 0x7fe6d41575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d2ffd700 1 -- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d4143500 msgr2=0x7fe6d41418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d2ffd700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d4143500 0x7fe6d41418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d2ffd700 1 -- 172.21.15.157:0/282588690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc009b30 con 0x7fe6d406ef20 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d2ffd700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d41f2e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400e760 tx=0x7fe6c400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6cbfff700 1 -- 172.21.15.157:0/282588690 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4013610 con 0x7fe6d406ef20 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6cbfff700 1 -- 172.21.15.157:0/282588690 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4013770 con 0x7fe6d406ef20 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d4157b00 con 0x7fe6d406ef20 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6cbfff700 1 -- 172.21.15.157:0/282588690 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4013ae0 con 0x7fe6d406ef20 2024-04-18T03:41:19.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d415b1e0 con 0x7fe6d406ef20 2024-04-18T03:41:19.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d415ad30 con 0x7fe6d406ef20 2024-04-18T03:41:19.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.571+0000 7fe6cbfff700 1 -- 172.21.15.157:0/282588690 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe6c4013c40 con 0x7fe6d406ef20 2024-04-18T03:41:19.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.575+0000 7fe6cbfff700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe6b4066730 0x7fe6b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.575+0000 7fe6cbfff700 1 -- 172.21.15.157:0/282588690 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe6c4083ff0 con 0x7fe6d406ef20 2024-04-18T03:41:19.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.575+0000 7fe6d27fc700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe6b4066730 0x7fe6b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.575+0000 7fe6d27fc700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe6b4066730 0x7fe6b4068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40b0690 tx=0x7fe6bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.579+0000 7fe6cbfff700 1 -- 172.21.15.157:0/282588690 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fe6c4050ff0 con 0x7fe6d406ef20 2024-04-18T03:41:19.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.743+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6d4157b00 con 0x7fe6d406ef20 2024-04-18T03:41:19.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.743+0000 7fe6cbfff700 1 -- 172.21.15.157:0/282588690 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6c4021020 con 0x7fe6d406ef20 2024-04-18T03:41:19.748 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:19.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe6b4066730 msgr2=0x7fe6b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe6b4066730 0x7fe6b4068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40b0690 tx=0x7fe6bc008040 comp rx=0 tx=0).stop 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 msgr2=0x7fe6d41f2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d41f2e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400e760 tx=0x7fe6c400eb20 comp rx=0 tx=0).stop 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 shutdown_connections 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fe6b4066730 0x7fe6b4068bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d4143500 0x7fe6d41418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d40ab8c0 0x7fe6d41575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 --2- 172.21.15.157:0/282588690 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe6d406ef20 0x7fe6d41f2e50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 >> 172.21.15.157:0/282588690 conn(0x7fe6d40b12d0 msgr2=0x7fe6d4070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 shutdown_connections 2024-04-18T03:41:19.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.747+0000 7fe6d3fff700 1 -- 172.21.15.157:0/282588690 wait complete. 2024-04-18T03:41:19.768 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:41:19.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.879+0000 7f686b59e700 1 Processor -- start 2024-04-18T03:41:19.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.879+0000 7f686b59e700 1 -- start start 2024-04-18T03:41:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f686c161660 0x7f686c06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f686c0d12b0 0x7f686c0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c06a770 con 0x7f686c071080 2024-04-18T03:41:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c06aa50 con 0x7f686c0d12b0 2024-04-18T03:41:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c06ad30 con 0x7f686c161660 2024-04-18T03:41:19.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686ad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f686c0d12b0 0x7f686c0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686ad9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f686c0d12b0 0x7f686c0d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47256/0 (socket says 172.21.15.157:47256) 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686ad9d700 1 -- 172.21.15.157:0/2584774396 learned_addr learned my addr 172.21.15.157:0/2584774396 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f6869d9b700 1 --2- 172.21.15.157:0/2584774396 >> v2:172.21.15.175:3300/0 conn(0x7f686c161660 0x7f686c06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686ad9d700 1 -- 172.21.15.157:0/2584774396 >> v2:172.21.15.175:3300/0 conn(0x7f686c161660 msgr2=0x7f686c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686ad9d700 1 --2- 172.21.15.157:0/2584774396 >> v2:172.21.15.175:3300/0 conn(0x7f686c161660 0x7f686c06c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686ad9d700 1 -- 172.21.15.157:0/2584774396 >> v1:172.21.15.175:6789/0 conn(0x7f686c071080 legacy=0x7f686c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686ad9d700 1 -- 172.21.15.157:0/2584774396 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c06b010 con 0x7f686c0d12b0 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f6869d9b700 1 --2- 172.21.15.157:0/2584774396 >> v2:172.21.15.175:3300/0 conn(0x7f686c161660 0x7f686c06c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686ad9d700 1 --2- 172.21.15.157:0/2584774396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c0d12b0 0x7f686c0d1740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f686c0b7670 tx=0x7f686400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce71f91fff70c780 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686959a700 1 -- 172.21.15.157:0/2584774396 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400e070 con 0x7f686c0d12b0 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686959a700 1 -- 172.21.15.157:0/2584774396 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686400b9c0 con 0x7f686c0d12b0 2024-04-18T03:41:19.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686959a700 1 -- 172.21.15.157:0/2584774396 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400bd70 con 0x7f686c0d12b0 2024-04-18T03:41:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 -- 172.21.15.157:0/2584774396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c0d12b0 msgr2=0x7f686c0d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 --2- 172.21.15.157:0/2584774396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c0d12b0 0x7f686c0d1740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f686c0b7670 tx=0x7f686400b330 comp rx=0 tx=0).stop 2024-04-18T03:41:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 -- 172.21.15.157:0/2584774396 shutdown_connections 2024-04-18T03:41:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 --2- 172.21.15.157:0/2584774396 >> v2:172.21.15.175:3300/0 conn(0x7f686c161660 0x7f686c06c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 --2- 172.21.15.157:0/2584774396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c0d12b0 0x7f686c0d1740 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 -- 172.21.15.157:0/2584774396 >> 172.21.15.157:0/2584774396 conn(0x7f686c06e020 msgr2=0x7f686c06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 -- 172.21.15.157:0/2584774396 shutdown_connections 2024-04-18T03:41:19.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.883+0000 7f686b59e700 1 -- 172.21.15.157:0/2584774396 wait complete. 2024-04-18T03:41:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 Processor -- start 2024-04-18T03:41:19.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 -- start start 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f686c071080 0x7f686c144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f686c0d12b0 0x7f686c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c161660 0x7f686c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c141580 con 0x7f686c161660 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c159700 con 0x7f686c071080 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c143b60 con 0x7f686c0d12b0 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c161660 0x7f686c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f6869d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f686c0d12b0 0x7f686c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f686c071080 0x7f686c144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f686c071080 0x7f686c144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:52004/0 (socket says 172.21.15.157:52004) 2024-04-18T03:41:19.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c161660 0x7f686c154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47262/0 (socket says 172.21.15.157:47262) 2024-04-18T03:41:19.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f6869d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f686c0d12b0 0x7f686c154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:36426/0 (socket says 172.21.15.157:36426) 2024-04-18T03:41:19.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 -- 172.21.15.157:0/3822181077 learned_addr learned my addr 172.21.15.157:0/3822181077 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 -- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f686c0d12b0 msgr2=0x7f686c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f686c0d12b0 0x7f686c154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 -- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f686c071080 msgr2=0x7f686c144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f686c071080 0x7f686c144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 -- 172.21.15.157:0/3822181077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6864009b30 con 0x7f686c161660 2024-04-18T03:41:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686ad9d700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c161660 0x7f686c154590 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f686400b730 tx=0x7f6864004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f685affd700 1 -- 172.21.15.157:0/3822181077 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68640048b0 con 0x7f686c161660 2024-04-18T03:41:19.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f685affd700 1 -- 172.21.15.157:0/3822181077 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68640092e0 con 0x7f686c161660 2024-04-18T03:41:19.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c154bc0 con 0x7f686c161660 2024-04-18T03:41:19.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f685affd700 1 -- 172.21.15.157:0/3822181077 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686401c680 con 0x7f686c161660 2024-04-18T03:41:19.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.887+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c155180 con 0x7f686c161660 2024-04-18T03:41:19.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.891+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c159890 con 0x7f686c161660 2024-04-18T03:41:19.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.891+0000 7f685affd700 1 -- 172.21.15.157:0/3822181077 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f686401c7e0 con 0x7f686c161660 2024-04-18T03:41:19.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.891+0000 7f685affd700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:19.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.891+0000 7f685affd700 1 -- 172.21.15.157:0/3822181077 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6864086150 con 0x7f686c161660 2024-04-18T03:41:19.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.891+0000 7f686a59c700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:19.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.895+0000 7f686a59c700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f684c066730 0x7f684c068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f68600018a0 tx=0x7f6860009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:19.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:19.903+0000 7f685affd700 1 -- 172.21.15.157:0/3822181077 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f68640530f0 con 0x7f686c161660 2024-04-18T03:41:20.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.067+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f686c04e650 con 0x7f686c161660 2024-04-18T03:41:20.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f685affd700 1 -- 172.21.15.157:0/3822181077 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6864056710 con 0x7f686c161660 2024-04-18T03:41:20.073 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f684c066730 msgr2=0x7f684c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f684c066730 0x7f684c068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f68600018a0 tx=0x7f6860009040 comp rx=0 tx=0).stop 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c161660 msgr2=0x7f686c154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c161660 0x7f686c154590 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f686400b730 tx=0x7f6864004af0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 shutdown_connections 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f684c066730 0x7f684c068bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f686c161660 0x7f686c154590 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f686c0d12b0 0x7f686c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 --2- 172.21.15.157:0/3822181077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f686c071080 0x7f686c144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 >> 172.21.15.157:0/3822181077 conn(0x7f686c06e020 msgr2=0x7f686c158210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 shutdown_connections 2024-04-18T03:41:20.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.071+0000 7f686b59e700 1 -- 172.21.15.157:0/3822181077 wait complete. 2024-04-18T03:41:20.088 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:41:20.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.199+0000 7f5220aad700 1 Processor -- start 2024-04-18T03:41:20.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.199+0000 7f5220aad700 1 -- start start 2024-04-18T03:41:20.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c070a80 0x7f521c0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c070fb0 con 0x7f521c15b030 2024-04-18T03:41:20.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c071290 con 0x7f521c0cb9c0 2024-04-18T03:41:20.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c071c30 con 0x7f521c070a80 2024-04-18T03:41:20.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521b7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f521c15b030 0x7f521c0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34694/0 (socket says 172.21.15.157:34694) 2024-04-18T03:41:20.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521b7fe700 1 -- 172.21.15.157:0/3164663759 learned_addr learned my addr 172.21.15.157:0/3164663759 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521affd700 1 --2- 172.21.15.157:0/3164663759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c070a80 0x7f521c0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521a7fc700 1 -- 172.21.15.157:0/3164663759 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462443897 0 0) 0x7f521c070fb0 con 0x7f521c15b030 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521a7fc700 1 -- 172.21.15.157:0/3164663759 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52040035d0 con 0x7f521c15b030 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521a7fc700 1 -- 172.21.15.157:0/3164663759 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272298182 0 0) 0x7f521c071290 con 0x7f521c0cb9c0 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521a7fc700 1 -- 172.21.15.157:0/3164663759 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f521c070fb0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521affd700 1 -- 172.21.15.157:0/3164663759 >> v1:172.21.15.175:6789/0 conn(0x7f521c0cb9c0 legacy=0x7f521c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521affd700 1 -- 172.21.15.157:0/3164663759 >> v1:172.21.15.157:6789/0 conn(0x7f521c15b030 legacy=0x7f521c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521a7fc700 1 -- 172.21.15.157:0/3164663759 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4183208790 0 0) 0x7f52040035d0 con 0x7f521c15b030 2024-04-18T03:41:20.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521affd700 1 -- 172.21.15.157:0/3164663759 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c071570 con 0x7f521c070a80 2024-04-18T03:41:20.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521affd700 1 --2- 172.21.15.157:0/3164663759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c070a80 0x7f521c0cb480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5210009880 tx=0x7f5210009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65105bea9603502 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521a7fc700 1 -- 172.21.15.157:0/3164663759 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c001670 con 0x7f521c070a80 2024-04-18T03:41:20.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521a7fc700 1 -- 172.21.15.157:0/3164663759 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210004030 con 0x7f521c070a80 2024-04-18T03:41:20.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f521a7fc700 1 -- 172.21.15.157:0/3164663759 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100043c0 con 0x7f521c070a80 2024-04-18T03:41:20.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 -- 172.21.15.157:0/3164663759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c070a80 msgr2=0x7f521c0cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 --2- 172.21.15.157:0/3164663759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c070a80 0x7f521c0cb480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5210009880 tx=0x7f5210009b90 comp rx=0 tx=0).stop 2024-04-18T03:41:20.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 -- 172.21.15.157:0/3164663759 shutdown_connections 2024-04-18T03:41:20.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 --2- 172.21.15.157:0/3164663759 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c070a80 0x7f521c0cb480 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 -- 172.21.15.157:0/3164663759 >> 172.21.15.157:0/3164663759 conn(0x7f521c0d0c20 msgr2=0x7f521c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:20.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 -- 172.21.15.157:0/3164663759 shutdown_connections 2024-04-18T03:41:20.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.203+0000 7f5220aad700 1 -- 172.21.15.157:0/3164663759 wait complete. 2024-04-18T03:41:20.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f5220aad700 1 Processor -- start 2024-04-18T03:41:20.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f5220aad700 1 -- start start 2024-04-18T03:41:20.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f5220aad700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f521c070a80 0x7f521c14d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f5220aad700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f521c0cb9c0 0x7f521c0c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f5220aad700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c15b030 0x7f521c0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f5220aad700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0c57f0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f5220aad700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0c5ad0 con 0x7f521c070a80 2024-04-18T03:41:20.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f5220aad700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0c5db0 con 0x7f521c15b030 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f521affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f521c0cb9c0 0x7f521c0c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f521affd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f521c0cb9c0 0x7f521c0c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47270/0 (socket says 172.21.15.157:47270) 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f521affd700 1 -- 172.21.15.157:0/2653685696 learned_addr learned my addr 172.21.15.157:0/2653685696 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.207+0000 7f521bfff700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c15b030 0x7f521c0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f521b7fe700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f521c070a80 0x7f521c14d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f521affd700 1 -- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c15b030 msgr2=0x7f521c0c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f521affd700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c15b030 0x7f521c0c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f521affd700 1 -- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f521c070a80 msgr2=0x7f521c14d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f521affd700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f521c070a80 0x7f521c14d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f521affd700 1 -- 172.21.15.157:0/2653685696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100094b0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f521affd700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f521c0cb9c0 0x7f521c0c6890 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f52100097d0 tx=0x7f5210004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f5203fff700 1 -- 172.21.15.157:0/2653685696 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210003c50 con 0x7f521c0cb9c0 2024-04-18T03:41:20.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c0c6090 con 0x7f521c0cb9c0 2024-04-18T03:41:20.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f5203fff700 1 -- 172.21.15.157:0/2653685696 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210003db0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f5203fff700 1 -- 172.21.15.157:0/2653685696 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210011870 con 0x7f521c0cb9c0 2024-04-18T03:41:20.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c14d650 con 0x7f521c0cb9c0 2024-04-18T03:41:20.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c0c65b0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f5203fff700 1 -- 172.21.15.157:0/2653685696 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5210018050 con 0x7f521c0cb9c0 2024-04-18T03:41:20.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.211+0000 7f5203fff700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5208066730 0x7f5208068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.215+0000 7f5203fff700 1 -- 172.21.15.157:0/2653685696 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5210084ea0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.215+0000 7f521b7fe700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5208066730 0x7f5208068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.215+0000 7f521b7fe700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5208066730 0x7f5208068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f520c000f60 tx=0x7f520c001670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.223+0000 7f5203fff700 1 -- 172.21.15.157:0/2653685696 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f521c0c65b0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.383+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f521c0c65b0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.383+0000 7f5203fff700 1 -- 172.21.15.157:0/2653685696 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f521c0c65b0 con 0x7f521c0cb9c0 2024-04-18T03:41:20.390 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:20.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5208066730 msgr2=0x7f5208068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5208066730 0x7f5208068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f520c000f60 tx=0x7f520c001670 comp rx=0 tx=0).stop 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f521c0cb9c0 msgr2=0x7f521c0c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f521c0cb9c0 0x7f521c0c6890 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f52100097d0 tx=0x7f5210004770 comp rx=0 tx=0).stop 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 shutdown_connections 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5208066730 0x7f5208068bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f521c15b030 0x7f521c0c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f521c0cb9c0 0x7f521c0c6890 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 --2- 172.21.15.157:0/2653685696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f521c070a80 0x7f521c14d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 >> 172.21.15.157:0/2653685696 conn(0x7f521c0d0c20 msgr2=0x7f521c0c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 shutdown_connections 2024-04-18T03:41:20.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.387+0000 7f5220aad700 1 -- 172.21.15.157:0/2653685696 wait complete. 2024-04-18T03:41:20.402 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:41:20.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.507+0000 7f41ab2cb700 1 Processor -- start 2024-04-18T03:41:20.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.507+0000 7f41ab2cb700 1 -- start start 2024-04-18T03:41:20.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41a41613b0 0x7f41a4167fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a406a960 con 0x7f41a415d390 2024-04-18T03:41:20.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a406af20 con 0x7f41a415cfb0 2024-04-18T03:41:20.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a4071500 con 0x7f41a41613b0 2024-04-18T03:41:20.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41aaaca700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41a41613b0 0x7f41a4167fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41a9ac8700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f41a415d390 0x7f41a4160ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34702/0 (socket says 172.21.15.157:34702) 2024-04-18T03:41:20.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41aaaca700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41a41613b0 0x7f41a4167fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47274/0 (socket says 172.21.15.157:47274) 2024-04-18T03:41:20.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41a9ac8700 1 -- 172.21.15.157:0/258086431 learned_addr learned my addr 172.21.15.157:0/258086431 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:20.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41aaaca700 1 -- 172.21.15.157:0/258086431 >> v1:172.21.15.175:6789/0 conn(0x7f41a415cfb0 legacy=0x7f41a4070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41aaaca700 1 -- 172.21.15.157:0/258086431 >> v1:172.21.15.157:6789/0 conn(0x7f41a415d390 legacy=0x7f41a4160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41aaaca700 1 -- 172.21.15.157:0/258086431 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a40717e0 con 0x7f41a41613b0 2024-04-18T03:41:20.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41a92c7700 1 -- 172.21.15.157:0/258086431 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201885472 0 0) 0x7f41a406a960 con 0x7f41a415d390 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41aaaca700 1 --2- 172.21.15.157:0/258086431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a41613b0 0x7f41a4167fd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f419c009d90 tx=0x7f419c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806081597e183df3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41a92c7700 1 -- 172.21.15.157:0/258086431 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00e070 con 0x7f41a41613b0 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41a92c7700 1 -- 172.21.15.157:0/258086431 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00bbd0 con 0x7f41a41613b0 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41a92c7700 1 -- 172.21.15.157:0/258086431 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c012430 con 0x7f41a41613b0 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 -- 172.21.15.157:0/258086431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a41613b0 msgr2=0x7f41a4167fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 --2- 172.21.15.157:0/258086431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a41613b0 0x7f41a4167fd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f419c009d90 tx=0x7f419c00b330 comp rx=0 tx=0).stop 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 -- 172.21.15.157:0/258086431 shutdown_connections 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 --2- 172.21.15.157:0/258086431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a41613b0 0x7f41a4167fd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 -- 172.21.15.157:0/258086431 >> 172.21.15.157:0/258086431 conn(0x7f41a40d0ae0 msgr2=0x7f41a40d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 -- 172.21.15.157:0/258086431 shutdown_connections 2024-04-18T03:41:20.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.511+0000 7f41ab2cb700 1 -- 172.21.15.157:0/258086431 wait complete. 2024-04-18T03:41:20.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41ab2cb700 1 Processor -- start 2024-04-18T03:41:20.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41ab2cb700 1 -- start start 2024-04-18T03:41:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41ab2cb700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a415cfb0 0x7f41a415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41ab2cb700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a415d390 0x7f41a41f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41ab2cb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a41613b0 0x7f41a415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41ab2cb700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a415e990 con 0x7f41a415d390 2024-04-18T03:41:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41ab2cb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a41f6f50 con 0x7f41a41613b0 2024-04-18T03:41:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41ab2cb700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a415dd80 con 0x7f41a415cfb0 2024-04-18T03:41:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a415d390 0x7f41a41f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a415d390 0x7f41a41f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47280/0 (socket says 172.21.15.157:47280) 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 -- 172.21.15.157:0/2730411001 learned_addr learned my addr 172.21.15.157:0/2730411001 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41aaaca700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a41613b0 0x7f41a415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41aa2c9700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a415cfb0 0x7f41a415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 -- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a415cfb0 msgr2=0x7f41a415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a415cfb0 0x7f41a415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 -- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a41613b0 msgr2=0x7f41a415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a41613b0 0x7f41a415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 -- 172.21.15.157:0/2730411001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c009a70 con 0x7f41a415d390 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41aaaca700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a41613b0 0x7f41a415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.515+0000 7f41a9ac8700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a415d390 0x7f41a41f6a10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f419400c520 tx=0x7f419400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f419affd700 1 -- 172.21.15.157:0/2730411001 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194004ca0 con 0x7f41a415d390 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f419affd700 1 -- 172.21.15.157:0/2730411001 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4194004e20 con 0x7f41a415d390 2024-04-18T03:41:20.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f419affd700 1 -- 172.21.15.157:0/2730411001 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4194007310 con 0x7f41a415d390 2024-04-18T03:41:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a415e060 con 0x7f41a415d390 2024-04-18T03:41:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a415e620 con 0x7f41a415d390 2024-04-18T03:41:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f419affd700 1 -- 172.21.15.157:0/2730411001 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4194007470 con 0x7f41a415d390 2024-04-18T03:41:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a40d18b0 con 0x7f41a415d390 2024-04-18T03:41:20.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f419affd700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4188066730 0x7f4188068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f419affd700 1 -- 172.21.15.157:0/2730411001 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4194084230 con 0x7f41a415d390 2024-04-18T03:41:20.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f41aa2c9700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4188066730 0x7f4188068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.519+0000 7f41aa2c9700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4188066730 0x7f4188068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f41a0000f60 tx=0x7f41a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.527+0000 7f419affd700 1 -- 172.21.15.157:0/2730411001 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f4194051150 con 0x7f41a415d390 2024-04-18T03:41:20.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41a404e650 con 0x7f41a415d390 2024-04-18T03:41:20.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f419affd700 1 -- 172.21.15.157:0/2730411001 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4194007720 con 0x7f41a415d390 2024-04-18T03:41:20.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4188066730 msgr2=0x7f4188068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4188066730 0x7f4188068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f41a0000f60 tx=0x7f41a0009040 comp rx=0 tx=0).stop 2024-04-18T03:41:20.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a415d390 msgr2=0x7f41a41f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a415d390 0x7f41a41f6a10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f419400c520 tx=0x7f419400c830 comp rx=0 tx=0).stop 2024-04-18T03:41:20.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 shutdown_connections 2024-04-18T03:41:20.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4188066730 0x7f4188068bf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a41613b0 0x7f41a415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41a415d390 0x7f41a41f6a10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 --2- 172.21.15.157:0/2730411001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a415cfb0 0x7f41a415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.707+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 >> 172.21.15.157:0/2730411001 conn(0x7f41a40d0ae0 msgr2=0x7f41a40b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:20.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.711+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 shutdown_connections 2024-04-18T03:41:20.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.711+0000 7f41ab2cb700 1 -- 172.21.15.157:0/2730411001 wait complete. 2024-04-18T03:41:20.714 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:41:20.725 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-18T03:41:20.725 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T03:41:20.733 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:41:20.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb182e3f700 1 Processor -- start 2024-04-18T03:41:20.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb182e3f700 1 -- start start 2024-04-18T03:41:20.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb182e3f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb17c1436b0 0x7fb17c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb182e3f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c06b780 0x7fb17c06bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb182e3f700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0cf0d0 con 0x7fb17c15da20 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb182e3f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c06c100 con 0x7fb17c1436b0 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb182e3f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0b3c30 con 0x7fb17c06b780 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb18263e700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb17c15da20 0x7fb17c15deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34710/0 (socket says 172.21.15.157:34710) 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb181e3d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb17c1436b0 0x7fb17c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb18263e700 1 -- 172.21.15.157:0/1772568301 learned_addr learned my addr 172.21.15.157:0/1772568301 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.839+0000 7fb18163c700 1 --2- 172.21.15.157:0/1772568301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c06b780 0x7fb17c06bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb181e3d700 1 -- 172.21.15.157:0/1772568301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c06b780 msgr2=0x7fb17c06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:20.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb181e3d700 1 --2- 172.21.15.157:0/1772568301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c06b780 0x7fb17c06bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb181e3d700 1 -- 172.21.15.157:0/1772568301 >> v1:172.21.15.157:6789/0 conn(0x7fb17c15da20 legacy=0x7fb17c15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb180e3b700 1 -- 172.21.15.157:0/1772568301 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943944109 0 0) 0x7fb17c0cf0d0 con 0x7fb17c15da20 2024-04-18T03:41:20.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb181e3d700 1 -- 172.21.15.157:0/1772568301 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0ce1e0 con 0x7fb17c1436b0 2024-04-18T03:41:20.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb18163c700 1 --2- 172.21.15.157:0/1772568301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c06b780 0x7fb17c06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:20.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb181e3d700 1 --2- 172.21.15.157:0/1772568301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c06d510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb178009850 tx=0x7fb178009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce7c133b30374 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb180e3b700 1 -- 172.21.15.157:0/1772568301 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011830 con 0x7fb17c1436b0 2024-04-18T03:41:20.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb180e3b700 1 -- 172.21.15.157:0/1772568301 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb178011990 con 0x7fb17c1436b0 2024-04-18T03:41:20.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb180e3b700 1 -- 172.21.15.157:0/1772568301 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011d20 con 0x7fb17c1436b0 2024-04-18T03:41:20.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 -- 172.21.15.157:0/1772568301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 msgr2=0x7fb17c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1772568301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c06d510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb178009850 tx=0x7fb178009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 -- 172.21.15.157:0/1772568301 shutdown_connections 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1772568301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c06b780 0x7fb17c06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1772568301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c06d510 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 -- 172.21.15.157:0/1772568301 >> 172.21.15.157:0/1772568301 conn(0x7fb17c0b1920 msgr2=0x7fb17c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 -- 172.21.15.157:0/1772568301 shutdown_connections 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 -- 172.21.15.157:0/1772568301 wait complete. 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 Processor -- start 2024-04-18T03:41:20.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.843+0000 7fb182e3f700 1 -- start start 2024-04-18T03:41:20.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb17c06b780 0x7fb17c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c15da20 0x7fb17c137490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15c360 con 0x7fb17c1436b0 2024-04-18T03:41:20.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15c780 con 0x7fb17c06b780 2024-04-18T03:41:20.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c15b6e0 con 0x7fb17c15da20 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c1556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47298/0 (socket says 172.21.15.157:47298) 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 -- 172.21.15.157:0/1565170869 learned_addr learned my addr 172.21.15.157:0/1565170869 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb181e3d700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb17c06b780 0x7fb17c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18263e700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c15da20 0x7fb17c137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 -- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c15da20 msgr2=0x7fb17c137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c15da20 0x7fb17c137490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 -- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb17c06b780 msgr2=0x7fb17c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb17c06b780 0x7fb17c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 -- 172.21.15.157:0/1565170869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780094b0 con 0x7fb17c1436b0 2024-04-18T03:41:20.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb18163c700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c1556b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00e760 tx=0x7fb16c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb1727fc700 1 -- 172.21.15.157:0/1565170869 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00c070 con 0x7fb17c1436b0 2024-04-18T03:41:20.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb1727fc700 1 -- 172.21.15.157:0/1565170869 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c004250 con 0x7fb17c1436b0 2024-04-18T03:41:20.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c15b9c0 con 0x7fb17c1436b0 2024-04-18T03:41:20.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb1727fc700 1 -- 172.21.15.157:0/1565170869 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0036c0 con 0x7fb17c1436b0 2024-04-18T03:41:20.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c15bd50 con 0x7fb17c1436b0 2024-04-18T03:41:20.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.847+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c15bb50 con 0x7fb17c1436b0 2024-04-18T03:41:20.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.851+0000 7fb1727fc700 1 -- 172.21.15.157:0/1565170869 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb16c003820 con 0x7fb17c1436b0 2024-04-18T03:41:20.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.851+0000 7fb1727fc700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb160066730 0x7fb160068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:20.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.851+0000 7fb1727fc700 1 -- 172.21.15.157:0/1565170869 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb16c084110 con 0x7fb17c1436b0 2024-04-18T03:41:20.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.851+0000 7fb181e3d700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb160066730 0x7fb160068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:20.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.851+0000 7fb181e3d700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb160066730 0x7fb160068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb1780090b0 tx=0x7fb178008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:20.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:20.855+0000 7fb1727fc700 1 -- 172.21.15.157:0/1565170869 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb16c051150 con 0x7fb17c1436b0 2024-04-18T03:41:21.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.027+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb17c15b470 con 0x7fb17c1436b0 2024-04-18T03:41:21.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.031+0000 7fb1727fc700 1 -- 172.21.15.157:0/1565170869 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7fb16c0094e0 con 0x7fb17c1436b0 2024-04-18T03:41:21.035 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:21.035 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb160066730 msgr2=0x7fb160068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb160066730 0x7fb160068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb1780090b0 tx=0x7fb178008030 comp rx=0 tx=0).stop 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 msgr2=0x7fb17c1556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c1556b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00e760 tx=0x7fb16c00ea70 comp rx=0 tx=0).stop 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 shutdown_connections 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb160066730 0x7fb160068bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb17c15da20 0x7fb17c137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb17c1436b0 0x7fb17c1556b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 --2- 172.21.15.157:0/1565170869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb17c06b780 0x7fb17c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 >> 172.21.15.157:0/1565170869 conn(0x7fb17c0b1920 msgr2=0x7fb17c13e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:21.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 shutdown_connections 2024-04-18T03:41:21.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.035+0000 7fb182e3f700 1 -- 172.21.15.157:0/1565170869 wait complete. 2024-04-18T03:41:21.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T03:37:27.828061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T03:37:32.619811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T03:37:33.276945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-18T03:37:36.333331+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T03:41:21.051 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T03:41:21.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1398a3700 1 Processor -- start 2024-04-18T03:41:21.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1398a3700 1 -- start start 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1398a3700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa1340ac970 0x7fa1340cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1398a3700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa1340cddc0 0x7fa134164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1398a3700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1340cc920 con 0x7fa13415b070 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1398a3700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1340cbd10 con 0x7fa1340ac970 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1398a3700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1340cbff0 con 0x7fa1340cddc0 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa133fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa1340ac970 0x7fa1340cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1388a1700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa13415b070 0x7fa1340ac260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34714/0 (socket says 172.21.15.157:34714) 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa133fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa1340ac970 0x7fa1340cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47302/0 (socket says 172.21.15.157:47302) 2024-04-18T03:41:21.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1388a1700 1 -- 172.21.15.157:0/1778079496 learned_addr learned my addr 172.21.15.157:0/1778079496 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1390a2700 1 --2- 172.21.15.157:0/1778079496 >> v2:172.21.15.175:3300/0 conn(0x7fa1340cddc0 0x7fa134164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa133fff700 1 -- 172.21.15.157:0/1778079496 >> v2:172.21.15.175:3300/0 conn(0x7fa1340cddc0 msgr2=0x7fa134164ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa133fff700 1 --2- 172.21.15.157:0/1778079496 >> v2:172.21.15.175:3300/0 conn(0x7fa1340cddc0 0x7fa134164ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa133fff700 1 -- 172.21.15.157:0/1778079496 >> v1:172.21.15.157:6789/0 conn(0x7fa13415b070 legacy=0x7fa1340ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa133fff700 1 -- 172.21.15.157:0/1778079496 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340cc2d0 con 0x7fa1340ac970 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.167+0000 7fa1337fe700 1 -- 172.21.15.157:0/1778079496 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276801434 0 0) 0x7fa1340cc920 con 0x7fa13415b070 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa133fff700 1 --2- 172.21.15.157:0/1778079496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa1340cf8d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa13406d370 tx=0x7fa128009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb6175e709aea8d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1337fe700 1 -- 172.21.15.157:0/1778079496 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011830 con 0x7fa1340ac970 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1337fe700 1 -- 172.21.15.157:0/1778079496 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128011990 con 0x7fa1340ac970 2024-04-18T03:41:21.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1337fe700 1 -- 172.21.15.157:0/1778079496 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011d20 con 0x7fa1340ac970 2024-04-18T03:41:21.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 -- 172.21.15.157:0/1778079496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 msgr2=0x7fa1340cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 --2- 172.21.15.157:0/1778079496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa1340cf8d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa13406d370 tx=0x7fa128009b30 comp rx=0 tx=0).stop 2024-04-18T03:41:21.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 -- 172.21.15.157:0/1778079496 shutdown_connections 2024-04-18T03:41:21.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 --2- 172.21.15.157:0/1778079496 >> v2:172.21.15.175:3300/0 conn(0x7fa1340cddc0 0x7fa134164ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 --2- 172.21.15.157:0/1778079496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa1340cf8d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 -- 172.21.15.157:0/1778079496 >> 172.21.15.157:0/1778079496 conn(0x7fa134098a50 msgr2=0x7fa1340b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:21.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 -- 172.21.15.157:0/1778079496 shutdown_connections 2024-04-18T03:41:21.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 -- 172.21.15.157:0/1778079496 wait complete. 2024-04-18T03:41:21.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 Processor -- start 2024-04-18T03:41:21.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.171+0000 7fa1398a3700 1 -- start start 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa134156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1340cddc0 0x7fa1341f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13415b070 0x7fa1341f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa134156a80 con 0x7fa1340ac970 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa134156d60 con 0x7fa1340cddc0 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa134157040 con 0x7fa13415b070 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa134156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa134156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47308/0 (socket says 172.21.15.157:47308) 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 -- 172.21.15.157:0/4047980448 learned_addr learned my addr 172.21.15.157:0/4047980448 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1390a2700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13415b070 0x7fa1341f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa133fff700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1340cddc0 0x7fa1341f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 -- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13415b070 msgr2=0x7fa1341f3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13415b070 0x7fa1341f3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 -- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1340cddc0 msgr2=0x7fa1341f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1340cddc0 0x7fa1341f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 -- 172.21.15.157:0/4047980448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280094b0 con 0x7fa1340ac970 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa133fff700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1340cddc0 0x7fa1341f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1388a1700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa134156170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c580 tx=0x7fa12400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1317fa700 1 -- 172.21.15.157:0/4047980448 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124004ca0 con 0x7fa1340ac970 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa134157320 con 0x7fa1340ac970 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1317fa700 1 -- 172.21.15.157:0/4047980448 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa124004e20 con 0x7fa1340ac970 2024-04-18T03:41:21.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1341566b0 con 0x7fa1340ac970 2024-04-18T03:41:21.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1317fa700 1 -- 172.21.15.157:0/4047980448 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1240072d0 con 0x7fa1340ac970 2024-04-18T03:41:21.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.175+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13404e650 con 0x7fa1340ac970 2024-04-18T03:41:21.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.179+0000 7fa1317fa700 1 -- 172.21.15.157:0/4047980448 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa124007430 con 0x7fa1340ac970 2024-04-18T03:41:21.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.179+0000 7fa1317fa700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa120066730 0x7fa120068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.179+0000 7fa1317fa700 1 -- 172.21.15.157:0/4047980448 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa124084060 con 0x7fa1340ac970 2024-04-18T03:41:21.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.179+0000 7fa133fff700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa120066730 0x7fa120068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.179+0000 7fa133fff700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa120066730 0x7fa120068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa13406d370 tx=0x7fa128008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.183+0000 7fa1317fa700 1 -- 172.21.15.157:0/4047980448 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa124051020 con 0x7fa1340ac970 2024-04-18T03:41:21.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.351+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa134151eb0 con 0x7fa1340ac970 2024-04-18T03:41:21.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.351+0000 7fa1317fa700 1 -- 172.21.15.157:0/4047980448 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa124054640 con 0x7fa1340ac970 2024-04-18T03:41:21.356 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 1 2024-04-18T03:41:21.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa120066730 msgr2=0x7fa120068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa120066730 0x7fa120068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa13406d370 tx=0x7fa128008030 comp rx=0 tx=0).stop 2024-04-18T03:41:21.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 msgr2=0x7fa134156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa134156170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c580 tx=0x7fa12400c890 comp rx=0 tx=0).stop 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 shutdown_connections 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa120066730 0x7fa120068bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1340cddc0 0x7fa1341f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa13415b070 0x7fa1341f3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 --2- 172.21.15.157:0/4047980448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1340ac970 0x7fa134156170 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 >> 172.21.15.157:0/4047980448 conn(0x7fa134098a50 msgr2=0x7fa1340ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 shutdown_connections 2024-04-18T03:41:21.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.355+0000 7fa1398a3700 1 -- 172.21.15.157:0/4047980448 wait complete. 2024-04-18T03:41:21.371 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T03:41:21.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 Processor -- start 2024-04-18T03:41:21.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 -- start start 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd300071080 0x7fd300071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3000719a0 con 0x7fd3000d12b0 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30006a770 con 0x7fd300161660 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30006aa50 con 0x7fd300071080 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2ff7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd300071080 0x7fd300071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2fffff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd3000d12b0 0x7fd3000d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34726/0 (socket says 172.21.15.157:34726) 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2fffff700 1 -- 172.21.15.157:0/3814213986 learned_addr learned my addr 172.21.15.157:0/3814213986 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2fe7fc700 1 -- 172.21.15.157:0/3814213986 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080926316 0 0) 0x7fd3000719a0 con 0x7fd3000d12b0 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2fe7fc700 1 -- 172.21.15.157:0/3814213986 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e80035d0 con 0x7fd3000d12b0 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2ff7fe700 1 -- 172.21.15.157:0/3814213986 >> v1:172.21.15.175:6789/0 conn(0x7fd300161660 legacy=0x7fd30006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2ff7fe700 1 -- 172.21.15.157:0/3814213986 >> v1:172.21.15.157:6789/0 conn(0x7fd3000d12b0 legacy=0x7fd3000d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2ff7fe700 1 -- 172.21.15.157:0/3814213986 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30006ad30 con 0x7fd300071080 2024-04-18T03:41:21.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2ff7fe700 1 --2- 172.21.15.157:0/3814213986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300071080 0x7fd300071460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009850 tx=0x7fd2f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86535013f611b71c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2fe7fc700 1 -- 172.21.15.157:0/3814213986 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4011830 con 0x7fd300071080 2024-04-18T03:41:21.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2fe7fc700 1 -- 172.21.15.157:0/3814213986 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4011990 con 0x7fd300071080 2024-04-18T03:41:21.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd2fe7fc700 1 -- 172.21.15.157:0/3814213986 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4011d00 con 0x7fd300071080 2024-04-18T03:41:21.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 -- 172.21.15.157:0/3814213986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300071080 msgr2=0x7fd300071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 --2- 172.21.15.157:0/3814213986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300071080 0x7fd300071460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009850 tx=0x7fd2f4009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:21.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.487+0000 7fd304e60700 1 -- 172.21.15.157:0/3814213986 shutdown_connections 2024-04-18T03:41:21.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 --2- 172.21.15.157:0/3814213986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300071080 0x7fd300071460 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- 172.21.15.157:0/3814213986 >> 172.21.15.157:0/3814213986 conn(0x7fd30006e020 msgr2=0x7fd30006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:21.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- 172.21.15.157:0/3814213986 shutdown_connections 2024-04-18T03:41:21.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- 172.21.15.157:0/3814213986 wait complete. 2024-04-18T03:41:21.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 Processor -- start 2024-04-18T03:41:21.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- start start 2024-04-18T03:41:21.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd300071080 0x7fd300157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000d12b0 0x7fd30015e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300161660 0x7fd30015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30015b930 con 0x7fd300161660 2024-04-18T03:41:21.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30015bc10 con 0x7fd3000d12b0 2024-04-18T03:41:21.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30015bef0 con 0x7fd300071080 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300161660 0x7fd30015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300161660 0x7fd30015ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47314/0 (socket says 172.21.15.157:47314) 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 -- 172.21.15.157:0/2649688687 learned_addr learned my addr 172.21.15.157:0/2649688687 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2ff7fe700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd300071080 0x7fd300157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2feffd700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000d12b0 0x7fd30015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 -- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd300071080 msgr2=0x7fd300157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd300071080 0x7fd300157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 -- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000d12b0 msgr2=0x7fd30015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000d12b0 0x7fd30015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 -- 172.21.15.157:0/2649688687 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f40094b0 con 0x7fd300161660 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2feffd700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000d12b0 0x7fd30015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2fffff700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300161660 0x7fd30015ea90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800cb40 tx=0x7fd2f800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2e7fff700 1 -- 172.21.15.157:0/2649688687 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800a7b0 con 0x7fd300161660 2024-04-18T03:41:21.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2e7fff700 1 -- 172.21.15.157:0/2649688687 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f800a910 con 0x7fd300161660 2024-04-18T03:41:21.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd2e7fff700 1 -- 172.21.15.157:0/2649688687 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800ac80 con 0x7fd300161660 2024-04-18T03:41:21.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30015c1d0 con 0x7fd300161660 2024-04-18T03:41:21.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.491+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3001577d0 con 0x7fd300161660 2024-04-18T03:41:21.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.495+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30015c6f0 con 0x7fd300161660 2024-04-18T03:41:21.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.495+0000 7fd2e7fff700 1 -- 172.21.15.157:0/2649688687 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2f801b3b0 con 0x7fd300161660 2024-04-18T03:41:21.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.495+0000 7fd2e7fff700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd2ec066730 0x7fd2ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.495+0000 7fd2e7fff700 1 -- 172.21.15.157:0/2649688687 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd2f8083dd0 con 0x7fd300161660 2024-04-18T03:41:21.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.495+0000 7fd2ff7fe700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd2ec066730 0x7fd2ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.495+0000 7fd2ff7fe700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd2ec066730 0x7fd2ec068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009ba0 tx=0x7fd2f4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.503+0000 7fd2e7fff700 1 -- 172.21.15.157:0/2649688687 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd30015c6f0 con 0x7fd300161660 2024-04-18T03:41:21.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.675+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd30015c6f0 con 0x7fd300161660 2024-04-18T03:41:21.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.675+0000 7fd2e7fff700 1 -- 172.21.15.157:0/2649688687 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd2f8017020 con 0x7fd300161660 2024-04-18T03:41:21.678 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd2ec066730 msgr2=0x7fd2ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd2ec066730 0x7fd2ec068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4009ba0 tx=0x7fd2f4008030 comp rx=0 tx=0).stop 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300161660 msgr2=0x7fd30015ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300161660 0x7fd30015ea90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800cb40 tx=0x7fd2f800cb70 comp rx=0 tx=0).stop 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 shutdown_connections 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd2ec066730 0x7fd2ec068bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3000d12b0 0x7fd30015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd300161660 0x7fd30015ea90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 --2- 172.21.15.157:0/2649688687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd300071080 0x7fd300157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 >> 172.21.15.157:0/2649688687 conn(0x7fd30006e020 msgr2=0x7fd300160820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 shutdown_connections 2024-04-18T03:41:21.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.679+0000 7fd304e60700 1 -- 172.21.15.157:0/2649688687 wait complete. 2024-04-18T03:41:21.698 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T03:41:21.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2508d700 1 Processor -- start 2024-04-18T03:41:21.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2508d700 1 -- start start 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2508d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 0x7f6c20071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2508d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c20161660 0x7f6c2006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2508d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200719a0 con 0x7f6c200b5f90 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2508d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2006a770 con 0x7f6c20161660 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2508d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2006aa50 con 0x7f6c20071080 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2488c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6c200b5f90 0x7f6c200b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:34730/0 (socket says 172.21.15.157:34730) 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c2488c700 1 -- 172.21.15.157:0/62616496 learned_addr learned my addr 172.21.15.157:0/62616496 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1f7fe700 1 --2- 172.21.15.157:0/62616496 >> v2:172.21.15.175:3300/0 conn(0x7f6c20161660 0x7f6c2006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1ffff700 1 --2- 172.21.15.157:0/62616496 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 0x7f6c20071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1effd700 1 -- 172.21.15.157:0/62616496 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434010624 0 0) 0x7f6c200719a0 con 0x7f6c200b5f90 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1effd700 1 -- 172.21.15.157:0/62616496 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c0c0035d0 con 0x7f6c200b5f90 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1f7fe700 1 -- 172.21.15.157:0/62616496 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 msgr2=0x7f6c20071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1f7fe700 1 --2- 172.21.15.157:0/62616496 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 0x7f6c20071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1f7fe700 1 -- 172.21.15.157:0/62616496 >> v1:172.21.15.157:6789/0 conn(0x7f6c200b5f90 legacy=0x7f6c200b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1f7fe700 1 -- 172.21.15.157:0/62616496 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2006ad30 con 0x7f6c20161660 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1f7fe700 1 --2- 172.21.15.157:0/62616496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c20161660 0x7f6c2006c3a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009850 tx=0x7f6c10009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce14884913b023fa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1effd700 1 -- 172.21.15.157:0/62616496 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10011830 con 0x7f6c20161660 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1effd700 1 -- 172.21.15.157:0/62616496 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c10011990 con 0x7f6c20161660 2024-04-18T03:41:21.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.811+0000 7f6c1effd700 1 -- 172.21.15.157:0/62616496 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10011d00 con 0x7f6c20161660 2024-04-18T03:41:21.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- 172.21.15.157:0/62616496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c20161660 msgr2=0x7f6c2006c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 --2- 172.21.15.157:0/62616496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c20161660 0x7f6c2006c3a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009850 tx=0x7f6c10009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:21.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- 172.21.15.157:0/62616496 shutdown_connections 2024-04-18T03:41:21.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 --2- 172.21.15.157:0/62616496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c20161660 0x7f6c2006c3a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 --2- 172.21.15.157:0/62616496 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 0x7f6c20071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- 172.21.15.157:0/62616496 >> 172.21.15.157:0/62616496 conn(0x7f6c2006e020 msgr2=0x7f6c2006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:21.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- 172.21.15.157:0/62616496 shutdown_connections 2024-04-18T03:41:21.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- 172.21.15.157:0/62616496 wait complete. 2024-04-18T03:41:21.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 Processor -- start 2024-04-18T03:41:21.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- start start 2024-04-18T03:41:21.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 0x7f6c20154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c200b5f90 0x7f6c201f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c20161660 0x7f6c201f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200ace90 con 0x7f6c20161660 2024-04-18T03:41:21.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c201f3530 con 0x7f6c200b5f90 2024-04-18T03:41:21.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.815+0000 7f6c2508d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c201f3810 con 0x7f6c20071080 2024-04-18T03:41:21.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c20161660 0x7f6c201f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c20161660 0x7f6c201f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47330/0 (socket says 172.21.15.157:47330) 2024-04-18T03:41:21.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 -- 172.21.15.157:0/2364749041 learned_addr learned my addr 172.21.15.157:0/2364749041 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:21.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c1ffff700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 0x7f6c20154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c1f7fe700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c200b5f90 0x7f6c201f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 -- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 msgr2=0x7f6c20154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 0x7f6c20154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 -- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c200b5f90 msgr2=0x7f6c201f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:21.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c200b5f90 0x7f6c201f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:21.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 -- 172.21.15.157:0/2364749041 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c100094b0 con 0x7f6c20161660 2024-04-18T03:41:21.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2488c700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c20161660 0x7f6c201f2ee0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800caa0 tx=0x7f6c1800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c1cff9700 1 -- 172.21.15.157:0/2364749041 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18007480 con 0x7f6c20161660 2024-04-18T03:41:21.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c1cff9700 1 -- 172.21.15.157:0/2364749041 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c180075e0 con 0x7f6c20161660 2024-04-18T03:41:21.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c201f3af0 con 0x7f6c20161660 2024-04-18T03:41:21.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c1cff9700 1 -- 172.21.15.157:0/2364749041 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18007970 con 0x7f6c20161660 2024-04-18T03:41:21.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c201f40b0 con 0x7f6c20161660 2024-04-18T03:41:21.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2004e650 con 0x7f6c20161660 2024-04-18T03:41:21.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.819+0000 7f6c1cff9700 1 -- 172.21.15.157:0/2364749041 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6c1801b3b0 con 0x7f6c20161660 2024-04-18T03:41:21.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.823+0000 7f6c1cff9700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6c00066730 0x7f6c00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:21.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.823+0000 7f6c1cff9700 1 -- 172.21.15.157:0/2364749041 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c18083e70 con 0x7f6c20161660 2024-04-18T03:41:21.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.823+0000 7f6c1ffff700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6c00066730 0x7f6c00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:21.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.823+0000 7f6c1ffff700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6c00066730 0x7f6c00068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009b50 tx=0x7f6c08009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:21.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.831+0000 7f6c1cff9700 1 -- 172.21.15.157:0/2364749041 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f6c18050da0 con 0x7f6c20161660 2024-04-18T03:41:22.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c201f42a0 con 0x7f6c20161660 2024-04-18T03:41:22.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c1cff9700 1 -- 172.21.15.157:0/2364749041 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c180543c0 con 0x7f6c20161660 2024-04-18T03:41:22.002 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 64 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6c00066730 msgr2=0x7f6c00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c2508d700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6c00066730 0x7f6c00068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009b50 tx=0x7f6c08009240 comp rx=0 tx=0).stop 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c20161660 msgr2=0x7f6c201f2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c2508d700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c20161660 0x7f6c201f2ee0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800caa0 tx=0x7f6c1800cad0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 shutdown_connections 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c2508d700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6c00066730 0x7f6c00068bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:21.999+0000 7f6c2508d700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c200b5f90 0x7f6c201f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.003+0000 7f6c2508d700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6c20161660 0x7f6c201f2ee0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.003+0000 7f6c2508d700 1 --2- 172.21.15.157:0/2364749041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c20071080 0x7f6c20154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.003+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 >> 172.21.15.157:0/2364749041 conn(0x7f6c2006e020 msgr2=0x7f6c2006e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:22.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.003+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 shutdown_connections 2024-04-18T03:41:22.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.003+0000 7f6c2508d700 1 -- 172.21.15.157:0/2364749041 wait complete. 2024-04-18T03:41:22.017 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-18T03:41:22.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.131+0000 7f46bbfff700 1 Processor -- start 2024-04-18T03:41:22.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.131+0000 7f46bbfff700 1 -- start start 2024-04-18T03:41:22.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.131+0000 7f46bbfff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46bc161660 0x7f46bc06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.131+0000 7f46bbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc0d12b0 0x7f46bc0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.131+0000 7f46bbfff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc06a770 con 0x7f46bc071080 2024-04-18T03:41:22.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46bc06aa50 con 0x7f46bc161660 2024-04-18T03:41:22.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc06ad30 con 0x7f46bc0d12b0 2024-04-18T03:41:22.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46ba7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46bc161660 0x7f46bc06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bb7fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc0d12b0 0x7f46bc0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46ba7fc700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46bc161660 0x7f46bc06c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:52088/0 (socket says 172.21.15.157:52088) 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46ba7fc700 1 -- 172.21.15.157:0/1452019280 learned_addr learned my addr 172.21.15.157:0/1452019280 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46baffd700 1 --1- 172.21.15.157:0/1452019280 >> v1:172.21.15.175:6789/0 conn(0x7f46bc071080 0x7f46bc071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:59476/0 (socket says 172.21.15.157:59476) 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46b9ffb700 1 -- 172.21.15.157:0/1452019280 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170848284 0 0) 0x7f46bc06a770 con 0x7f46bc071080 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46b9ffb700 1 -- 172.21.15.157:0/1452019280 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a40035d0 con 0x7f46bc071080 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46ba7fc700 1 -- 172.21.15.157:0/1452019280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc0d12b0 msgr2=0x7f46bc0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46ba7fc700 1 --2- 172.21.15.157:0/1452019280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc0d12b0 0x7f46bc0d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46ba7fc700 1 -- 172.21.15.157:0/1452019280 >> v1:172.21.15.175:6789/0 conn(0x7f46bc071080 legacy=0x7f46bc071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46ba7fc700 1 -- 172.21.15.157:0/1452019280 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc06b010 con 0x7f46bc161660 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bb7fe700 1 --2- 172.21.15.157:0/1452019280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc0d12b0 0x7f46bc0d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46ba7fc700 1 --2- 172.21.15.157:0/1452019280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc161660 0x7f46bc06c3a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009910 tx=0x7f46ac009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea11753e180e6027 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46b9ffb700 1 -- 172.21.15.157:0/1452019280 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac011830 con 0x7f46bc161660 2024-04-18T03:41:22.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46b9ffb700 1 -- 172.21.15.157:0/1452019280 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac011990 con 0x7f46bc161660 2024-04-18T03:41:22.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46b9ffb700 1 -- 172.21.15.157:0/1452019280 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac011d40 con 0x7f46bc161660 2024-04-18T03:41:22.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 -- 172.21.15.157:0/1452019280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc161660 msgr2=0x7f46bc06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 --2- 172.21.15.157:0/1452019280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc161660 0x7f46bc06c3a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009910 tx=0x7f46ac009c20 comp rx=0 tx=0).stop 2024-04-18T03:41:22.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 -- 172.21.15.157:0/1452019280 shutdown_connections 2024-04-18T03:41:22.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 --2- 172.21.15.157:0/1452019280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc0d12b0 0x7f46bc0d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 --2- 172.21.15.157:0/1452019280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc161660 0x7f46bc06c3a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 -- 172.21.15.157:0/1452019280 >> 172.21.15.157:0/1452019280 conn(0x7f46bc06e020 msgr2=0x7f46bc06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:22.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 -- 172.21.15.157:0/1452019280 shutdown_connections 2024-04-18T03:41:22.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.135+0000 7f46bbfff700 1 -- 172.21.15.157:0/1452019280 wait complete. 2024-04-18T03:41:22.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 Processor -- start 2024-04-18T03:41:22.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 -- start start 2024-04-18T03:41:22.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46bc071080 0x7f46bc1f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc0d12b0 0x7f46bc156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc161660 0x7f46bc1e8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc1f73e0 con 0x7f46bc071080 2024-04-18T03:41:22.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc157390 con 0x7f46bc0d12b0 2024-04-18T03:41:22.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc15b270 con 0x7f46bc161660 2024-04-18T03:41:22.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46bc071080 0x7f46bc1f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46bc071080 0x7f46bc1f6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:47334/0 (socket says 172.21.15.157:47334) 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 -- 172.21.15.157:0/782045335 learned_addr learned my addr 172.21.15.157:0/782045335 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46ba7fc700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc0d12b0 0x7f46bc156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bb7fe700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc161660 0x7f46bc1e8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 -- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc161660 msgr2=0x7f46bc1e8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc161660 0x7f46bc1e8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 -- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc0d12b0 msgr2=0x7f46bc156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc0d12b0 0x7f46bc156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 -- 172.21.15.157:0/782045335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009a70 con 0x7f46bc071080 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46baffd700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46bc071080 0x7f46bc1f6ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c700 tx=0x7f46b000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46a37fe700 1 -- 172.21.15.157:0/782045335 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0005cd0 con 0x7f46bc071080 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46a37fe700 1 -- 172.21.15.157:0/782045335 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0005e30 con 0x7f46bc071080 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac009570 con 0x7f46bc071080 2024-04-18T03:41:22.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.139+0000 7f46a37fe700 1 -- 172.21.15.157:0/782045335 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b00072f0 con 0x7f46bc071080 2024-04-18T03:41:22.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.143+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc0ab8c0 con 0x7f46bc071080 2024-04-18T03:41:22.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.143+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46bc04e650 con 0x7f46bc071080 2024-04-18T03:41:22.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.143+0000 7f46a37fe700 1 -- 172.21.15.157:0/782045335 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f46b0007450 con 0x7f46bc071080 2024-04-18T03:41:22.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.143+0000 7f46a37fe700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46a8066730 0x7f46a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.143+0000 7f46a37fe700 1 -- 172.21.15.157:0/782045335 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46b00839d0 con 0x7f46bc071080 2024-04-18T03:41:22.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.147+0000 7f46ba7fc700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46a8066730 0x7f46a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.147+0000 7f46ba7fc700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46a8066730 0x7f46a8068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000c00 tx=0x7f46ac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:22.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.147+0000 7f46a37fe700 1 -- 172.21.15.157:0/782045335 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f46b0050970 con 0x7f46bc071080 2024-04-18T03:41:22.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.311+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f46bc06a550 con 0x7f46bc071080 2024-04-18T03:41:22.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.311+0000 7f46a37fe700 1 -- 172.21.15.157:0/782045335 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f46b00170a0 con 0x7f46bc071080 2024-04-18T03:41:22.316 INFO:teuthology.orchestra.run.smithi157.stdout:pg_num: 32 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46a8066730 msgr2=0x7f46a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46a8066730 0x7f46a8068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000c00 tx=0x7f46ac008030 comp rx=0 tx=0).stop 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46bc071080 msgr2=0x7f46bc1f6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46bc071080 0x7f46bc1f6ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c700 tx=0x7f46b000ca10 comp rx=0 tx=0).stop 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 shutdown_connections 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46a8066730 0x7f46a8068bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46bc0d12b0 0x7f46bc156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46bc161660 0x7f46bc1e8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 --2- 172.21.15.157:0/782045335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46bc071080 0x7f46bc1f6ea0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 >> 172.21.15.157:0/782045335 conn(0x7f46bc06e020 msgr2=0x7f46bc071460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 shutdown_connections 2024-04-18T03:41:22.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.315+0000 7f46bbfff700 1 -- 172.21.15.157:0/782045335 wait complete. 2024-04-18T03:41:22.331 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T03:41:22.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.443+0000 7f09b4b66700 1 Processor -- start 2024-04-18T03:41:22.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.443+0000 7f09b4b66700 1 -- start start 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.443+0000 7f09b4b66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 0x7f09b015e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.443+0000 7f09b4b66700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f09b00b1f20 0x7f09b00ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.443+0000 7f09b4b66700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00cdb70 con 0x7f09b0071080 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.443+0000 7f09b4b66700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b01434f0 con 0x7f09b00b1f20 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.443+0000 7f09b4b66700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b015e7a0 con 0x7f09b0143110 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f09b00b1f20 0x7f09b00ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f09b00b1f20 0x7f09b00ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55212/0 (socket says 172.21.15.157:55212) 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 -- 172.21.15.157:0/3892632204 learned_addr learned my addr 172.21.15.157:0/3892632204 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09ae59c700 1 --2- 172.21.15.157:0/3892632204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 0x7f09b015e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 -- 172.21.15.157:0/3892632204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 msgr2=0x7f09b015e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:22.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 --2- 172.21.15.157:0/3892632204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 0x7f09b015e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 -- 172.21.15.157:0/3892632204 >> v1:172.21.15.175:6789/0 conn(0x7f09b0071080 legacy=0x7f09b00b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 -- 172.21.15.157:0/3892632204 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00b24e0 con 0x7f09b00b1f20 2024-04-18T03:41:22.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 --2- 172.21.15.157:0/3892632204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b00ce000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009e50 tx=0x7f09a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346f21bb06632a23 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:22.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09ad59a700 1 -- 172.21.15.157:0/3892632204 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000e070 con 0x7f09b00b1f20 2024-04-18T03:41:22.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09ad59a700 1 -- 172.21.15.157:0/3892632204 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000b910 con 0x7f09b00b1f20 2024-04-18T03:41:22.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09ad59a700 1 -- 172.21.15.157:0/3892632204 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a000bcc0 con 0x7f09b00b1f20 2024-04-18T03:41:22.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- 172.21.15.157:0/3892632204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 msgr2=0x7f09b00ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 --2- 172.21.15.157:0/3892632204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b00ce000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009e50 tx=0x7f09a000b330 comp rx=0 tx=0).stop 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- 172.21.15.157:0/3892632204 shutdown_connections 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 --2- 172.21.15.157:0/3892632204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b00ce000 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 --2- 172.21.15.157:0/3892632204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 0x7f09b015e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- 172.21.15.157:0/3892632204 >> 172.21.15.157:0/3892632204 conn(0x7f09b006e190 msgr2=0x7f09b006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- 172.21.15.157:0/3892632204 shutdown_connections 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- 172.21.15.157:0/3892632204 wait complete. 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 Processor -- start 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- start start 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b0071080 0x7f09b0137b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b0139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 0x7f09b015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0140ca0 con 0x7f09b00b1f20 2024-04-18T03:41:22.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0140120 con 0x7f09b0071080 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09b4b66700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0140400 con 0x7f09b0143110 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b0139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b0139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55226/0 (socket says 172.21.15.157:55226) 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.447+0000 7f09add9b700 1 -- 172.21.15.157:0/1434005874 learned_addr learned my addr 172.21.15.157:0/1434005874 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09ae59c700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b0071080 0x7f09b0137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09aed9d700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 0x7f09b015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09add9b700 1 -- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 msgr2=0x7f09b015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09add9b700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 0x7f09b015c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09add9b700 1 -- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b0071080 msgr2=0x7f09b0137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09add9b700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b0071080 0x7f09b0137b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09add9b700 1 -- 172.21.15.157:0/1434005874 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009b30 con 0x7f09b00b1f20 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09add9b700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b0139490 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f09a000b370 tx=0x7f09a0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:22.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09a6ffd700 1 -- 172.21.15.157:0/1434005874 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0004960 con 0x7f09b00b1f20 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b01406e0 con 0x7f09b00b1f20 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09a6ffd700 1 -- 172.21.15.157:0/1434005874 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a00092e0 con 0x7f09b00b1f20 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09a6ffd700 1 -- 172.21.15.157:0/1434005874 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a001c6a0 con 0x7f09b00b1f20 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b013fd80 con 0x7f09b00b1f20 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b004e6a0 con 0x7f09b00b1f20 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09a6ffd700 1 -- 172.21.15.157:0/1434005874 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09a001c800 con 0x7f09b00b1f20 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.451+0000 7f09a6ffd700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0990066760 0x7f0990068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.455+0000 7f09a6ffd700 1 -- 172.21.15.157:0/1434005874 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f09a0085f50 con 0x7f09b00b1f20 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.455+0000 7f09ae59c700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0990066760 0x7f0990068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:22.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.455+0000 7f09ae59c700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0990066760 0x7f0990068c20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0998009ae0 tx=0x7f0998008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:22.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.463+0000 7f09a6ffd700 1 -- 172.21.15.157:0/1434005874 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f09a0052f10 con 0x7f09b00b1f20 2024-04-18T03:41:22.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.643+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f09b00afec0 con 0x7f09b00b1f20 2024-04-18T03:41:22.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.643+0000 7f09a6ffd700 1 -- 172.21.15.157:0/1434005874 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f09a0056530 con 0x7f09b00b1f20 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0990066760 msgr2=0x7f0990068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0990066760 0x7f0990068c20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0998009ae0 tx=0x7f0998008040 comp rx=0 tx=0).stop 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 msgr2=0x7f09b0139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b0139490 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f09a000b370 tx=0x7f09a0004af0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 shutdown_connections 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f0990066760 0x7f0990068c20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09b0143110 0x7f09b015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09b00b1f20 0x7f09b0139490 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 --2- 172.21.15.157:0/1434005874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09b0071080 0x7f09b0137b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 >> 172.21.15.157:0/1434005874 conn(0x7f09b006e190 msgr2=0x7f09b006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 shutdown_connections 2024-04-18T03:41:22.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:22.647+0000 7f09b4b66700 1 -- 172.21.15.157:0/1434005874 wait complete. 2024-04-18T03:41:22.653 INFO:teuthology.orchestra.run.smithi157.stderr:listed 0 entries 2024-04-18T03:41:22.664 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2024-04-18T03:41:22.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:22.664 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-18T03:41:22.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[31238]: fuse finished with error 0 and tester_r 0 2024-04-18T03:41:22.679 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:41:28.781 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:41:28.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:28.781 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-18T03:41:28.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:28.790 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-04-18T03:41:28.798 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-18T03:41:28.798 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-18T03:41:28.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:28.798 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-18T03:41:28.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:28.857 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T03:41:28.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:28.867 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2024-04-18T03:41:29.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:29.022 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-18T03:41:29.030 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-18T03:41:29.030 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-18T03:41:29.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:29.030 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-18T03:41:29.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:29.089 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T03:41:29.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T03:41:29.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-18T03:41:29.270 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-18T03:41:29.283 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T03:41:29.284 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:41:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 Processor -- start 2024-04-18T03:41:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 -- start start 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c94071790 0x7f7c9406a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c9406aec0 0x7f7c9415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9415b5d0 con 0x7f7c94143bd0 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9406b700 con 0x7f7c9406aec0 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9415b3c0 con 0x7f7c94071790 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c93fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c9406aec0 0x7f7c9415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c93fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c9406aec0 0x7f7c9415c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55242/0 (socket says 172.21.15.157:55242) 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c93fff700 1 -- 172.21.15.157:0/2458997342 learned_addr learned my addr 172.21.15.157:0/2458997342 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c92ffd700 1 --2- 172.21.15.157:0/2458997342 >> v2:172.21.15.175:3300/0 conn(0x7f7c94071790 0x7f7c9406a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c93fff700 1 -- 172.21.15.157:0/2458997342 >> v2:172.21.15.175:3300/0 conn(0x7f7c94071790 msgr2=0x7f7c9406a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c93fff700 1 --2- 172.21.15.157:0/2458997342 >> v2:172.21.15.175:3300/0 conn(0x7f7c94071790 0x7f7c9406a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c93fff700 1 -- 172.21.15.157:0/2458997342 >> v1:172.21.15.175:6789/0 conn(0x7f7c94143bd0 legacy=0x7f7c94071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c93fff700 1 -- 172.21.15.157:0/2458997342 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9415b8b0 con 0x7f7c9406aec0 2024-04-18T03:41:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c93fff700 1 --2- 172.21.15.157:0/2458997342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c9406aec0 0x7f7c9415c390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c940ae920 tx=0x7f7c8c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1608199d037316a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c927fc700 1 -- 172.21.15.157:0/2458997342 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c011830 con 0x7f7c9406aec0 2024-04-18T03:41:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c927fc700 1 -- 172.21.15.157:0/2458997342 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c011990 con 0x7f7c9406aec0 2024-04-18T03:41:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c927fc700 1 -- 172.21.15.157:0/2458997342 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c011d20 con 0x7f7c9406aec0 2024-04-18T03:41:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 -- 172.21.15.157:0/2458997342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c9406aec0 msgr2=0x7f7c9415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/2458997342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c9406aec0 0x7f7c9415c390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c940ae920 tx=0x7f7c8c009bf0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 -- 172.21.15.157:0/2458997342 shutdown_connections 2024-04-18T03:41:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/2458997342 >> v2:172.21.15.175:3300/0 conn(0x7f7c94071790 0x7f7c9406a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/2458997342 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c9406aec0 0x7f7c9415c390 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.403+0000 7f7c9a21b700 1 -- 172.21.15.157:0/2458997342 >> 172.21.15.157:0/2458997342 conn(0x7f7c940b1170 msgr2=0x7f7c9406e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 -- 172.21.15.157:0/2458997342 shutdown_connections 2024-04-18T03:41:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 -- 172.21.15.157:0/2458997342 wait complete. 2024-04-18T03:41:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 Processor -- start 2024-04-18T03:41:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 -- start start 2024-04-18T03:41:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c9406aec0 0x7f7c9415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c94071790 0x7f7c9413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c94143bd0 0x7f7c941598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9413d090 con 0x7f7c94071790 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9413d370 con 0x7f7c9406aec0 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9413d650 con 0x7f7c94143bd0 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c94071790 0x7f7c9413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c94071790 0x7f7c9413fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55246/0 (socket says 172.21.15.157:55246) 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 -- 172.21.15.157:0/3316918383 learned_addr learned my addr 172.21.15.157:0/3316918383 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c937fe700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c9406aec0 0x7f7c9415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c93fff700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c94143bd0 0x7f7c941598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 -- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c94143bd0 msgr2=0x7f7c941598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c94143bd0 0x7f7c941598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 -- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c9406aec0 msgr2=0x7f7c9415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c9406aec0 0x7f7c9415a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 -- 172.21.15.157:0/3316918383 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c009570 con 0x7f7c94071790 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c93fff700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c94143bd0 0x7f7c941598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c92ffd700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c94071790 0x7f7c9413fda0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00e9d0 tx=0x7f7c7c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c8bfff700 1 -- 172.21.15.157:0/3316918383 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c009720 con 0x7f7c94071790 2024-04-18T03:41:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c8bfff700 1 -- 172.21.15.157:0/3316918383 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c00c850 con 0x7f7c94071790 2024-04-18T03:41:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9413d930 con 0x7f7c94071790 2024-04-18T03:41:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c8bfff700 1 -- 172.21.15.157:0/3316918383 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00cbc0 con 0x7f7c94071790 2024-04-18T03:41:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.407+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c941402e0 con 0x7f7c94071790 2024-04-18T03:41:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.411+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9404e6c0 con 0x7f7c94071790 2024-04-18T03:41:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.411+0000 7f7c8bfff700 1 -- 172.21.15.157:0/3316918383 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c7c00cd20 con 0x7f7c94071790 2024-04-18T03:41:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.411+0000 7f7c8bfff700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7c74066730 0x7f7c74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.411+0000 7f7c8bfff700 1 -- 172.21.15.157:0/3316918383 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c7c084600 con 0x7f7c94071790 2024-04-18T03:41:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.411+0000 7f7c937fe700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7c74066730 0x7f7c74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.411+0000 7f7c937fe700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7c74066730 0x7f7c74068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c94139e00 tx=0x7f7c84009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:29.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.419+0000 7f7c8bfff700 1 -- 172.21.15.157:0/3316918383 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f7c7c0515b0 con 0x7f7c94071790 2024-04-18T03:41:29.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.582+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c9413d4e0 con 0x7f7c74066730 2024-04-18T03:41:29.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.606+0000 7f7c8bfff700 1 -- 172.21.15.157:0/3316918383 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368926 (secure 0 0 0) 0x7f7c9413d4e0 con 0x7f7c74066730 2024-04-18T03:41:29.616 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:29.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.610+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7c74066730 msgr2=0x7f7c74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.610+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7c74066730 0x7f7c74068bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c94139e00 tx=0x7f7c84009040 comp rx=0 tx=0).stop 2024-04-18T03:41:29.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.610+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c94071790 msgr2=0x7f7c9413fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.610+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c94071790 0x7f7c9413fda0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00e9d0 tx=0x7f7c7c00ece0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.614+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 shutdown_connections 2024-04-18T03:41:29.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.614+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f7c74066730 0x7f7c74068bf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.614+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c94143bd0 0x7f7c941598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.614+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c94071790 0x7f7c9413fda0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.614+0000 7f7c9a21b700 1 --2- 172.21.15.157:0/3316918383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c9406aec0 0x7f7c9415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.614+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 >> 172.21.15.157:0/3316918383 conn(0x7f7c940b1170 msgr2=0x7f7c94144130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:29.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.614+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 shutdown_connections 2024-04-18T03:41:29.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.614+0000 7f7c9a21b700 1 -- 172.21.15.157:0/3316918383 wait complete. 2024-04-18T03:41:29.620 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:41:29.631 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-04-18T03:41:27.857614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31730824,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":488,"num_write":3272,"num_write_kb":34003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8652,"ondisk_log_size":8652,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":333616,"kb_used_data":64240,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754641104,"statfs":{"total":773094113280,"available":772752490496,"internally_reserved":0,"allocated":65781760,"data_stored":64389399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004667"},"pg_stats":[{"pgid":"2.1f","version":"27'41","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.601078+0000","last_change":"2024-04-18T03:37:33.922528+0000","last_active":"2024-04-18T03:40:39.601078+0000","last_peered":"2024-04-18T03:40:39.601078+0000","last_clean":"2024-04-18T03:40:39.601078+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:40:39.601078+0000","last_undegraded":"2024-04-18T03:40:39.601078+0000","last_fullsized":"2024-04-18T03:40:39.601078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:05:10.328715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551062+0000","last_change":"2024-04-18T03:37:34.316836+0000","last_active":"2024-04-18T03:40:52.551062+0000","last_peered":"2024-04-18T03:40:52.551062+0000","last_clean":"2024-04-18T03:40:52.551062+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:40:52.551062+0000","last_undegraded":"2024-04-18T03:40:52.551062+0000","last_fullsized":"2024-04-18T03:40:52.551062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'49","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845576+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:40:47.845576+0000","last_peered":"2024-04-18T03:40:47.845576+0000","last_clean":"2024-04-18T03:40:47.845576+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:40:47.845576+0000","last_undegraded":"2024-04-18T03:40:47.845576+0000","last_fullsized":"2024-04-18T03:40:47.845576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:51:07.334398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'30","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.112956+0000","last_change":"2024-04-18T03:37:33.925462+0000","last_active":"2024-04-18T03:40:42.112956+0000","last_peered":"2024-04-18T03:40:42.112956+0000","last_clean":"2024-04-18T03:40:42.112956+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:40:42.112956+0000","last_undegraded":"2024-04-18T03:40:42.112956+0000","last_fullsized":"2024-04-18T03:40:42.112956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:23.795590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'57","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553108+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:40:52.553108+0000","last_peered":"2024-04-18T03:40:52.553108+0000","last_clean":"2024-04-18T03:40:52.553108+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:40:52.553108+0000","last_undegraded":"2024-04-18T03:40:52.553108+0000","last_fullsized":"2024-04-18T03:40:52.553108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851456+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:40:47.851456+0000","last_peered":"2024-04-18T03:40:47.851456+0000","last_clean":"2024-04-18T03:40:47.851456+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:40:47.851456+0000","last_undegraded":"2024-04-18T03:40:47.851456+0000","last_fullsized":"2024-04-18T03:40:47.851456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'64","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:12.605809+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:41:12.605809+0000","last_peered":"2024-04-18T03:41:12.605809+0000","last_clean":"2024-04-18T03:41:12.605809+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:41:12.605809+0000","last_undegraded":"2024-04-18T03:41:12.605809+0000","last_fullsized":"2024-04-18T03:41:12.605809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604669,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562731+0000","last_change":"2024-04-18T03:37:34.306151+0000","last_active":"2024-04-18T03:40:52.562731+0000","last_peered":"2024-04-18T03:40:52.562731+0000","last_clean":"2024-04-18T03:40:52.562731+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:40:52.562731+0000","last_undegraded":"2024-04-18T03:40:52.562731+0000","last_fullsized":"2024-04-18T03:40:52.562731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'44","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847304+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:40:47.847304+0000","last_peered":"2024-04-18T03:40:47.847304+0000","last_clean":"2024-04-18T03:40:47.847304+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:40:47.847304+0000","last_undegraded":"2024-04-18T03:40:47.847304+0000","last_fullsized":"2024-04-18T03:40:47.847304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.587521+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:40:39.587521+0000","last_peered":"2024-04-18T03:40:39.587521+0000","last_clean":"2024-04-18T03:40:39.587521+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:40:39.587521+0000","last_undegraded":"2024-04-18T03:40:39.587521+0000","last_fullsized":"2024-04-18T03:40:39.587521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:12.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559721+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:40:52.559721+0000","last_peered":"2024-04-18T03:40:52.559721+0000","last_clean":"2024-04-18T03:40:52.559721+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:40:52.559721+0000","last_undegraded":"2024-04-18T03:40:52.559721+0000","last_fullsized":"2024-04-18T03:40:52.559721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'40","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847344+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:40:47.847344+0000","last_peered":"2024-04-18T03:40:47.847344+0000","last_clean":"2024-04-18T03:40:47.847344+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:40:47.847344+0000","last_undegraded":"2024-04-18T03:40:47.847344+0000","last_fullsized":"2024-04-18T03:40:47.847344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:29:44.713922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'42","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.542046+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:40:52.542046+0000","last_peered":"2024-04-18T03:40:52.542046+0000","last_clean":"2024-04-18T03:40:52.542046+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:40:52.542046+0000","last_undegraded":"2024-04-18T03:40:52.542046+0000","last_fullsized":"2024-04-18T03:40:52.542046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'527","reported_seq":545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598960+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:40:39.598960+0000","last_peered":"2024-04-18T03:40:39.598960+0000","last_clean":"2024-04-18T03:40:39.598960+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:40:39.598960+0000","last_undegraded":"2024-04-18T03:40:39.598960+0000","last_fullsized":"2024-04-18T03:40:39.598960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:08.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'41","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838531+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:40:47.838531+0000","last_peered":"2024-04-18T03:40:47.838531+0000","last_clean":"2024-04-18T03:40:47.838531+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:40:47.838531+0000","last_undegraded":"2024-04-18T03:40:47.838531+0000","last_fullsized":"2024-04-18T03:40:47.838531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:09:17.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543682+0000","last_change":"2024-04-18T03:38:23.517111+0000","last_active":"2024-04-18T03:40:52.543682+0000","last_peered":"2024-04-18T03:40:52.543682+0000","last_clean":"2024-04-18T03:40:52.543682+0000","last_became_active":"2024-04-18T03:38:23.516790+0000","last_became_peered":"2024-04-18T03:38:23.516790+0000","last_unstale":"2024-04-18T03:40:52.543682+0000","last_undegraded":"2024-04-18T03:40:52.543682+0000","last_fullsized":"2024-04-18T03:40:52.543682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:10:09.506622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"27'31","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.577011+0000","last_change":"2024-04-18T03:37:33.928257+0000","last_active":"2024-04-18T03:40:39.577011+0000","last_peered":"2024-04-18T03:40:39.577011+0000","last_clean":"2024-04-18T03:40:39.577011+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:40:39.577011+0000","last_undegraded":"2024-04-18T03:40:39.577011+0000","last_fullsized":"2024-04-18T03:40:39.577011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'48","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838662+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:40:47.838662+0000","last_peered":"2024-04-18T03:40:47.838662+0000","last_clean":"2024-04-18T03:40:47.838662+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:40:47.838662+0000","last_undegraded":"2024-04-18T03:40:47.838662+0000","last_fullsized":"2024-04-18T03:40:47.838662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552324+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:40:52.552324+0000","last_peered":"2024-04-18T03:40:52.552324+0000","last_clean":"2024-04-18T03:40:52.552324+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:40:52.552324+0000","last_undegraded":"2024-04-18T03:40:52.552324+0000","last_fullsized":"2024-04-18T03:40:52.552324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:15:10.489560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'28","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.722721+0000","last_change":"2024-04-18T03:37:33.921368+0000","last_active":"2024-04-18T03:40:49.722721+0000","last_peered":"2024-04-18T03:40:49.722721+0000","last_clean":"2024-04-18T03:40:49.722721+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:40:49.722721+0000","last_undegraded":"2024-04-18T03:40:49.722721+0000","last_fullsized":"2024-04-18T03:40:49.722721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'40","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857384+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:40:47.857384+0000","last_peered":"2024-04-18T03:40:47.857384+0000","last_clean":"2024-04-18T03:40:47.857384+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:40:47.857384+0000","last_undegraded":"2024-04-18T03:40:47.857384+0000","last_fullsized":"2024-04-18T03:40:47.857384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:26.586052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.524278+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:40:52.524278+0000","last_peered":"2024-04-18T03:40:52.524278+0000","last_clean":"2024-04-18T03:40:52.524278+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:40:52.524278+0000","last_undegraded":"2024-04-18T03:40:52.524278+0000","last_fullsized":"2024-04-18T03:40:52.524278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:55.630435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.595207+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:40:39.595207+0000","last_peered":"2024-04-18T03:40:39.595207+0000","last_clean":"2024-04-18T03:40:39.595207+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:40:39.595207+0000","last_undegraded":"2024-04-18T03:40:39.595207+0000","last_fullsized":"2024-04-18T03:40:39.595207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:07:09.652439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'42","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845971+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:40:47.845971+0000","last_peered":"2024-04-18T03:40:47.845971+0000","last_clean":"2024-04-18T03:40:47.845971+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:40:47.845971+0000","last_undegraded":"2024-04-18T03:40:47.845971+0000","last_fullsized":"2024-04-18T03:40:47.845971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549472+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:40:52.549472+0000","last_peered":"2024-04-18T03:40:52.549472+0000","last_clean":"2024-04-18T03:40:52.549472+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:40:52.549472+0000","last_undegraded":"2024-04-18T03:40:52.549472+0000","last_fullsized":"2024-04-18T03:40:52.549472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'26","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.731034+0000","last_change":"2024-04-18T03:37:33.929905+0000","last_active":"2024-04-18T03:40:49.731034+0000","last_peered":"2024-04-18T03:40:49.731034+0000","last_clean":"2024-04-18T03:40:49.731034+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:40:49.731034+0000","last_undegraded":"2024-04-18T03:40:49.731034+0000","last_fullsized":"2024-04-18T03:40:49.731034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'46","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.849762+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:40:47.849762+0000","last_peered":"2024-04-18T03:40:47.849762+0000","last_clean":"2024-04-18T03:40:47.849762+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:40:47.849762+0000","last_undegraded":"2024-04-18T03:40:47.849762+0000","last_fullsized":"2024-04-18T03:40:47.849762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559720+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:40:52.559720+0000","last_peered":"2024-04-18T03:40:52.559720+0000","last_clean":"2024-04-18T03:40:52.559720+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:40:52.559720+0000","last_undegraded":"2024-04-18T03:40:52.559720+0000","last_fullsized":"2024-04-18T03:40:52.559720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:16.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'38","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:48.070931+0000","last_change":"2024-04-18T03:37:33.932828+0000","last_active":"2024-04-18T03:40:48.070931+0000","last_peered":"2024-04-18T03:40:48.070931+0000","last_clean":"2024-04-18T03:40:48.070931+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:40:48.070931+0000","last_undegraded":"2024-04-18T03:40:48.070931+0000","last_fullsized":"2024-04-18T03:40:48.070931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:54.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'51","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.815270+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:40:47.815270+0000","last_peered":"2024-04-18T03:40:47.815270+0000","last_clean":"2024-04-18T03:40:47.815270+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:40:47.815270+0000","last_undegraded":"2024-04-18T03:40:47.815270+0000","last_fullsized":"2024-04-18T03:40:47.815270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:45.707050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'45","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549693+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:40:52.549693+0000","last_peered":"2024-04-18T03:40:52.549693+0000","last_clean":"2024-04-18T03:40:52.549693+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:40:52.549693+0000","last_undegraded":"2024-04-18T03:40:52.549693+0000","last_fullsized":"2024-04-18T03:40:52.549693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'28","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.591466+0000","last_change":"2024-04-18T03:37:33.924320+0000","last_active":"2024-04-18T03:40:39.591466+0000","last_peered":"2024-04-18T03:40:39.591466+0000","last_clean":"2024-04-18T03:40:39.591466+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:40:39.591466+0000","last_undegraded":"2024-04-18T03:40:39.591466+0000","last_fullsized":"2024-04-18T03:40:39.591466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851656+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:40:47.851656+0000","last_peered":"2024-04-18T03:40:47.851656+0000","last_clean":"2024-04-18T03:40:47.851656+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:40:47.851656+0000","last_undegraded":"2024-04-18T03:40:47.851656+0000","last_fullsized":"2024-04-18T03:40:47.851656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547280+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:40:52.547280+0000","last_peered":"2024-04-18T03:40:52.547280+0000","last_clean":"2024-04-18T03:40:52.547280+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:40:52.547280+0000","last_undegraded":"2024-04-18T03:40:52.547280+0000","last_fullsized":"2024-04-18T03:40:52.547280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'22","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.590635+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:40:39.590635+0000","last_peered":"2024-04-18T03:40:39.590635+0000","last_clean":"2024-04-18T03:40:39.590635+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:40:39.590635+0000","last_undegraded":"2024-04-18T03:40:39.590635+0000","last_fullsized":"2024-04-18T03:40:39.590635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:09.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'45","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.792824+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:40:47.792824+0000","last_peered":"2024-04-18T03:40:47.792824+0000","last_clean":"2024-04-18T03:40:47.792824+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:40:47.792824+0000","last_undegraded":"2024-04-18T03:40:47.792824+0000","last_fullsized":"2024-04-18T03:40:47.792824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549805+0000","last_change":"2024-04-18T03:37:34.308669+0000","last_active":"2024-04-18T03:40:52.549805+0000","last_peered":"2024-04-18T03:40:52.549805+0000","last_clean":"2024-04-18T03:40:52.549805+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:40:52.549805+0000","last_undegraded":"2024-04-18T03:40:52.549805+0000","last_fullsized":"2024-04-18T03:40:52.549805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:07.525115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598437+0000","last_change":"2024-04-18T03:37:33.921017+0000","last_active":"2024-04-18T03:40:39.598437+0000","last_peered":"2024-04-18T03:40:39.598437+0000","last_clean":"2024-04-18T03:40:39.598437+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:40:39.598437+0000","last_undegraded":"2024-04-18T03:40:39.598437+0000","last_fullsized":"2024-04-18T03:40:39.598437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857321+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:40:47.857321+0000","last_peered":"2024-04-18T03:40:47.857321+0000","last_clean":"2024-04-18T03:40:47.857321+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:40:47.857321+0000","last_undegraded":"2024-04-18T03:40:47.857321+0000","last_fullsized":"2024-04-18T03:40:47.857321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'45","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543795+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:40:52.543795+0000","last_peered":"2024-04-18T03:40:52.543795+0000","last_clean":"2024-04-18T03:40:52.543795+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:40:52.543795+0000","last_undegraded":"2024-04-18T03:40:52.543795+0000","last_fullsized":"2024-04-18T03:40:52.543795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'73","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.684345+0000","last_change":"2024-04-18T03:37:33.916761+0000","last_active":"2024-04-18T03:40:52.684345+0000","last_peered":"2024-04-18T03:40:52.684345+0000","last_clean":"2024-04-18T03:40:52.684345+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:40:52.684345+0000","last_undegraded":"2024-04-18T03:40:52.684345+0000","last_fullsized":"2024-04-18T03:40:52.684345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":44,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'49","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.798919+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:40:47.798919+0000","last_peered":"2024-04-18T03:40:47.798919+0000","last_clean":"2024-04-18T03:40:47.798919+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:40:47.798919+0000","last_undegraded":"2024-04-18T03:40:47.798919+0000","last_fullsized":"2024-04-18T03:40:47.798919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543231+0000","last_change":"2024-04-18T03:37:34.301044+0000","last_active":"2024-04-18T03:40:52.543231+0000","last_peered":"2024-04-18T03:40:52.543231+0000","last_clean":"2024-04-18T03:40:52.543231+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:40:52.543231+0000","last_undegraded":"2024-04-18T03:40:52.543231+0000","last_fullsized":"2024-04-18T03:40:52.543231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599677+0000","last_change":"2024-04-18T03:37:33.922934+0000","last_active":"2024-04-18T03:40:39.599677+0000","last_peered":"2024-04-18T03:40:39.599677+0000","last_clean":"2024-04-18T03:40:39.599677+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:40:39.599677+0000","last_undegraded":"2024-04-18T03:40:39.599677+0000","last_fullsized":"2024-04-18T03:40:39.599677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:21.818428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'40","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843748+0000","last_change":"2024-04-18T03:38:23.756539+0000","last_active":"2024-04-18T03:40:47.843748+0000","last_peered":"2024-04-18T03:40:47.843748+0000","last_clean":"2024-04-18T03:40:47.843748+0000","last_became_active":"2024-04-18T03:38:23.755354+0000","last_became_peered":"2024-04-18T03:38:23.755354+0000","last_unstale":"2024-04-18T03:40:47.843748+0000","last_undegraded":"2024-04-18T03:40:47.843748+0000","last_fullsized":"2024-04-18T03:40:47.843748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:13.146033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'57","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561718+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:40:52.561718+0000","last_peered":"2024-04-18T03:40:52.561718+0000","last_clean":"2024-04-18T03:40:52.561718+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:40:52.561718+0000","last_undegraded":"2024-04-18T03:40:52.561718+0000","last_fullsized":"2024-04-18T03:40:52.561718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599918+0000","last_change":"2024-04-18T03:37:33.919255+0000","last_active":"2024-04-18T03:40:39.599918+0000","last_peered":"2024-04-18T03:40:39.599918+0000","last_clean":"2024-04-18T03:40:39.599918+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:40:39.599918+0000","last_undegraded":"2024-04-18T03:40:39.599918+0000","last_fullsized":"2024-04-18T03:40:39.599918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:38:23.750319+0000","last_change":"2024-04-18T03:37:28.881821+0000","last_active":"2024-04-18T03:38:23.750319+0000","last_peered":"2024-04-18T03:38:23.750319+0000","last_clean":"2024-04-18T03:38:23.750319+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:38:23.750319+0000","last_undegraded":"2024-04-18T03:38:23.750319+0000","last_fullsized":"2024-04-18T03:38:23.750319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_clean_scrub_stamp":"2024-04-18T03:37:27.828246+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:15.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'35","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.829690+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:40:47.829690+0000","last_peered":"2024-04-18T03:40:47.829690+0000","last_clean":"2024-04-18T03:40:47.829690+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:40:47.829690+0000","last_undegraded":"2024-04-18T03:40:47.829690+0000","last_fullsized":"2024-04-18T03:40:47.829690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562621+0000","last_change":"2024-04-18T03:37:34.308036+0000","last_active":"2024-04-18T03:40:52.562621+0000","last_peered":"2024-04-18T03:40:52.562621+0000","last_clean":"2024-04-18T03:40:52.562621+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:40:52.562621+0000","last_undegraded":"2024-04-18T03:40:52.562621+0000","last_fullsized":"2024-04-18T03:40:52.562621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'29","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.601414+0000","last_change":"2024-04-18T03:37:33.922748+0000","last_active":"2024-04-18T03:40:39.601414+0000","last_peered":"2024-04-18T03:40:39.601414+0000","last_clean":"2024-04-18T03:40:39.601414+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:40:39.601414+0000","last_undegraded":"2024-04-18T03:40:39.601414+0000","last_fullsized":"2024-04-18T03:40:39.601414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'34","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.823501+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:40:47.823501+0000","last_peered":"2024-04-18T03:40:47.823501+0000","last_clean":"2024-04-18T03:40:47.823501+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:40:47.823501+0000","last_undegraded":"2024-04-18T03:40:47.823501+0000","last_fullsized":"2024-04-18T03:40:47.823501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:02.179174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560420+0000","last_change":"2024-04-18T03:37:34.300176+0000","last_active":"2024-04-18T03:40:52.560420+0000","last_peered":"2024-04-18T03:40:52.560420+0000","last_clean":"2024-04-18T03:40:52.560420+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:40:52.560420+0000","last_undegraded":"2024-04-18T03:40:52.560420+0000","last_fullsized":"2024-04-18T03:40:52.560420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.600329+0000","last_change":"2024-04-18T03:37:33.916221+0000","last_active":"2024-04-18T03:40:39.600329+0000","last_peered":"2024-04-18T03:40:39.600329+0000","last_clean":"2024-04-18T03:40:39.600329+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:40:39.600329+0000","last_undegraded":"2024-04-18T03:40:39.600329+0000","last_fullsized":"2024-04-18T03:40:39.600329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:06.510816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'55","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856820+0000","last_change":"2024-04-18T03:38:23.707932+0000","last_active":"2024-04-18T03:40:47.856820+0000","last_peered":"2024-04-18T03:40:47.856820+0000","last_clean":"2024-04-18T03:40:47.856820+0000","last_became_active":"2024-04-18T03:38:23.706819+0000","last_became_peered":"2024-04-18T03:38:23.706819+0000","last_unstale":"2024-04-18T03:40:47.856820+0000","last_undegraded":"2024-04-18T03:40:47.856820+0000","last_fullsized":"2024-04-18T03:40:47.856820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:51:19.448927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561853+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:40:52.561853+0000","last_peered":"2024-04-18T03:40:52.561853+0000","last_clean":"2024-04-18T03:40:52.561853+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:40:52.561853+0000","last_undegraded":"2024-04-18T03:40:52.561853+0000","last_fullsized":"2024-04-18T03:40:52.561853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.596947+0000","last_change":"2024-04-18T03:37:33.923743+0000","last_active":"2024-04-18T03:40:39.596947+0000","last_peered":"2024-04-18T03:40:39.596947+0000","last_clean":"2024-04-18T03:40:39.596947+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:40:39.596947+0000","last_undegraded":"2024-04-18T03:40:39.596947+0000","last_fullsized":"2024-04-18T03:40:39.596947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'50","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.853932+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:40:47.853932+0000","last_peered":"2024-04-18T03:40:47.853932+0000","last_clean":"2024-04-18T03:40:47.853932+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:40:47.853932+0000","last_undegraded":"2024-04-18T03:40:47.853932+0000","last_fullsized":"2024-04-18T03:40:47.853932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:26:14.663224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'39","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.544372+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:40:52.544372+0000","last_peered":"2024-04-18T03:40:52.544372+0000","last_clean":"2024-04-18T03:40:52.544372+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:40:52.544372+0000","last_undegraded":"2024-04-18T03:40:52.544372+0000","last_fullsized":"2024-04-18T03:40:52.544372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'23","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599132+0000","last_change":"2024-04-18T03:37:33.923624+0000","last_active":"2024-04-18T03:40:39.599132+0000","last_peered":"2024-04-18T03:40:39.599132+0000","last_clean":"2024-04-18T03:40:39.599132+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:40:39.599132+0000","last_undegraded":"2024-04-18T03:40:39.599132+0000","last_fullsized":"2024-04-18T03:40:39.599132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:30:29.619675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'47","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.830977+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:40:47.830977+0000","last_peered":"2024-04-18T03:40:47.830977+0000","last_clean":"2024-04-18T03:40:47.830977+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:40:47.830977+0000","last_undegraded":"2024-04-18T03:40:47.830977+0000","last_fullsized":"2024-04-18T03:40:47.830977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:42:56.306731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.539345+0000","last_change":"2024-04-18T03:37:34.304075+0000","last_active":"2024-04-18T03:40:52.539345+0000","last_peered":"2024-04-18T03:40:52.539345+0000","last_clean":"2024-04-18T03:40:52.539345+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:40:52.539345+0000","last_undegraded":"2024-04-18T03:40:52.539345+0000","last_fullsized":"2024-04-18T03:40:52.539345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'33","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.692279+0000","last_change":"2024-04-18T03:37:33.917032+0000","last_active":"2024-04-18T03:40:50.692279+0000","last_peered":"2024-04-18T03:40:50.692279+0000","last_clean":"2024-04-18T03:40:50.692279+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:40:50.692279+0000","last_undegraded":"2024-04-18T03:40:50.692279+0000","last_fullsized":"2024-04-18T03:40:50.692279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'54","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.835036+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:40:47.835036+0000","last_peered":"2024-04-18T03:40:47.835036+0000","last_clean":"2024-04-18T03:40:47.835036+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:40:47.835036+0000","last_undegraded":"2024-04-18T03:40:47.835036+0000","last_fullsized":"2024-04-18T03:40:47.835036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545077+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:40:52.545077+0000","last_peered":"2024-04-18T03:40:52.545077+0000","last_clean":"2024-04-18T03:40:52.545077+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:40:52.545077+0000","last_undegraded":"2024-04-18T03:40:52.545077+0000","last_fullsized":"2024-04-18T03:40:52.545077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'30","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.638004+0000","last_change":"2024-04-18T03:37:33.930343+0000","last_active":"2024-04-18T03:40:42.638004+0000","last_peered":"2024-04-18T03:40:42.638004+0000","last_clean":"2024-04-18T03:40:42.638004+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:40:42.638004+0000","last_undegraded":"2024-04-18T03:40:42.638004+0000","last_fullsized":"2024-04-18T03:40:42.638004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.839352+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:40:47.839352+0000","last_peered":"2024-04-18T03:40:47.839352+0000","last_clean":"2024-04-18T03:40:47.839352+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:40:47.839352+0000","last_undegraded":"2024-04-18T03:40:47.839352+0000","last_fullsized":"2024-04-18T03:40:47.839352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:57.028939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'63","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562675+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:40:52.562675+0000","last_peered":"2024-04-18T03:40:52.562675+0000","last_clean":"2024-04-18T03:40:52.562675+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:40:52.562675+0000","last_undegraded":"2024-04-18T03:40:52.562675+0000","last_fullsized":"2024-04-18T03:40:52.562675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'35","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.657282+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:40:42.657282+0000","last_peered":"2024-04-18T03:40:42.657282+0000","last_clean":"2024-04-18T03:40:42.657282+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:40:42.657282+0000","last_undegraded":"2024-04-18T03:40:42.657282+0000","last_fullsized":"2024-04-18T03:40:42.657282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'34","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.839304+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:40:47.839304+0000","last_peered":"2024-04-18T03:40:47.839304+0000","last_clean":"2024-04-18T03:40:47.839304+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:40:47.839304+0000","last_undegraded":"2024-04-18T03:40:47.839304+0000","last_fullsized":"2024-04-18T03:40:47.839304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:00:18.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563388+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:40:52.563388+0000","last_peered":"2024-04-18T03:40:52.563388+0000","last_clean":"2024-04-18T03:40:52.563388+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:40:52.563388+0000","last_undegraded":"2024-04-18T03:40:52.563388+0000","last_fullsized":"2024-04-18T03:40:52.563388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'17","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.592478+0000","last_change":"2024-04-18T03:37:33.927394+0000","last_active":"2024-04-18T03:40:39.592478+0000","last_peered":"2024-04-18T03:40:39.592478+0000","last_clean":"2024-04-18T03:40:39.592478+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:40:39.592478+0000","last_undegraded":"2024-04-18T03:40:39.592478+0000","last_fullsized":"2024-04-18T03:40:39.592478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'38","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.823050+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:40:47.823050+0000","last_peered":"2024-04-18T03:40:47.823050+0000","last_clean":"2024-04-18T03:40:47.823050+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:40:47.823050+0000","last_undegraded":"2024-04-18T03:40:47.823050+0000","last_fullsized":"2024-04-18T03:40:47.823050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:08.435358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562533+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:40:52.562533+0000","last_peered":"2024-04-18T03:40:52.562533+0000","last_clean":"2024-04-18T03:40:52.562533+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:40:52.562533+0000","last_undegraded":"2024-04-18T03:40:52.562533+0000","last_fullsized":"2024-04-18T03:40:52.562533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:16:02.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'909","reported_seq":927,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:02.522993+0000","last_change":"2024-04-18T03:37:33.929970+0000","last_active":"2024-04-18T03:41:02.522993+0000","last_peered":"2024-04-18T03:41:02.522993+0000","last_clean":"2024-04-18T03:41:02.522993+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:41:02.522993+0000","last_undegraded":"2024-04-18T03:41:02.522993+0000","last_fullsized":"2024-04-18T03:41:02.522993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.472626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.849440+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:40:47.849440+0000","last_peered":"2024-04-18T03:40:47.849440+0000","last_clean":"2024-04-18T03:40:47.849440+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:40:47.849440+0000","last_undegraded":"2024-04-18T03:40:47.849440+0000","last_fullsized":"2024-04-18T03:40:47.849440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.539661+0000","last_change":"2024-04-18T03:37:34.299294+0000","last_active":"2024-04-18T03:40:52.539661+0000","last_peered":"2024-04-18T03:40:52.539661+0000","last_clean":"2024-04-18T03:40:52.539661+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:40:52.539661+0000","last_undegraded":"2024-04-18T03:40:52.539661+0000","last_fullsized":"2024-04-18T03:40:52.539661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:10.767359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'48","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.706214+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:40:50.706214+0000","last_peered":"2024-04-18T03:40:50.706214+0000","last_clean":"2024-04-18T03:40:50.706214+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:40:50.706214+0000","last_undegraded":"2024-04-18T03:40:50.706214+0000","last_fullsized":"2024-04-18T03:40:50.706214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:42.808326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'45","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.840857+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:40:47.840857+0000","last_peered":"2024-04-18T03:40:47.840857+0000","last_clean":"2024-04-18T03:40:47.840857+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:40:47.840857+0000","last_undegraded":"2024-04-18T03:40:47.840857+0000","last_fullsized":"2024-04-18T03:40:47.840857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:40:51.668813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553243+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:40:52.553243+0000","last_peered":"2024-04-18T03:40:52.553243+0000","last_clean":"2024-04-18T03:40:52.553243+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:40:52.553243+0000","last_undegraded":"2024-04-18T03:40:52.553243+0000","last_fullsized":"2024-04-18T03:40:52.553243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599913+0000","last_change":"2024-04-18T03:37:33.931236+0000","last_active":"2024-04-18T03:40:39.599913+0000","last_peered":"2024-04-18T03:40:39.599913+0000","last_clean":"2024-04-18T03:40:39.599913+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:40:39.599913+0000","last_undegraded":"2024-04-18T03:40:39.599913+0000","last_fullsized":"2024-04-18T03:40:39.599913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'39","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843384+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:40:47.843384+0000","last_peered":"2024-04-18T03:40:47.843384+0000","last_clean":"2024-04-18T03:40:47.843384+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:40:47.843384+0000","last_undegraded":"2024-04-18T03:40:47.843384+0000","last_fullsized":"2024-04-18T03:40:47.843384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:23.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'73","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561939+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:40:52.561939+0000","last_peered":"2024-04-18T03:40:52.561939+0000","last_clean":"2024-04-18T03:40:52.561939+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:40:52.561939+0000","last_undegraded":"2024-04-18T03:40:52.561939+0000","last_fullsized":"2024-04-18T03:40:52.561939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'23","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598903+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:40:39.598903+0000","last_peered":"2024-04-18T03:40:39.598903+0000","last_clean":"2024-04-18T03:40:39.598903+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:40:39.598903+0000","last_undegraded":"2024-04-18T03:40:39.598903+0000","last_fullsized":"2024-04-18T03:40:39.598903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'42","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.819889+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:40:47.819889+0000","last_peered":"2024-04-18T03:40:47.819889+0000","last_clean":"2024-04-18T03:40:47.819889+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:40:47.819889+0000","last_undegraded":"2024-04-18T03:40:47.819889+0000","last_fullsized":"2024-04-18T03:40:47.819889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:29:14.484508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.818602+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:40:47.818602+0000","last_peered":"2024-04-18T03:40:47.818602+0000","last_clean":"2024-04-18T03:40:47.818602+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:40:47.818602+0000","last_undegraded":"2024-04-18T03:40:47.818602+0000","last_fullsized":"2024-04-18T03:40:47.818602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552611+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:40:52.552611+0000","last_peered":"2024-04-18T03:40:52.552611+0000","last_clean":"2024-04-18T03:40:52.552611+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:40:52.552611+0000","last_undegraded":"2024-04-18T03:40:52.552611+0000","last_fullsized":"2024-04-18T03:40:52.552611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:38.556875+0000","last_change":"2024-04-18T03:37:33.925286+0000","last_active":"2024-04-18T03:40:38.556875+0000","last_peered":"2024-04-18T03:40:38.556875+0000","last_clean":"2024-04-18T03:40:38.556875+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:40:38.556875+0000","last_undegraded":"2024-04-18T03:40:38.556875+0000","last_fullsized":"2024-04-18T03:40:38.556875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'50","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.850145+0000","last_change":"2024-04-18T03:38:23.708738+0000","last_active":"2024-04-18T03:40:47.850145+0000","last_peered":"2024-04-18T03:40:47.850145+0000","last_clean":"2024-04-18T03:40:47.850145+0000","last_became_active":"2024-04-18T03:38:23.707524+0000","last_became_peered":"2024-04-18T03:38:23.707524+0000","last_unstale":"2024-04-18T03:40:47.850145+0000","last_undegraded":"2024-04-18T03:40:47.850145+0000","last_fullsized":"2024-04-18T03:40:47.850145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:49:54.313746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'65","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551506+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:40:52.551506+0000","last_peered":"2024-04-18T03:40:52.551506+0000","last_clean":"2024-04-18T03:40:52.551506+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:40:52.551506+0000","last_undegraded":"2024-04-18T03:40:52.551506+0000","last_fullsized":"2024-04-18T03:40:52.551506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:14:23.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'19","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.591356+0000","last_change":"2024-04-18T03:37:33.932436+0000","last_active":"2024-04-18T03:40:39.591356+0000","last_peered":"2024-04-18T03:40:39.591356+0000","last_clean":"2024-04-18T03:40:39.591356+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:40:39.591356+0000","last_undegraded":"2024-04-18T03:40:39.591356+0000","last_fullsized":"2024-04-18T03:40:39.591356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:11.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'42","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598520+0000","last_change":"2024-04-18T03:37:33.929695+0000","last_active":"2024-04-18T03:40:39.598520+0000","last_peered":"2024-04-18T03:40:39.598520+0000","last_clean":"2024-04-18T03:40:39.598520+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:40:39.598520+0000","last_undegraded":"2024-04-18T03:40:39.598520+0000","last_fullsized":"2024-04-18T03:40:39.598520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:29.848633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554295+0000","last_change":"2024-04-18T03:37:34.306548+0000","last_active":"2024-04-18T03:40:52.554295+0000","last_peered":"2024-04-18T03:40:52.554295+0000","last_clean":"2024-04-18T03:40:52.554295+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:40:52.554295+0000","last_undegraded":"2024-04-18T03:40:52.554295+0000","last_fullsized":"2024-04-18T03:40:52.554295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843692+0000","last_change":"2024-04-18T03:37:38.336681+0000","last_active":"2024-04-18T03:40:47.843692+0000","last_peered":"2024-04-18T03:40:47.843692+0000","last_clean":"2024-04-18T03:40:47.843692+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:40:47.843692+0000","last_undegraded":"2024-04-18T03:40:47.843692+0000","last_fullsized":"2024-04-18T03:40:47.843692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:16.022475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1515","reported_seq":1533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.603653+0000","last_change":"2024-04-18T03:37:33.923165+0000","last_active":"2024-04-18T03:40:39.603653+0000","last_peered":"2024-04-18T03:40:39.603653+0000","last_clean":"2024-04-18T03:40:39.603653+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:40:39.603653+0000","last_undegraded":"2024-04-18T03:40:39.603653+0000","last_fullsized":"2024-04-18T03:40:39.603653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1515,"log_dups_size":0,"ondisk_log_size":1515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1489,"num_write_kb":4584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'44","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.542586+0000","last_change":"2024-04-18T03:37:34.289192+0000","last_active":"2024-04-18T03:40:52.542586+0000","last_peered":"2024-04-18T03:40:52.542586+0000","last_clean":"2024-04-18T03:40:52.542586+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:40:52.542586+0000","last_undegraded":"2024-04-18T03:40:52.542586+0000","last_fullsized":"2024-04-18T03:40:52.542586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:35.397966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'55","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856434+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:40:47.856434+0000","last_peered":"2024-04-18T03:40:47.856434+0000","last_clean":"2024-04-18T03:40:47.856434+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:40:47.856434+0000","last_undegraded":"2024-04-18T03:40:47.856434+0000","last_fullsized":"2024-04-18T03:40:47.856434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:57.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'69","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.548740+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:40:52.548740+0000","last_peered":"2024-04-18T03:40:52.548740+0000","last_clean":"2024-04-18T03:40:52.548740+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:40:52.548740+0000","last_undegraded":"2024-04-18T03:40:52.548740+0000","last_fullsized":"2024-04-18T03:40:52.548740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'59","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553815+0000","last_change":"2024-04-18T03:37:34.295362+0000","last_active":"2024-04-18T03:40:52.553815+0000","last_peered":"2024-04-18T03:40:52.553815+0000","last_clean":"2024-04-18T03:40:52.553815+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:40:52.553815+0000","last_undegraded":"2024-04-18T03:40:52.553815+0000","last_fullsized":"2024-04-18T03:40:52.553815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:13.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554725+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:40:52.554725+0000","last_peered":"2024-04-18T03:40:52.554725+0000","last_clean":"2024-04-18T03:40:52.554725+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:40:52.554725+0000","last_undegraded":"2024-04-18T03:40:52.554725+0000","last_fullsized":"2024-04-18T03:40:52.554725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'52","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553829+0000","last_change":"2024-04-18T03:37:34.305580+0000","last_active":"2024-04-18T03:40:52.553829+0000","last_peered":"2024-04-18T03:40:52.553829+0000","last_clean":"2024-04-18T03:40:52.553829+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:40:52.553829+0000","last_undegraded":"2024-04-18T03:40:52.553829+0000","last_fullsized":"2024-04-18T03:40:52.553829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.550134+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:40:52.550134+0000","last_peered":"2024-04-18T03:40:52.550134+0000","last_clean":"2024-04-18T03:40:52.550134+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:40:52.550134+0000","last_undegraded":"2024-04-18T03:40:52.550134+0000","last_fullsized":"2024-04-18T03:40:52.550134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'37","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546218+0000","last_change":"2024-04-18T03:37:34.298453+0000","last_active":"2024-04-18T03:40:52.546218+0000","last_peered":"2024-04-18T03:40:52.546218+0000","last_clean":"2024-04-18T03:40:52.546218+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:40:52.546218+0000","last_undegraded":"2024-04-18T03:40:52.546218+0000","last_fullsized":"2024-04-18T03:40:52.546218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'66","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.558555+0000","last_change":"2024-04-18T03:38:23.515116+0000","last_active":"2024-04-18T03:40:52.558555+0000","last_peered":"2024-04-18T03:40:52.558555+0000","last_clean":"2024-04-18T03:40:52.558555+0000","last_became_active":"2024-04-18T03:38:23.514633+0000","last_became_peered":"2024-04-18T03:38:23.514633+0000","last_unstale":"2024-04-18T03:40:52.558555+0000","last_undegraded":"2024-04-18T03:40:52.558555+0000","last_fullsized":"2024-04-18T03:40:52.558555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:04.434087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'42","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547910+0000","last_change":"2024-04-18T03:37:34.310319+0000","last_active":"2024-04-18T03:40:52.547910+0000","last_peered":"2024-04-18T03:40:52.547910+0000","last_clean":"2024-04-18T03:40:52.547910+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:40:52.547910+0000","last_undegraded":"2024-04-18T03:40:52.547910+0000","last_fullsized":"2024-04-18T03:40:52.547910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:44.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560802+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:40:52.560802+0000","last_peered":"2024-04-18T03:40:52.560802+0000","last_clean":"2024-04-18T03:40:52.560802+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:40:52.560802+0000","last_undegraded":"2024-04-18T03:40:52.560802+0000","last_fullsized":"2024-04-18T03:40:52.560802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551501+0000","last_change":"2024-04-18T03:37:34.310229+0000","last_active":"2024-04-18T03:40:52.551501+0000","last_peered":"2024-04-18T03:40:52.551501+0000","last_clean":"2024-04-18T03:40:52.551501+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:40:52.551501+0000","last_undegraded":"2024-04-18T03:40:52.551501+0000","last_fullsized":"2024-04-18T03:40:52.551501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'58","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563696+0000","last_change":"2024-04-18T03:38:23.754521+0000","last_active":"2024-04-18T03:40:52.563696+0000","last_peered":"2024-04-18T03:40:52.563696+0000","last_clean":"2024-04-18T03:40:52.563696+0000","last_became_active":"2024-04-18T03:38:23.753851+0000","last_became_peered":"2024-04-18T03:38:23.753851+0000","last_unstale":"2024-04-18T03:40:52.563696+0000","last_undegraded":"2024-04-18T03:40:52.563696+0000","last_fullsized":"2024-04-18T03:40:52.563696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:13:50.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"27'63","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.564060+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:40:52.564060+0000","last_peered":"2024-04-18T03:40:52.564060+0000","last_clean":"2024-04-18T03:40:52.564060+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:40:52.564060+0000","last_undegraded":"2024-04-18T03:40:52.564060+0000","last_fullsized":"2024-04-18T03:40:52.564060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'62","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545598+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:40:52.545598+0000","last_peered":"2024-04-18T03:40:52.545598+0000","last_clean":"2024-04-18T03:40:52.545598+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:40:52.545598+0000","last_undegraded":"2024-04-18T03:40:52.545598+0000","last_fullsized":"2024-04-18T03:40:52.545598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561058+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:40:52.561058+0000","last_peered":"2024-04-18T03:40:52.561058+0000","last_clean":"2024-04-18T03:40:52.561058+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:40:52.561058+0000","last_undegraded":"2024-04-18T03:40:52.561058+0000","last_fullsized":"2024-04-18T03:40:52.561058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551885+0000","last_change":"2024-04-18T03:37:34.313079+0000","last_active":"2024-04-18T03:40:52.551885+0000","last_peered":"2024-04-18T03:40:52.551885+0000","last_clean":"2024-04-18T03:40:52.551885+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:40:52.551885+0000","last_undegraded":"2024-04-18T03:40:52.551885+0000","last_fullsized":"2024-04-18T03:40:52.551885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:50.485855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562415+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:40:52.562415+0000","last_peered":"2024-04-18T03:40:52.562415+0000","last_clean":"2024-04-18T03:40:52.562415+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:40:52.562415+0000","last_undegraded":"2024-04-18T03:40:52.562415+0000","last_fullsized":"2024-04-18T03:40:52.562415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551256+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:40:52.551256+0000","last_peered":"2024-04-18T03:40:52.551256+0000","last_clean":"2024-04-18T03:40:52.551256+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:40:52.551256+0000","last_undegraded":"2024-04-18T03:40:52.551256+0000","last_fullsized":"2024-04-18T03:40:52.551256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'53","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547747+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:40:52.547747+0000","last_peered":"2024-04-18T03:40:52.547747+0000","last_clean":"2024-04-18T03:40:52.547747+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:40:52.547747+0000","last_undegraded":"2024-04-18T03:40:52.547747+0000","last_fullsized":"2024-04-18T03:40:52.547747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'59","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547235+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:40:52.547235+0000","last_peered":"2024-04-18T03:40:52.547235+0000","last_clean":"2024-04-18T03:40:52.547235+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:40:52.547235+0000","last_undegraded":"2024-04-18T03:40:52.547235+0000","last_fullsized":"2024-04-18T03:40:52.547235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551542+0000","last_change":"2024-04-18T03:37:34.314282+0000","last_active":"2024-04-18T03:40:52.551542+0000","last_peered":"2024-04-18T03:40:52.551542+0000","last_clean":"2024-04-18T03:40:52.551542+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:40:52.551542+0000","last_undegraded":"2024-04-18T03:40:52.551542+0000","last_fullsized":"2024-04-18T03:40:52.551542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'44","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.527773+0000","last_change":"2024-04-18T03:37:34.299168+0000","last_active":"2024-04-18T03:40:52.527773+0000","last_peered":"2024-04-18T03:40:52.527773+0000","last_clean":"2024-04-18T03:40:52.527773+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:40:52.527773+0000","last_undegraded":"2024-04-18T03:40:52.527773+0000","last_fullsized":"2024-04-18T03:40:52.527773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:43.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551884+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:40:52.551884+0000","last_peered":"2024-04-18T03:40:52.551884+0000","last_clean":"2024-04-18T03:40:52.551884+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:40:52.551884+0000","last_undegraded":"2024-04-18T03:40:52.551884+0000","last_fullsized":"2024-04-18T03:40:52.551884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'53","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560125+0000","last_change":"2024-04-18T03:38:23.515120+0000","last_active":"2024-04-18T03:40:52.560125+0000","last_peered":"2024-04-18T03:40:52.560125+0000","last_clean":"2024-04-18T03:40:52.560125+0000","last_became_active":"2024-04-18T03:38:23.514732+0000","last_became_peered":"2024-04-18T03:38:23.514732+0000","last_unstale":"2024-04-18T03:40:52.560125+0000","last_undegraded":"2024-04-18T03:40:52.560125+0000","last_fullsized":"2024-04-18T03:40:52.560125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:10.490370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561761+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:40:52.561761+0000","last_peered":"2024-04-18T03:40:52.561761+0000","last_clean":"2024-04-18T03:40:52.561761+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:40:52.561761+0000","last_undegraded":"2024-04-18T03:40:52.561761+0000","last_fullsized":"2024-04-18T03:40:52.561761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561804+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:40:52.561804+0000","last_peered":"2024-04-18T03:40:52.561804+0000","last_clean":"2024-04-18T03:40:52.561804+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:40:52.561804+0000","last_undegraded":"2024-04-18T03:40:52.561804+0000","last_fullsized":"2024-04-18T03:40:52.561804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552286+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:40:52.552286+0000","last_peered":"2024-04-18T03:40:52.552286+0000","last_clean":"2024-04-18T03:40:52.552286+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:40:52.552286+0000","last_undegraded":"2024-04-18T03:40:52.552286+0000","last_fullsized":"2024-04-18T03:40:52.552286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547093+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:40:52.547093+0000","last_peered":"2024-04-18T03:40:52.547093+0000","last_clean":"2024-04-18T03:40:52.547093+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:40:52.547093+0000","last_undegraded":"2024-04-18T03:40:52.547093+0000","last_fullsized":"2024-04-18T03:40:52.547093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562460+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:40:52.562460+0000","last_peered":"2024-04-18T03:40:52.562460+0000","last_clean":"2024-04-18T03:40:52.562460+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:40:52.562460+0000","last_undegraded":"2024-04-18T03:40:52.562460+0000","last_fullsized":"2024-04-18T03:40:52.562460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'40","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560874+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:40:52.560874+0000","last_peered":"2024-04-18T03:40:52.560874+0000","last_clean":"2024-04-18T03:40:52.560874+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:40:52.560874+0000","last_undegraded":"2024-04-18T03:40:52.560874+0000","last_fullsized":"2024-04-18T03:40:52.560874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545925+0000","last_change":"2024-04-18T03:37:34.300927+0000","last_active":"2024-04-18T03:40:52.545925+0000","last_peered":"2024-04-18T03:40:52.545925+0000","last_clean":"2024-04-18T03:40:52.545925+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:40:52.545925+0000","last_undegraded":"2024-04-18T03:40:52.545925+0000","last_fullsized":"2024-04-18T03:40:52.545925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546623+0000","last_change":"2024-04-18T03:37:34.289446+0000","last_active":"2024-04-18T03:40:52.546623+0000","last_peered":"2024-04-18T03:40:52.546623+0000","last_clean":"2024-04-18T03:40:52.546623+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:40:52.546623+0000","last_undegraded":"2024-04-18T03:40:52.546623+0000","last_fullsized":"2024-04-18T03:40:52.546623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560712+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:40:52.560712+0000","last_peered":"2024-04-18T03:40:52.560712+0000","last_clean":"2024-04-18T03:40:52.560712+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:40:52.560712+0000","last_undegraded":"2024-04-18T03:40:52.560712+0000","last_fullsized":"2024-04-18T03:40:52.560712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:49.338554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31140456,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":3113,"num_write_kb":31587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62341120,"data_stored":62280912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3821,"ondisk_log_size":3821,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49160,"kb_used_data":13952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94322680,"statfs":{"total":96636764160,"available":96586424320,"internally_reserved":0,"allocated":14286848,"data_stored":14110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83799999999999997,"15min":0.86699999999999999},"min":{"1min":0.48899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1299999999999999,"5min":1.286,"15min":1.286},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.87,"15min":0.89100000000000001},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2110000000000001,"5min":1.331,"15min":1.331},"last":0.97299999999999998}]},{"osd":1,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.88200000000000001},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1000000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.879},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.879},"min":{"1min":0.59599999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.133,"5min":1.724,"15min":1.724},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96999999999999997,"15min":0.98999999999999999},"min":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.298,"5min":1.329,"15min":1.329},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86499999999999999,"15min":0.89000000000000001},"min":{"1min":0.59999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0669999999999999,"5min":1.228,"15min":1.228},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83599999999999997,"15min":0.83399999999999996},"min":{"1min":0.69699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.097,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90000000000000002,"15min":0.88},"min":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.081,"15min":1.101},"min":{"1min":0.86899999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7350000000000001,"5min":2.198,"15min":2.198},"last":1.123}]},{"osd":5,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90500000000000003,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":1.0109999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.75}]},{"osd":7,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0700000000000001,"15min":1.0760000000000001},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.0620000000000001},"min":{"1min":0.78200000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4450000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0349999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39588,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94332252,"statfs":{"total":96636764160,"available":96596226048,"internally_reserved":0,"allocated":8679424,"data_stored":8504374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77200000000000002,"15min":0.77600000000000002},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.105,"15min":1.105},"last":0.746},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"min":{"1min":0.61499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95099999999999996,"15min":0.96699999999999997},"min":{"1min":0.65000000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2529999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.94599999999999995}]},{"osd":2,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.83699999999999997,"15min":0.81100000000000005},"min":{"1min":0.67800000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2769999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90200000000000002,"15min":0.91500000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.157,"5min":1.224,"15min":1.224},"last":1.048}]},{"osd":3,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.72199999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.61599999999999999},{"interface":"front","average":{"1min":1,"5min":0.94199999999999995,"15min":0.92400000000000004},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93100000000000005,"15min":0.92700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.877},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95699999999999996,"15min":0.96299999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.234,"5min":1.236,"15min":1.236},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0149999999999999,"15min":0.98299999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.012},{"interface":"front","average":{"1min":1.133,"5min":1.1240000000000001,"15min":1.127},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.161}]},{"osd":7,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.054,"15min":1.054},"min":{"1min":0.747,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3740000000000001,"5min":1.395,"15min":1.395},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.155,"15min":1.125},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1240000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57928,"kb_used_data":18624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94313912,"statfs":{"total":96636764160,"available":96577445888,"internally_reserved":0,"allocated":19070976,"data_stored":18894785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77900000000000003,"15min":0.80400000000000005},"min":{"1min":0.52900000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0309999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1579999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.093}]},{"osd":1,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1479999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.495,"15min":0.495},"max":{"1min":1.034,"5min":1.123,"15min":1.123},"last":1.1220000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.63400000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0860000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.621,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.92000000000000004,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1799999999999999,"5min":1.232,"15min":1.232},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.216,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.181,"5min":1.679,"15min":1.679},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97299999999999998,"15min":0.98099999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2470000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.036}]},{"osd":5,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3380000000000001,"5min":1.617,"15min":1.617},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.79100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2729999999999999,"5min":1.496,"15min":1.496},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.80100000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.534,"5min":1.593,"15min":1.593},"last":1.167},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2549999999999999,"5min":1.462,"15min":1.462},"last":1.23}]}]},{"osd":5,"up_from":14,"seq":60129542195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":116344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.86699999999999999,"15min":0.90600000000000003},"min":{"1min":0.54600000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83599999999999997,"15min":0.85299999999999998},"min":{"1min":0.55500000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3700000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.89100000000000001},"min":{"1min":0.64800000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.878},"min":{"1min":0.64800000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0109999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91600000000000004,"15min":0.93799999999999994},"min":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.115,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.014,"15min":1.046},"min":{"1min":0.74399999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.534,"5min":1.536,"15min":1.536},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.70499999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2430000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.04},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93600000000000005,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.97399999999999998}]},{"osd":4,"last update":"Thu Apr 18 03:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.006,"15min":1.038},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2370000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":1.0329999999999999,"15min":1.079},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.506,"5min":1.631,"15min":1.631},"last":1.0609999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.006},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1220000000000001,"15min":1.1499999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4059999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.214}]},{"osd":7,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.014,"15min":1.046},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.196,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.256},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2230000000000001,"15min":1.26},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.46,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.1599999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":12932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":13242368,"data_stored":13068331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.228,"5min":2.202,"15min":2.202},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.2290000000000001,"5min":1.629,"15min":1.629},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.622,"5min":0.38,"15min":0.38},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.748,"15min":0.749},"min":{"1min":0.59399999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.026,"5min":0.86399999999999999,"15min":0.86799999999999999},"min":{"1min":0.73399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.5900000000000001,"5min":1.821,"15min":1.821},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.98099999999999998,"15min":0.97999999999999998},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.94099999999999995,"15min":0.93799999999999994},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3839999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.75800000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0449999999999999,"15min":1.024},"min":{"1min":0.84699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.1659999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0669999999999999,"15min":1.0680000000000001},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.0920000000000001,"15min":1.0720000000000001},"min":{"1min":0.97699999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.022,"15min":1.012},"min":{"1min":0.86799999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.198},{"interface":"front","average":{"1min":1.238,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.98699999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8149999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.089}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35844,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335996,"statfs":{"total":96636764160,"available":96600059904,"internally_reserved":0,"allocated":651264,"data_stored":484747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63300000000000001,"15min":0.65000000000000002},"min":{"1min":0.33200000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.94599999999999995,"5min":0.995,"15min":0.995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.39900000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.145,"5min":1.532,"15min":1.532},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.316,"15min":0.316},"max":{"1min":1.0880000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.44400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.55400000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Apr 18 03:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.409,"15min":1.409},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96899999999999997,"15min":0.98499999999999999},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1,"15min":1.016},"min":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":1.0169999999999999},"min":{"1min":0.63400000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.048,"15min":1.0589999999999999},"min":{"1min":0.76600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.03,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.137}]},{"osd":7,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0529999999999999,"15min":1.081},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.143,"5min":1.0620000000000001,"15min":1.0740000000000001},"min":{"1min":0.78600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.03}]}]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35492,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336348,"statfs":{"total":96636764160,"available":96600420352,"internally_reserved":0,"allocated":290816,"data_stored":116414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.504,"5min":0.25,"15min":0.25},"max":{"1min":0.78300000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.48999999999999999,"5min":0.215,"15min":0.215},"max":{"1min":1.1020000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.50600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.64000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3169999999999999,"5min":1.321,"15min":1.321},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80500000000000005,"15min":0.83499999999999996},"min":{"1min":0.58199999999999996,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.028,"5min":1.583,"15min":1.583},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.69899999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1180000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2190000000000001,"5min":1.337,"15min":1.337},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.70399999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.244,"5min":1.274,"15min":1.274},"last":0.748}]},{"osd":5,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98999999999999999,"15min":1.006},"min":{"1min":0.73499999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2649999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.84399999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.304,"5min":1.353,"15min":1.353},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.095,"15min":1.143},"min":{"1min":0.81599999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4179999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.099,"5min":1.0900000000000001,"15min":1.123},"min":{"1min":0.83099999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.407,"5min":2.242,"15min":2.242},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1020000000000001,"15min":1.137},"min":{"1min":0.997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3640000000000001,"5min":2.044,"15min":2.044},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.96299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4590000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.012}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44264,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94327576,"statfs":{"total":96636764160,"available":96591437824,"internally_reserved":0,"allocated":9273344,"data_stored":9094201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.51300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.49099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.68700000000000006,"15min":0.69599999999999995},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.66600000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99099999999999999,"5min":1.103,"15min":1.103},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.70699999999999996,"15min":0.68100000000000005},"min":{"1min":0.52800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.751},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.58399999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68799999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.048},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98799999999999999,"15min":0.96799999999999997},"min":{"1min":0.85399999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.077},{"interface":"front","average":{"1min":1.129,"5min":1.0600000000000001,"15min":1.0549999999999999},"min":{"1min":0.85799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4890000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0389999999999999,"15min":1.0329999999999999},"min":{"1min":0.84599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4910000000000001,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.077,"15min":1.0640000000000001},"min":{"1min":0.82399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.1299999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.048,"15min":1.0600000000000001},"min":{"1min":0.79700000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2989999999999999,"5min":1.484,"15min":1.484},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.127,"15min":1.123},"min":{"1min":0.78200000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.97599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14004224,"data_stored":13993949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18194432,"data_stored":18188163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:41:29.638 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:41:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.742+0000 7ff1d680a700 1 Processor -- start 2024-04-18T03:41:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.742+0000 7ff1d680a700 1 -- start start 2024-04-18T03:41:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff1d0071790 0x7ff1d006a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d015b5d0 con 0x7ff1d0143bd0 2024-04-18T03:41:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d015b8b0 con 0x7ff1d006aec0 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d006b700 con 0x7ff1d0071790 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1cf7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff1d0071790 0x7ff1d006a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1cf7fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff1d0071790 0x7ff1d006a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55256/0 (socket says 172.21.15.157:55256) 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1cf7fe700 1 -- 172.21.15.157:0/1141734189 learned_addr learned my addr 172.21.15.157:0/1141734189 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1cf7fe700 1 -- 172.21.15.157:0/1141734189 >> v1:172.21.15.175:6789/0 conn(0x7ff1d006aec0 legacy=0x7ff1d015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1cf7fe700 1 -- 172.21.15.157:0/1141734189 >> v1:172.21.15.157:6789/0 conn(0x7ff1d0143bd0 legacy=0x7ff1d0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1cf7fe700 1 -- 172.21.15.157:0/1141734189 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d015bb90 con 0x7ff1d0071790 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1cf7fe700 1 --2- 172.21.15.157:0/1141734189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0071790 0x7ff1d006a980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009910 tx=0x7ff1c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b294bc113b3e15ee server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1ceffd700 1 -- 172.21.15.157:0/1141734189 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0004230 con 0x7ff1d0071790 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1ceffd700 1 -- 172.21.15.157:0/1141734189 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0004390 con 0x7ff1d0071790 2024-04-18T03:41:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1ceffd700 1 -- 172.21.15.157:0/1141734189 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0009e60 con 0x7ff1d0071790 2024-04-18T03:41:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 -- 172.21.15.157:0/1141734189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0071790 msgr2=0x7ff1d006a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 --2- 172.21.15.157:0/1141734189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0071790 0x7ff1d006a980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009910 tx=0x7ff1c0009c20 comp rx=0 tx=0).stop 2024-04-18T03:41:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 -- 172.21.15.157:0/1141734189 shutdown_connections 2024-04-18T03:41:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 --2- 172.21.15.157:0/1141734189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0071790 0x7ff1d006a980 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 -- 172.21.15.157:0/1141734189 >> 172.21.15.157:0/1141734189 conn(0x7ff1d00b1170 msgr2=0x7ff1d006e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 -- 172.21.15.157:0/1141734189 shutdown_connections 2024-04-18T03:41:29.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.746+0000 7ff1d680a700 1 -- 172.21.15.157:0/1141734189 wait complete. 2024-04-18T03:41:29.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 Processor -- start 2024-04-18T03:41:29.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 -- start start 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1d006aec0 0x7ff1d014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1d0071790 0x7ff1d014b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0143bd0 0x7ff1d0139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d013f8d0 con 0x7ff1d0143bd0 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d013a2d0 con 0x7ff1d0071790 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d014b730 con 0x7ff1d006aec0 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0143bd0 0x7ff1d0139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0143bd0 0x7ff1d0139d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55268/0 (socket says 172.21.15.157:55268) 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 -- 172.21.15.157:0/2018596117 learned_addr learned my addr 172.21.15.157:0/2018596117 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1cffff700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1d006aec0 0x7ff1d014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1cf7fe700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1d0071790 0x7ff1d014b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 -- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1d006aec0 msgr2=0x7ff1d014dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1d006aec0 0x7ff1d014dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 -- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1d0071790 msgr2=0x7ff1d014b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1d0071790 0x7ff1d014b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 -- 172.21.15.157:0/2018596117 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c0009570 con 0x7ff1d0143bd0 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d4da7700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0143bd0 0x7ff1d0139d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c7c0 tx=0x7ff1c800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1ccff9700 1 -- 172.21.15.157:0/2018596117 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8003e30 con 0x7ff1d0143bd0 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1ccff9700 1 -- 172.21.15.157:0/2018596117 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c8005070 con 0x7ff1d0143bd0 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d014ba10 con 0x7ff1d0143bd0 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1ccff9700 1 -- 172.21.15.157:0/2018596117 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8005420 con 0x7ff1d0143bd0 2024-04-18T03:41:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.750+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d014bfd0 con 0x7ff1d0143bd0 2024-04-18T03:41:29.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.754+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d006a6f0 con 0x7ff1d0143bd0 2024-04-18T03:41:29.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.754+0000 7ff1ccff9700 1 -- 172.21.15.157:0/2018596117 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1c8005580 con 0x7ff1d0143bd0 2024-04-18T03:41:29.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.754+0000 7ff1ccff9700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff1bc066760 0x7ff1bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:29.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.754+0000 7ff1ccff9700 1 -- 172.21.15.157:0/2018596117 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff1c8083960 con 0x7ff1d0143bd0 2024-04-18T03:41:29.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.754+0000 7ff1cffff700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff1bc066760 0x7ff1bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:29.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.758+0000 7ff1cffff700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff1bc066760 0x7ff1bc068c20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4001800 tx=0x7ff1c4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:29.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.762+0000 7ff1ccff9700 1 -- 172.21.15.157:0/2018596117 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff1c8050a50 con 0x7ff1d0143bd0 2024-04-18T03:41:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.926+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1d004e6c0 con 0x7ff1bc066760 2024-04-18T03:41:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.946+0000 7ff1ccff9700 1 -- 172.21.15.157:0/2018596117 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368945 (secure 0 0 0) 0x7ff1d004e6c0 con 0x7ff1bc066760 2024-04-18T03:41:29.955 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff1bc066760 msgr2=0x7ff1bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff1bc066760 0x7ff1bc068c20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4001800 tx=0x7ff1c4009040 comp rx=0 tx=0).stop 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0143bd0 msgr2=0x7ff1d0139d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0143bd0 0x7ff1d0139d90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c7c0 tx=0x7ff1c800cad0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 shutdown_connections 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff1bc066760 0x7ff1bc068c20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1d0071790 0x7ff1d014b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff1d0143bd0 0x7ff1d0139d90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 --2- 172.21.15.157:0/2018596117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1d006aec0 0x7ff1d014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 >> 172.21.15.157:0/2018596117 conn(0x7ff1d00b1170 msgr2=0x7ff1d0070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 shutdown_connections 2024-04-18T03:41:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:29.950+0000 7ff1d680a700 1 -- 172.21.15.157:0/2018596117 wait complete. 2024-04-18T03:41:29.959 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:41:29.973 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-18T03:41:29.858587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31730824,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":488,"num_write":3272,"num_write_kb":34003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8652,"ondisk_log_size":8652,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":333616,"kb_used_data":64240,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754641104,"statfs":{"total":773094113280,"available":772752490496,"internally_reserved":0,"allocated":65781760,"data_stored":64389399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005062"},"pg_stats":[{"pgid":"2.1f","version":"27'41","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.601078+0000","last_change":"2024-04-18T03:37:33.922528+0000","last_active":"2024-04-18T03:40:39.601078+0000","last_peered":"2024-04-18T03:40:39.601078+0000","last_clean":"2024-04-18T03:40:39.601078+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:40:39.601078+0000","last_undegraded":"2024-04-18T03:40:39.601078+0000","last_fullsized":"2024-04-18T03:40:39.601078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:05:10.328715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551062+0000","last_change":"2024-04-18T03:37:34.316836+0000","last_active":"2024-04-18T03:40:52.551062+0000","last_peered":"2024-04-18T03:40:52.551062+0000","last_clean":"2024-04-18T03:40:52.551062+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:40:52.551062+0000","last_undegraded":"2024-04-18T03:40:52.551062+0000","last_fullsized":"2024-04-18T03:40:52.551062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'49","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845576+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:40:47.845576+0000","last_peered":"2024-04-18T03:40:47.845576+0000","last_clean":"2024-04-18T03:40:47.845576+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:40:47.845576+0000","last_undegraded":"2024-04-18T03:40:47.845576+0000","last_fullsized":"2024-04-18T03:40:47.845576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:51:07.334398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'30","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.112956+0000","last_change":"2024-04-18T03:37:33.925462+0000","last_active":"2024-04-18T03:40:42.112956+0000","last_peered":"2024-04-18T03:40:42.112956+0000","last_clean":"2024-04-18T03:40:42.112956+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:40:42.112956+0000","last_undegraded":"2024-04-18T03:40:42.112956+0000","last_fullsized":"2024-04-18T03:40:42.112956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:23.795590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'57","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553108+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:40:52.553108+0000","last_peered":"2024-04-18T03:40:52.553108+0000","last_clean":"2024-04-18T03:40:52.553108+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:40:52.553108+0000","last_undegraded":"2024-04-18T03:40:52.553108+0000","last_fullsized":"2024-04-18T03:40:52.553108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851456+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:40:47.851456+0000","last_peered":"2024-04-18T03:40:47.851456+0000","last_clean":"2024-04-18T03:40:47.851456+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:40:47.851456+0000","last_undegraded":"2024-04-18T03:40:47.851456+0000","last_fullsized":"2024-04-18T03:40:47.851456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'64","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:12.605809+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:41:12.605809+0000","last_peered":"2024-04-18T03:41:12.605809+0000","last_clean":"2024-04-18T03:41:12.605809+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:41:12.605809+0000","last_undegraded":"2024-04-18T03:41:12.605809+0000","last_fullsized":"2024-04-18T03:41:12.605809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604669,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562731+0000","last_change":"2024-04-18T03:37:34.306151+0000","last_active":"2024-04-18T03:40:52.562731+0000","last_peered":"2024-04-18T03:40:52.562731+0000","last_clean":"2024-04-18T03:40:52.562731+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:40:52.562731+0000","last_undegraded":"2024-04-18T03:40:52.562731+0000","last_fullsized":"2024-04-18T03:40:52.562731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'44","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847304+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:40:47.847304+0000","last_peered":"2024-04-18T03:40:47.847304+0000","last_clean":"2024-04-18T03:40:47.847304+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:40:47.847304+0000","last_undegraded":"2024-04-18T03:40:47.847304+0000","last_fullsized":"2024-04-18T03:40:47.847304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.587521+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:40:39.587521+0000","last_peered":"2024-04-18T03:40:39.587521+0000","last_clean":"2024-04-18T03:40:39.587521+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:40:39.587521+0000","last_undegraded":"2024-04-18T03:40:39.587521+0000","last_fullsized":"2024-04-18T03:40:39.587521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:12.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559721+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:40:52.559721+0000","last_peered":"2024-04-18T03:40:52.559721+0000","last_clean":"2024-04-18T03:40:52.559721+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:40:52.559721+0000","last_undegraded":"2024-04-18T03:40:52.559721+0000","last_fullsized":"2024-04-18T03:40:52.559721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'40","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847344+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:40:47.847344+0000","last_peered":"2024-04-18T03:40:47.847344+0000","last_clean":"2024-04-18T03:40:47.847344+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:40:47.847344+0000","last_undegraded":"2024-04-18T03:40:47.847344+0000","last_fullsized":"2024-04-18T03:40:47.847344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:29:44.713922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'42","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.542046+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:40:52.542046+0000","last_peered":"2024-04-18T03:40:52.542046+0000","last_clean":"2024-04-18T03:40:52.542046+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:40:52.542046+0000","last_undegraded":"2024-04-18T03:40:52.542046+0000","last_fullsized":"2024-04-18T03:40:52.542046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'527","reported_seq":545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598960+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:40:39.598960+0000","last_peered":"2024-04-18T03:40:39.598960+0000","last_clean":"2024-04-18T03:40:39.598960+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:40:39.598960+0000","last_undegraded":"2024-04-18T03:40:39.598960+0000","last_fullsized":"2024-04-18T03:40:39.598960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:08.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'41","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838531+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:40:47.838531+0000","last_peered":"2024-04-18T03:40:47.838531+0000","last_clean":"2024-04-18T03:40:47.838531+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:40:47.838531+0000","last_undegraded":"2024-04-18T03:40:47.838531+0000","last_fullsized":"2024-04-18T03:40:47.838531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:09:17.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543682+0000","last_change":"2024-04-18T03:38:23.517111+0000","last_active":"2024-04-18T03:40:52.543682+0000","last_peered":"2024-04-18T03:40:52.543682+0000","last_clean":"2024-04-18T03:40:52.543682+0000","last_became_active":"2024-04-18T03:38:23.516790+0000","last_became_peered":"2024-04-18T03:38:23.516790+0000","last_unstale":"2024-04-18T03:40:52.543682+0000","last_undegraded":"2024-04-18T03:40:52.543682+0000","last_fullsized":"2024-04-18T03:40:52.543682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:10:09.506622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"27'31","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.577011+0000","last_change":"2024-04-18T03:37:33.928257+0000","last_active":"2024-04-18T03:40:39.577011+0000","last_peered":"2024-04-18T03:40:39.577011+0000","last_clean":"2024-04-18T03:40:39.577011+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:40:39.577011+0000","last_undegraded":"2024-04-18T03:40:39.577011+0000","last_fullsized":"2024-04-18T03:40:39.577011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'48","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838662+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:40:47.838662+0000","last_peered":"2024-04-18T03:40:47.838662+0000","last_clean":"2024-04-18T03:40:47.838662+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:40:47.838662+0000","last_undegraded":"2024-04-18T03:40:47.838662+0000","last_fullsized":"2024-04-18T03:40:47.838662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552324+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:40:52.552324+0000","last_peered":"2024-04-18T03:40:52.552324+0000","last_clean":"2024-04-18T03:40:52.552324+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:40:52.552324+0000","last_undegraded":"2024-04-18T03:40:52.552324+0000","last_fullsized":"2024-04-18T03:40:52.552324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:15:10.489560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'28","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.722721+0000","last_change":"2024-04-18T03:37:33.921368+0000","last_active":"2024-04-18T03:40:49.722721+0000","last_peered":"2024-04-18T03:40:49.722721+0000","last_clean":"2024-04-18T03:40:49.722721+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:40:49.722721+0000","last_undegraded":"2024-04-18T03:40:49.722721+0000","last_fullsized":"2024-04-18T03:40:49.722721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'40","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857384+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:40:47.857384+0000","last_peered":"2024-04-18T03:40:47.857384+0000","last_clean":"2024-04-18T03:40:47.857384+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:40:47.857384+0000","last_undegraded":"2024-04-18T03:40:47.857384+0000","last_fullsized":"2024-04-18T03:40:47.857384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:26.586052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.524278+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:40:52.524278+0000","last_peered":"2024-04-18T03:40:52.524278+0000","last_clean":"2024-04-18T03:40:52.524278+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:40:52.524278+0000","last_undegraded":"2024-04-18T03:40:52.524278+0000","last_fullsized":"2024-04-18T03:40:52.524278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:55.630435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.595207+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:40:39.595207+0000","last_peered":"2024-04-18T03:40:39.595207+0000","last_clean":"2024-04-18T03:40:39.595207+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:40:39.595207+0000","last_undegraded":"2024-04-18T03:40:39.595207+0000","last_fullsized":"2024-04-18T03:40:39.595207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:07:09.652439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'42","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845971+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:40:47.845971+0000","last_peered":"2024-04-18T03:40:47.845971+0000","last_clean":"2024-04-18T03:40:47.845971+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:40:47.845971+0000","last_undegraded":"2024-04-18T03:40:47.845971+0000","last_fullsized":"2024-04-18T03:40:47.845971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549472+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:40:52.549472+0000","last_peered":"2024-04-18T03:40:52.549472+0000","last_clean":"2024-04-18T03:40:52.549472+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:40:52.549472+0000","last_undegraded":"2024-04-18T03:40:52.549472+0000","last_fullsized":"2024-04-18T03:40:52.549472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'26","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.731034+0000","last_change":"2024-04-18T03:37:33.929905+0000","last_active":"2024-04-18T03:40:49.731034+0000","last_peered":"2024-04-18T03:40:49.731034+0000","last_clean":"2024-04-18T03:40:49.731034+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:40:49.731034+0000","last_undegraded":"2024-04-18T03:40:49.731034+0000","last_fullsized":"2024-04-18T03:40:49.731034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'46","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.849762+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:40:47.849762+0000","last_peered":"2024-04-18T03:40:47.849762+0000","last_clean":"2024-04-18T03:40:47.849762+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:40:47.849762+0000","last_undegraded":"2024-04-18T03:40:47.849762+0000","last_fullsized":"2024-04-18T03:40:47.849762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559720+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:40:52.559720+0000","last_peered":"2024-04-18T03:40:52.559720+0000","last_clean":"2024-04-18T03:40:52.559720+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:40:52.559720+0000","last_undegraded":"2024-04-18T03:40:52.559720+0000","last_fullsized":"2024-04-18T03:40:52.559720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:16.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'38","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:48.070931+0000","last_change":"2024-04-18T03:37:33.932828+0000","last_active":"2024-04-18T03:40:48.070931+0000","last_peered":"2024-04-18T03:40:48.070931+0000","last_clean":"2024-04-18T03:40:48.070931+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:40:48.070931+0000","last_undegraded":"2024-04-18T03:40:48.070931+0000","last_fullsized":"2024-04-18T03:40:48.070931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:54.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'51","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.815270+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:40:47.815270+0000","last_peered":"2024-04-18T03:40:47.815270+0000","last_clean":"2024-04-18T03:40:47.815270+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:40:47.815270+0000","last_undegraded":"2024-04-18T03:40:47.815270+0000","last_fullsized":"2024-04-18T03:40:47.815270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:45.707050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'45","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549693+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:40:52.549693+0000","last_peered":"2024-04-18T03:40:52.549693+0000","last_clean":"2024-04-18T03:40:52.549693+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:40:52.549693+0000","last_undegraded":"2024-04-18T03:40:52.549693+0000","last_fullsized":"2024-04-18T03:40:52.549693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'28","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.591466+0000","last_change":"2024-04-18T03:37:33.924320+0000","last_active":"2024-04-18T03:40:39.591466+0000","last_peered":"2024-04-18T03:40:39.591466+0000","last_clean":"2024-04-18T03:40:39.591466+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:40:39.591466+0000","last_undegraded":"2024-04-18T03:40:39.591466+0000","last_fullsized":"2024-04-18T03:40:39.591466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851656+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:40:47.851656+0000","last_peered":"2024-04-18T03:40:47.851656+0000","last_clean":"2024-04-18T03:40:47.851656+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:40:47.851656+0000","last_undegraded":"2024-04-18T03:40:47.851656+0000","last_fullsized":"2024-04-18T03:40:47.851656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547280+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:40:52.547280+0000","last_peered":"2024-04-18T03:40:52.547280+0000","last_clean":"2024-04-18T03:40:52.547280+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:40:52.547280+0000","last_undegraded":"2024-04-18T03:40:52.547280+0000","last_fullsized":"2024-04-18T03:40:52.547280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'22","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.590635+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:40:39.590635+0000","last_peered":"2024-04-18T03:40:39.590635+0000","last_clean":"2024-04-18T03:40:39.590635+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:40:39.590635+0000","last_undegraded":"2024-04-18T03:40:39.590635+0000","last_fullsized":"2024-04-18T03:40:39.590635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:09.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'45","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.792824+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:40:47.792824+0000","last_peered":"2024-04-18T03:40:47.792824+0000","last_clean":"2024-04-18T03:40:47.792824+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:40:47.792824+0000","last_undegraded":"2024-04-18T03:40:47.792824+0000","last_fullsized":"2024-04-18T03:40:47.792824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549805+0000","last_change":"2024-04-18T03:37:34.308669+0000","last_active":"2024-04-18T03:40:52.549805+0000","last_peered":"2024-04-18T03:40:52.549805+0000","last_clean":"2024-04-18T03:40:52.549805+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:40:52.549805+0000","last_undegraded":"2024-04-18T03:40:52.549805+0000","last_fullsized":"2024-04-18T03:40:52.549805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:07.525115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598437+0000","last_change":"2024-04-18T03:37:33.921017+0000","last_active":"2024-04-18T03:40:39.598437+0000","last_peered":"2024-04-18T03:40:39.598437+0000","last_clean":"2024-04-18T03:40:39.598437+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:40:39.598437+0000","last_undegraded":"2024-04-18T03:40:39.598437+0000","last_fullsized":"2024-04-18T03:40:39.598437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857321+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:40:47.857321+0000","last_peered":"2024-04-18T03:40:47.857321+0000","last_clean":"2024-04-18T03:40:47.857321+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:40:47.857321+0000","last_undegraded":"2024-04-18T03:40:47.857321+0000","last_fullsized":"2024-04-18T03:40:47.857321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'45","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543795+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:40:52.543795+0000","last_peered":"2024-04-18T03:40:52.543795+0000","last_clean":"2024-04-18T03:40:52.543795+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:40:52.543795+0000","last_undegraded":"2024-04-18T03:40:52.543795+0000","last_fullsized":"2024-04-18T03:40:52.543795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'73","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.684345+0000","last_change":"2024-04-18T03:37:33.916761+0000","last_active":"2024-04-18T03:40:52.684345+0000","last_peered":"2024-04-18T03:40:52.684345+0000","last_clean":"2024-04-18T03:40:52.684345+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:40:52.684345+0000","last_undegraded":"2024-04-18T03:40:52.684345+0000","last_fullsized":"2024-04-18T03:40:52.684345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":44,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'49","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.798919+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:40:47.798919+0000","last_peered":"2024-04-18T03:40:47.798919+0000","last_clean":"2024-04-18T03:40:47.798919+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:40:47.798919+0000","last_undegraded":"2024-04-18T03:40:47.798919+0000","last_fullsized":"2024-04-18T03:40:47.798919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543231+0000","last_change":"2024-04-18T03:37:34.301044+0000","last_active":"2024-04-18T03:40:52.543231+0000","last_peered":"2024-04-18T03:40:52.543231+0000","last_clean":"2024-04-18T03:40:52.543231+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:40:52.543231+0000","last_undegraded":"2024-04-18T03:40:52.543231+0000","last_fullsized":"2024-04-18T03:40:52.543231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599677+0000","last_change":"2024-04-18T03:37:33.922934+0000","last_active":"2024-04-18T03:40:39.599677+0000","last_peered":"2024-04-18T03:40:39.599677+0000","last_clean":"2024-04-18T03:40:39.599677+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:40:39.599677+0000","last_undegraded":"2024-04-18T03:40:39.599677+0000","last_fullsized":"2024-04-18T03:40:39.599677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:21.818428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'40","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843748+0000","last_change":"2024-04-18T03:38:23.756539+0000","last_active":"2024-04-18T03:40:47.843748+0000","last_peered":"2024-04-18T03:40:47.843748+0000","last_clean":"2024-04-18T03:40:47.843748+0000","last_became_active":"2024-04-18T03:38:23.755354+0000","last_became_peered":"2024-04-18T03:38:23.755354+0000","last_unstale":"2024-04-18T03:40:47.843748+0000","last_undegraded":"2024-04-18T03:40:47.843748+0000","last_fullsized":"2024-04-18T03:40:47.843748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:13.146033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'57","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561718+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:40:52.561718+0000","last_peered":"2024-04-18T03:40:52.561718+0000","last_clean":"2024-04-18T03:40:52.561718+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:40:52.561718+0000","last_undegraded":"2024-04-18T03:40:52.561718+0000","last_fullsized":"2024-04-18T03:40:52.561718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599918+0000","last_change":"2024-04-18T03:37:33.919255+0000","last_active":"2024-04-18T03:40:39.599918+0000","last_peered":"2024-04-18T03:40:39.599918+0000","last_clean":"2024-04-18T03:40:39.599918+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:40:39.599918+0000","last_undegraded":"2024-04-18T03:40:39.599918+0000","last_fullsized":"2024-04-18T03:40:39.599918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:38:23.750319+0000","last_change":"2024-04-18T03:37:28.881821+0000","last_active":"2024-04-18T03:38:23.750319+0000","last_peered":"2024-04-18T03:38:23.750319+0000","last_clean":"2024-04-18T03:38:23.750319+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:38:23.750319+0000","last_undegraded":"2024-04-18T03:38:23.750319+0000","last_fullsized":"2024-04-18T03:38:23.750319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_clean_scrub_stamp":"2024-04-18T03:37:27.828246+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:15.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'35","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.829690+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:40:47.829690+0000","last_peered":"2024-04-18T03:40:47.829690+0000","last_clean":"2024-04-18T03:40:47.829690+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:40:47.829690+0000","last_undegraded":"2024-04-18T03:40:47.829690+0000","last_fullsized":"2024-04-18T03:40:47.829690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562621+0000","last_change":"2024-04-18T03:37:34.308036+0000","last_active":"2024-04-18T03:40:52.562621+0000","last_peered":"2024-04-18T03:40:52.562621+0000","last_clean":"2024-04-18T03:40:52.562621+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:40:52.562621+0000","last_undegraded":"2024-04-18T03:40:52.562621+0000","last_fullsized":"2024-04-18T03:40:52.562621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'29","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.601414+0000","last_change":"2024-04-18T03:37:33.922748+0000","last_active":"2024-04-18T03:40:39.601414+0000","last_peered":"2024-04-18T03:40:39.601414+0000","last_clean":"2024-04-18T03:40:39.601414+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:40:39.601414+0000","last_undegraded":"2024-04-18T03:40:39.601414+0000","last_fullsized":"2024-04-18T03:40:39.601414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'34","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.823501+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:40:47.823501+0000","last_peered":"2024-04-18T03:40:47.823501+0000","last_clean":"2024-04-18T03:40:47.823501+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:40:47.823501+0000","last_undegraded":"2024-04-18T03:40:47.823501+0000","last_fullsized":"2024-04-18T03:40:47.823501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:02.179174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560420+0000","last_change":"2024-04-18T03:37:34.300176+0000","last_active":"2024-04-18T03:40:52.560420+0000","last_peered":"2024-04-18T03:40:52.560420+0000","last_clean":"2024-04-18T03:40:52.560420+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:40:52.560420+0000","last_undegraded":"2024-04-18T03:40:52.560420+0000","last_fullsized":"2024-04-18T03:40:52.560420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.600329+0000","last_change":"2024-04-18T03:37:33.916221+0000","last_active":"2024-04-18T03:40:39.600329+0000","last_peered":"2024-04-18T03:40:39.600329+0000","last_clean":"2024-04-18T03:40:39.600329+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:40:39.600329+0000","last_undegraded":"2024-04-18T03:40:39.600329+0000","last_fullsized":"2024-04-18T03:40:39.600329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:06.510816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'55","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856820+0000","last_change":"2024-04-18T03:38:23.707932+0000","last_active":"2024-04-18T03:40:47.856820+0000","last_peered":"2024-04-18T03:40:47.856820+0000","last_clean":"2024-04-18T03:40:47.856820+0000","last_became_active":"2024-04-18T03:38:23.706819+0000","last_became_peered":"2024-04-18T03:38:23.706819+0000","last_unstale":"2024-04-18T03:40:47.856820+0000","last_undegraded":"2024-04-18T03:40:47.856820+0000","last_fullsized":"2024-04-18T03:40:47.856820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:51:19.448927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561853+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:40:52.561853+0000","last_peered":"2024-04-18T03:40:52.561853+0000","last_clean":"2024-04-18T03:40:52.561853+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:40:52.561853+0000","last_undegraded":"2024-04-18T03:40:52.561853+0000","last_fullsized":"2024-04-18T03:40:52.561853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.596947+0000","last_change":"2024-04-18T03:37:33.923743+0000","last_active":"2024-04-18T03:40:39.596947+0000","last_peered":"2024-04-18T03:40:39.596947+0000","last_clean":"2024-04-18T03:40:39.596947+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:40:39.596947+0000","last_undegraded":"2024-04-18T03:40:39.596947+0000","last_fullsized":"2024-04-18T03:40:39.596947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'50","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.853932+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:40:47.853932+0000","last_peered":"2024-04-18T03:40:47.853932+0000","last_clean":"2024-04-18T03:40:47.853932+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:40:47.853932+0000","last_undegraded":"2024-04-18T03:40:47.853932+0000","last_fullsized":"2024-04-18T03:40:47.853932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:26:14.663224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'39","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.544372+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:40:52.544372+0000","last_peered":"2024-04-18T03:40:52.544372+0000","last_clean":"2024-04-18T03:40:52.544372+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:40:52.544372+0000","last_undegraded":"2024-04-18T03:40:52.544372+0000","last_fullsized":"2024-04-18T03:40:52.544372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'23","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599132+0000","last_change":"2024-04-18T03:37:33.923624+0000","last_active":"2024-04-18T03:40:39.599132+0000","last_peered":"2024-04-18T03:40:39.599132+0000","last_clean":"2024-04-18T03:40:39.599132+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:40:39.599132+0000","last_undegraded":"2024-04-18T03:40:39.599132+0000","last_fullsized":"2024-04-18T03:40:39.599132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:30:29.619675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'47","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.830977+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:40:47.830977+0000","last_peered":"2024-04-18T03:40:47.830977+0000","last_clean":"2024-04-18T03:40:47.830977+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:40:47.830977+0000","last_undegraded":"2024-04-18T03:40:47.830977+0000","last_fullsized":"2024-04-18T03:40:47.830977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:42:56.306731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.539345+0000","last_change":"2024-04-18T03:37:34.304075+0000","last_active":"2024-04-18T03:40:52.539345+0000","last_peered":"2024-04-18T03:40:52.539345+0000","last_clean":"2024-04-18T03:40:52.539345+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:40:52.539345+0000","last_undegraded":"2024-04-18T03:40:52.539345+0000","last_fullsized":"2024-04-18T03:40:52.539345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'33","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.692279+0000","last_change":"2024-04-18T03:37:33.917032+0000","last_active":"2024-04-18T03:40:50.692279+0000","last_peered":"2024-04-18T03:40:50.692279+0000","last_clean":"2024-04-18T03:40:50.692279+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:40:50.692279+0000","last_undegraded":"2024-04-18T03:40:50.692279+0000","last_fullsized":"2024-04-18T03:40:50.692279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'54","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.835036+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:40:47.835036+0000","last_peered":"2024-04-18T03:40:47.835036+0000","last_clean":"2024-04-18T03:40:47.835036+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:40:47.835036+0000","last_undegraded":"2024-04-18T03:40:47.835036+0000","last_fullsized":"2024-04-18T03:40:47.835036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545077+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:40:52.545077+0000","last_peered":"2024-04-18T03:40:52.545077+0000","last_clean":"2024-04-18T03:40:52.545077+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:40:52.545077+0000","last_undegraded":"2024-04-18T03:40:52.545077+0000","last_fullsized":"2024-04-18T03:40:52.545077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'30","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.638004+0000","last_change":"2024-04-18T03:37:33.930343+0000","last_active":"2024-04-18T03:40:42.638004+0000","last_peered":"2024-04-18T03:40:42.638004+0000","last_clean":"2024-04-18T03:40:42.638004+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:40:42.638004+0000","last_undegraded":"2024-04-18T03:40:42.638004+0000","last_fullsized":"2024-04-18T03:40:42.638004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.839352+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:40:47.839352+0000","last_peered":"2024-04-18T03:40:47.839352+0000","last_clean":"2024-04-18T03:40:47.839352+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:40:47.839352+0000","last_undegraded":"2024-04-18T03:40:47.839352+0000","last_fullsized":"2024-04-18T03:40:47.839352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:57.028939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'63","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562675+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:40:52.562675+0000","last_peered":"2024-04-18T03:40:52.562675+0000","last_clean":"2024-04-18T03:40:52.562675+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:40:52.562675+0000","last_undegraded":"2024-04-18T03:40:52.562675+0000","last_fullsized":"2024-04-18T03:40:52.562675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'35","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.657282+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:40:42.657282+0000","last_peered":"2024-04-18T03:40:42.657282+0000","last_clean":"2024-04-18T03:40:42.657282+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:40:42.657282+0000","last_undegraded":"2024-04-18T03:40:42.657282+0000","last_fullsized":"2024-04-18T03:40:42.657282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'34","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.839304+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:40:47.839304+0000","last_peered":"2024-04-18T03:40:47.839304+0000","last_clean":"2024-04-18T03:40:47.839304+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:40:47.839304+0000","last_undegraded":"2024-04-18T03:40:47.839304+0000","last_fullsized":"2024-04-18T03:40:47.839304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:00:18.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563388+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:40:52.563388+0000","last_peered":"2024-04-18T03:40:52.563388+0000","last_clean":"2024-04-18T03:40:52.563388+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:40:52.563388+0000","last_undegraded":"2024-04-18T03:40:52.563388+0000","last_fullsized":"2024-04-18T03:40:52.563388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'17","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.592478+0000","last_change":"2024-04-18T03:37:33.927394+0000","last_active":"2024-04-18T03:40:39.592478+0000","last_peered":"2024-04-18T03:40:39.592478+0000","last_clean":"2024-04-18T03:40:39.592478+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:40:39.592478+0000","last_undegraded":"2024-04-18T03:40:39.592478+0000","last_fullsized":"2024-04-18T03:40:39.592478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'38","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.823050+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:40:47.823050+0000","last_peered":"2024-04-18T03:40:47.823050+0000","last_clean":"2024-04-18T03:40:47.823050+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:40:47.823050+0000","last_undegraded":"2024-04-18T03:40:47.823050+0000","last_fullsized":"2024-04-18T03:40:47.823050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:08.435358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562533+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:40:52.562533+0000","last_peered":"2024-04-18T03:40:52.562533+0000","last_clean":"2024-04-18T03:40:52.562533+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:40:52.562533+0000","last_undegraded":"2024-04-18T03:40:52.562533+0000","last_fullsized":"2024-04-18T03:40:52.562533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:16:02.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'909","reported_seq":927,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:02.522993+0000","last_change":"2024-04-18T03:37:33.929970+0000","last_active":"2024-04-18T03:41:02.522993+0000","last_peered":"2024-04-18T03:41:02.522993+0000","last_clean":"2024-04-18T03:41:02.522993+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:41:02.522993+0000","last_undegraded":"2024-04-18T03:41:02.522993+0000","last_fullsized":"2024-04-18T03:41:02.522993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.472626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.849440+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:40:47.849440+0000","last_peered":"2024-04-18T03:40:47.849440+0000","last_clean":"2024-04-18T03:40:47.849440+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:40:47.849440+0000","last_undegraded":"2024-04-18T03:40:47.849440+0000","last_fullsized":"2024-04-18T03:40:47.849440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.539661+0000","last_change":"2024-04-18T03:37:34.299294+0000","last_active":"2024-04-18T03:40:52.539661+0000","last_peered":"2024-04-18T03:40:52.539661+0000","last_clean":"2024-04-18T03:40:52.539661+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:40:52.539661+0000","last_undegraded":"2024-04-18T03:40:52.539661+0000","last_fullsized":"2024-04-18T03:40:52.539661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:10.767359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'48","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.706214+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:40:50.706214+0000","last_peered":"2024-04-18T03:40:50.706214+0000","last_clean":"2024-04-18T03:40:50.706214+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:40:50.706214+0000","last_undegraded":"2024-04-18T03:40:50.706214+0000","last_fullsized":"2024-04-18T03:40:50.706214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:42.808326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'45","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.840857+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:40:47.840857+0000","last_peered":"2024-04-18T03:40:47.840857+0000","last_clean":"2024-04-18T03:40:47.840857+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:40:47.840857+0000","last_undegraded":"2024-04-18T03:40:47.840857+0000","last_fullsized":"2024-04-18T03:40:47.840857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:40:51.668813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553243+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:40:52.553243+0000","last_peered":"2024-04-18T03:40:52.553243+0000","last_clean":"2024-04-18T03:40:52.553243+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:40:52.553243+0000","last_undegraded":"2024-04-18T03:40:52.553243+0000","last_fullsized":"2024-04-18T03:40:52.553243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599913+0000","last_change":"2024-04-18T03:37:33.931236+0000","last_active":"2024-04-18T03:40:39.599913+0000","last_peered":"2024-04-18T03:40:39.599913+0000","last_clean":"2024-04-18T03:40:39.599913+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:40:39.599913+0000","last_undegraded":"2024-04-18T03:40:39.599913+0000","last_fullsized":"2024-04-18T03:40:39.599913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'39","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843384+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:40:47.843384+0000","last_peered":"2024-04-18T03:40:47.843384+0000","last_clean":"2024-04-18T03:40:47.843384+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:40:47.843384+0000","last_undegraded":"2024-04-18T03:40:47.843384+0000","last_fullsized":"2024-04-18T03:40:47.843384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:23.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'73","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561939+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:40:52.561939+0000","last_peered":"2024-04-18T03:40:52.561939+0000","last_clean":"2024-04-18T03:40:52.561939+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:40:52.561939+0000","last_undegraded":"2024-04-18T03:40:52.561939+0000","last_fullsized":"2024-04-18T03:40:52.561939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'23","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598903+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:40:39.598903+0000","last_peered":"2024-04-18T03:40:39.598903+0000","last_clean":"2024-04-18T03:40:39.598903+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:40:39.598903+0000","last_undegraded":"2024-04-18T03:40:39.598903+0000","last_fullsized":"2024-04-18T03:40:39.598903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'42","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.819889+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:40:47.819889+0000","last_peered":"2024-04-18T03:40:47.819889+0000","last_clean":"2024-04-18T03:40:47.819889+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:40:47.819889+0000","last_undegraded":"2024-04-18T03:40:47.819889+0000","last_fullsized":"2024-04-18T03:40:47.819889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:29:14.484508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.818602+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:40:47.818602+0000","last_peered":"2024-04-18T03:40:47.818602+0000","last_clean":"2024-04-18T03:40:47.818602+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:40:47.818602+0000","last_undegraded":"2024-04-18T03:40:47.818602+0000","last_fullsized":"2024-04-18T03:40:47.818602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552611+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:40:52.552611+0000","last_peered":"2024-04-18T03:40:52.552611+0000","last_clean":"2024-04-18T03:40:52.552611+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:40:52.552611+0000","last_undegraded":"2024-04-18T03:40:52.552611+0000","last_fullsized":"2024-04-18T03:40:52.552611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:38.556875+0000","last_change":"2024-04-18T03:37:33.925286+0000","last_active":"2024-04-18T03:40:38.556875+0000","last_peered":"2024-04-18T03:40:38.556875+0000","last_clean":"2024-04-18T03:40:38.556875+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:40:38.556875+0000","last_undegraded":"2024-04-18T03:40:38.556875+0000","last_fullsized":"2024-04-18T03:40:38.556875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'50","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.850145+0000","last_change":"2024-04-18T03:38:23.708738+0000","last_active":"2024-04-18T03:40:47.850145+0000","last_peered":"2024-04-18T03:40:47.850145+0000","last_clean":"2024-04-18T03:40:47.850145+0000","last_became_active":"2024-04-18T03:38:23.707524+0000","last_became_peered":"2024-04-18T03:38:23.707524+0000","last_unstale":"2024-04-18T03:40:47.850145+0000","last_undegraded":"2024-04-18T03:40:47.850145+0000","last_fullsized":"2024-04-18T03:40:47.850145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:49:54.313746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'65","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551506+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:40:52.551506+0000","last_peered":"2024-04-18T03:40:52.551506+0000","last_clean":"2024-04-18T03:40:52.551506+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:40:52.551506+0000","last_undegraded":"2024-04-18T03:40:52.551506+0000","last_fullsized":"2024-04-18T03:40:52.551506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:14:23.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'19","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.591356+0000","last_change":"2024-04-18T03:37:33.932436+0000","last_active":"2024-04-18T03:40:39.591356+0000","last_peered":"2024-04-18T03:40:39.591356+0000","last_clean":"2024-04-18T03:40:39.591356+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:40:39.591356+0000","last_undegraded":"2024-04-18T03:40:39.591356+0000","last_fullsized":"2024-04-18T03:40:39.591356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:11.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'42","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598520+0000","last_change":"2024-04-18T03:37:33.929695+0000","last_active":"2024-04-18T03:40:39.598520+0000","last_peered":"2024-04-18T03:40:39.598520+0000","last_clean":"2024-04-18T03:40:39.598520+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:40:39.598520+0000","last_undegraded":"2024-04-18T03:40:39.598520+0000","last_fullsized":"2024-04-18T03:40:39.598520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:29.848633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554295+0000","last_change":"2024-04-18T03:37:34.306548+0000","last_active":"2024-04-18T03:40:52.554295+0000","last_peered":"2024-04-18T03:40:52.554295+0000","last_clean":"2024-04-18T03:40:52.554295+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:40:52.554295+0000","last_undegraded":"2024-04-18T03:40:52.554295+0000","last_fullsized":"2024-04-18T03:40:52.554295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843692+0000","last_change":"2024-04-18T03:37:38.336681+0000","last_active":"2024-04-18T03:40:47.843692+0000","last_peered":"2024-04-18T03:40:47.843692+0000","last_clean":"2024-04-18T03:40:47.843692+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:40:47.843692+0000","last_undegraded":"2024-04-18T03:40:47.843692+0000","last_fullsized":"2024-04-18T03:40:47.843692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:16.022475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1515","reported_seq":1533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.603653+0000","last_change":"2024-04-18T03:37:33.923165+0000","last_active":"2024-04-18T03:40:39.603653+0000","last_peered":"2024-04-18T03:40:39.603653+0000","last_clean":"2024-04-18T03:40:39.603653+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:40:39.603653+0000","last_undegraded":"2024-04-18T03:40:39.603653+0000","last_fullsized":"2024-04-18T03:40:39.603653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1515,"log_dups_size":0,"ondisk_log_size":1515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1489,"num_write_kb":4584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'44","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.542586+0000","last_change":"2024-04-18T03:37:34.289192+0000","last_active":"2024-04-18T03:40:52.542586+0000","last_peered":"2024-04-18T03:40:52.542586+0000","last_clean":"2024-04-18T03:40:52.542586+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:40:52.542586+0000","last_undegraded":"2024-04-18T03:40:52.542586+0000","last_fullsized":"2024-04-18T03:40:52.542586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:35.397966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'55","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856434+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:40:47.856434+0000","last_peered":"2024-04-18T03:40:47.856434+0000","last_clean":"2024-04-18T03:40:47.856434+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:40:47.856434+0000","last_undegraded":"2024-04-18T03:40:47.856434+0000","last_fullsized":"2024-04-18T03:40:47.856434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:57.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'69","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.548740+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:40:52.548740+0000","last_peered":"2024-04-18T03:40:52.548740+0000","last_clean":"2024-04-18T03:40:52.548740+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:40:52.548740+0000","last_undegraded":"2024-04-18T03:40:52.548740+0000","last_fullsized":"2024-04-18T03:40:52.548740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'59","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553815+0000","last_change":"2024-04-18T03:37:34.295362+0000","last_active":"2024-04-18T03:40:52.553815+0000","last_peered":"2024-04-18T03:40:52.553815+0000","last_clean":"2024-04-18T03:40:52.553815+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:40:52.553815+0000","last_undegraded":"2024-04-18T03:40:52.553815+0000","last_fullsized":"2024-04-18T03:40:52.553815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:13.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554725+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:40:52.554725+0000","last_peered":"2024-04-18T03:40:52.554725+0000","last_clean":"2024-04-18T03:40:52.554725+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:40:52.554725+0000","last_undegraded":"2024-04-18T03:40:52.554725+0000","last_fullsized":"2024-04-18T03:40:52.554725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'52","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553829+0000","last_change":"2024-04-18T03:37:34.305580+0000","last_active":"2024-04-18T03:40:52.553829+0000","last_peered":"2024-04-18T03:40:52.553829+0000","last_clean":"2024-04-18T03:40:52.553829+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:40:52.553829+0000","last_undegraded":"2024-04-18T03:40:52.553829+0000","last_fullsized":"2024-04-18T03:40:52.553829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.550134+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:40:52.550134+0000","last_peered":"2024-04-18T03:40:52.550134+0000","last_clean":"2024-04-18T03:40:52.550134+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:40:52.550134+0000","last_undegraded":"2024-04-18T03:40:52.550134+0000","last_fullsized":"2024-04-18T03:40:52.550134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'37","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546218+0000","last_change":"2024-04-18T03:37:34.298453+0000","last_active":"2024-04-18T03:40:52.546218+0000","last_peered":"2024-04-18T03:40:52.546218+0000","last_clean":"2024-04-18T03:40:52.546218+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:40:52.546218+0000","last_undegraded":"2024-04-18T03:40:52.546218+0000","last_fullsized":"2024-04-18T03:40:52.546218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'66","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.558555+0000","last_change":"2024-04-18T03:38:23.515116+0000","last_active":"2024-04-18T03:40:52.558555+0000","last_peered":"2024-04-18T03:40:52.558555+0000","last_clean":"2024-04-18T03:40:52.558555+0000","last_became_active":"2024-04-18T03:38:23.514633+0000","last_became_peered":"2024-04-18T03:38:23.514633+0000","last_unstale":"2024-04-18T03:40:52.558555+0000","last_undegraded":"2024-04-18T03:40:52.558555+0000","last_fullsized":"2024-04-18T03:40:52.558555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:04.434087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'42","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547910+0000","last_change":"2024-04-18T03:37:34.310319+0000","last_active":"2024-04-18T03:40:52.547910+0000","last_peered":"2024-04-18T03:40:52.547910+0000","last_clean":"2024-04-18T03:40:52.547910+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:40:52.547910+0000","last_undegraded":"2024-04-18T03:40:52.547910+0000","last_fullsized":"2024-04-18T03:40:52.547910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:44.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560802+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:40:52.560802+0000","last_peered":"2024-04-18T03:40:52.560802+0000","last_clean":"2024-04-18T03:40:52.560802+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:40:52.560802+0000","last_undegraded":"2024-04-18T03:40:52.560802+0000","last_fullsized":"2024-04-18T03:40:52.560802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551501+0000","last_change":"2024-04-18T03:37:34.310229+0000","last_active":"2024-04-18T03:40:52.551501+0000","last_peered":"2024-04-18T03:40:52.551501+0000","last_clean":"2024-04-18T03:40:52.551501+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:40:52.551501+0000","last_undegraded":"2024-04-18T03:40:52.551501+0000","last_fullsized":"2024-04-18T03:40:52.551501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'58","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563696+0000","last_change":"2024-04-18T03:38:23.754521+0000","last_active":"2024-04-18T03:40:52.563696+0000","last_peered":"2024-04-18T03:40:52.563696+0000","last_clean":"2024-04-18T03:40:52.563696+0000","last_became_active":"2024-04-18T03:38:23.753851+0000","last_became_peered":"2024-04-18T03:38:23.753851+0000","last_unstale":"2024-04-18T03:40:52.563696+0000","last_undegraded":"2024-04-18T03:40:52.563696+0000","last_fullsized":"2024-04-18T03:40:52.563696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:13:50.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"27'63","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.564060+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:40:52.564060+0000","last_peered":"2024-04-18T03:40:52.564060+0000","last_clean":"2024-04-18T03:40:52.564060+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:40:52.564060+0000","last_undegraded":"2024-04-18T03:40:52.564060+0000","last_fullsized":"2024-04-18T03:40:52.564060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'62","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545598+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:40:52.545598+0000","last_peered":"2024-04-18T03:40:52.545598+0000","last_clean":"2024-04-18T03:40:52.545598+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:40:52.545598+0000","last_undegraded":"2024-04-18T03:40:52.545598+0000","last_fullsized":"2024-04-18T03:40:52.545598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561058+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:40:52.561058+0000","last_peered":"2024-04-18T03:40:52.561058+0000","last_clean":"2024-04-18T03:40:52.561058+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:40:52.561058+0000","last_undegraded":"2024-04-18T03:40:52.561058+0000","last_fullsized":"2024-04-18T03:40:52.561058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551885+0000","last_change":"2024-04-18T03:37:34.313079+0000","last_active":"2024-04-18T03:40:52.551885+0000","last_peered":"2024-04-18T03:40:52.551885+0000","last_clean":"2024-04-18T03:40:52.551885+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:40:52.551885+0000","last_undegraded":"2024-04-18T03:40:52.551885+0000","last_fullsized":"2024-04-18T03:40:52.551885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:50.485855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562415+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:40:52.562415+0000","last_peered":"2024-04-18T03:40:52.562415+0000","last_clean":"2024-04-18T03:40:52.562415+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:40:52.562415+0000","last_undegraded":"2024-04-18T03:40:52.562415+0000","last_fullsized":"2024-04-18T03:40:52.562415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551256+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:40:52.551256+0000","last_peered":"2024-04-18T03:40:52.551256+0000","last_clean":"2024-04-18T03:40:52.551256+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:40:52.551256+0000","last_undegraded":"2024-04-18T03:40:52.551256+0000","last_fullsized":"2024-04-18T03:40:52.551256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'53","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547747+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:40:52.547747+0000","last_peered":"2024-04-18T03:40:52.547747+0000","last_clean":"2024-04-18T03:40:52.547747+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:40:52.547747+0000","last_undegraded":"2024-04-18T03:40:52.547747+0000","last_fullsized":"2024-04-18T03:40:52.547747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'59","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547235+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:40:52.547235+0000","last_peered":"2024-04-18T03:40:52.547235+0000","last_clean":"2024-04-18T03:40:52.547235+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:40:52.547235+0000","last_undegraded":"2024-04-18T03:40:52.547235+0000","last_fullsized":"2024-04-18T03:40:52.547235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551542+0000","last_change":"2024-04-18T03:37:34.314282+0000","last_active":"2024-04-18T03:40:52.551542+0000","last_peered":"2024-04-18T03:40:52.551542+0000","last_clean":"2024-04-18T03:40:52.551542+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:40:52.551542+0000","last_undegraded":"2024-04-18T03:40:52.551542+0000","last_fullsized":"2024-04-18T03:40:52.551542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'44","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.527773+0000","last_change":"2024-04-18T03:37:34.299168+0000","last_active":"2024-04-18T03:40:52.527773+0000","last_peered":"2024-04-18T03:40:52.527773+0000","last_clean":"2024-04-18T03:40:52.527773+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:40:52.527773+0000","last_undegraded":"2024-04-18T03:40:52.527773+0000","last_fullsized":"2024-04-18T03:40:52.527773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:43.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551884+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:40:52.551884+0000","last_peered":"2024-04-18T03:40:52.551884+0000","last_clean":"2024-04-18T03:40:52.551884+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:40:52.551884+0000","last_undegraded":"2024-04-18T03:40:52.551884+0000","last_fullsized":"2024-04-18T03:40:52.551884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'53","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560125+0000","last_change":"2024-04-18T03:38:23.515120+0000","last_active":"2024-04-18T03:40:52.560125+0000","last_peered":"2024-04-18T03:40:52.560125+0000","last_clean":"2024-04-18T03:40:52.560125+0000","last_became_active":"2024-04-18T03:38:23.514732+0000","last_became_peered":"2024-04-18T03:38:23.514732+0000","last_unstale":"2024-04-18T03:40:52.560125+0000","last_undegraded":"2024-04-18T03:40:52.560125+0000","last_fullsized":"2024-04-18T03:40:52.560125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:10.490370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561761+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:40:52.561761+0000","last_peered":"2024-04-18T03:40:52.561761+0000","last_clean":"2024-04-18T03:40:52.561761+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:40:52.561761+0000","last_undegraded":"2024-04-18T03:40:52.561761+0000","last_fullsized":"2024-04-18T03:40:52.561761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561804+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:40:52.561804+0000","last_peered":"2024-04-18T03:40:52.561804+0000","last_clean":"2024-04-18T03:40:52.561804+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:40:52.561804+0000","last_undegraded":"2024-04-18T03:40:52.561804+0000","last_fullsized":"2024-04-18T03:40:52.561804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552286+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:40:52.552286+0000","last_peered":"2024-04-18T03:40:52.552286+0000","last_clean":"2024-04-18T03:40:52.552286+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:40:52.552286+0000","last_undegraded":"2024-04-18T03:40:52.552286+0000","last_fullsized":"2024-04-18T03:40:52.552286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547093+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:40:52.547093+0000","last_peered":"2024-04-18T03:40:52.547093+0000","last_clean":"2024-04-18T03:40:52.547093+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:40:52.547093+0000","last_undegraded":"2024-04-18T03:40:52.547093+0000","last_fullsized":"2024-04-18T03:40:52.547093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562460+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:40:52.562460+0000","last_peered":"2024-04-18T03:40:52.562460+0000","last_clean":"2024-04-18T03:40:52.562460+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:40:52.562460+0000","last_undegraded":"2024-04-18T03:40:52.562460+0000","last_fullsized":"2024-04-18T03:40:52.562460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'40","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560874+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:40:52.560874+0000","last_peered":"2024-04-18T03:40:52.560874+0000","last_clean":"2024-04-18T03:40:52.560874+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:40:52.560874+0000","last_undegraded":"2024-04-18T03:40:52.560874+0000","last_fullsized":"2024-04-18T03:40:52.560874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545925+0000","last_change":"2024-04-18T03:37:34.300927+0000","last_active":"2024-04-18T03:40:52.545925+0000","last_peered":"2024-04-18T03:40:52.545925+0000","last_clean":"2024-04-18T03:40:52.545925+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:40:52.545925+0000","last_undegraded":"2024-04-18T03:40:52.545925+0000","last_fullsized":"2024-04-18T03:40:52.545925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546623+0000","last_change":"2024-04-18T03:37:34.289446+0000","last_active":"2024-04-18T03:40:52.546623+0000","last_peered":"2024-04-18T03:40:52.546623+0000","last_clean":"2024-04-18T03:40:52.546623+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:40:52.546623+0000","last_undegraded":"2024-04-18T03:40:52.546623+0000","last_fullsized":"2024-04-18T03:40:52.546623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560712+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:40:52.560712+0000","last_peered":"2024-04-18T03:40:52.560712+0000","last_clean":"2024-04-18T03:40:52.560712+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:40:52.560712+0000","last_undegraded":"2024-04-18T03:40:52.560712+0000","last_fullsized":"2024-04-18T03:40:52.560712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:49.338554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31140456,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":3113,"num_write_kb":31587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62341120,"data_stored":62280912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3821,"ondisk_log_size":3821,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49160,"kb_used_data":13952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94322680,"statfs":{"total":96636764160,"available":96586424320,"internally_reserved":0,"allocated":14286848,"data_stored":14110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83799999999999997,"15min":0.86699999999999999},"min":{"1min":0.48899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1299999999999999,"5min":1.286,"15min":1.286},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.87,"15min":0.89100000000000001},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2110000000000001,"5min":1.331,"15min":1.331},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.88200000000000001},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1000000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.879},"min":{"1min":0.59599999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.133,"5min":1.724,"15min":1.724},"last":1.1559999999999999}]},{"osd":2,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96999999999999997,"15min":0.98999999999999999},"min":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.298,"5min":1.329,"15min":1.329},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86499999999999999,"15min":0.89000000000000001},"min":{"1min":0.59999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0669999999999999,"5min":1.228,"15min":1.228},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83599999999999997,"15min":0.83399999999999996},"min":{"1min":0.69699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.097,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90000000000000002,"15min":0.88},"min":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.081,"15min":1.101},"min":{"1min":0.86899999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7350000000000001,"5min":2.198,"15min":2.198},"last":1.113}]},{"osd":5,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90500000000000003,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":1.0109999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0700000000000001,"15min":1.0760000000000001},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.206},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.0620000000000001},"min":{"1min":0.78200000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4450000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1799999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39588,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94332252,"statfs":{"total":96636764160,"available":96596226048,"internally_reserved":0,"allocated":8679424,"data_stored":8504374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77200000000000002,"15min":0.77600000000000002},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.105,"15min":1.105},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"min":{"1min":0.61499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.006},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95099999999999996,"15min":0.96699999999999997},"min":{"1min":0.65000000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2529999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.83699999999999997,"15min":0.81100000000000005},"min":{"1min":0.67800000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2769999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90200000000000002,"15min":0.91500000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.157,"5min":1.224,"15min":1.224},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.72199999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.0629999999999999},{"interface":"front","average":{"1min":1,"5min":0.94199999999999995,"15min":0.92400000000000004},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93100000000000005,"15min":0.92700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95699999999999996,"15min":0.96299999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.234,"5min":1.236,"15min":1.236},"last":1.123}]},{"osd":6,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0149999999999999,"15min":0.98299999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.133,"5min":1.1240000000000001,"15min":1.127},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.032}]},{"osd":7,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.054,"15min":1.054},"min":{"1min":0.747,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3740000000000001,"5min":1.395,"15min":1.395},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.155,"15min":1.125},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1539999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57928,"kb_used_data":18624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94313912,"statfs":{"total":96636764160,"available":96577445888,"internally_reserved":0,"allocated":19070976,"data_stored":18894785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77900000000000003,"15min":0.80400000000000005},"min":{"1min":0.52900000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0309999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1579999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.093}]},{"osd":1,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1479999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.495,"15min":0.495},"max":{"1min":1.034,"5min":1.123,"15min":1.123},"last":1.1220000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.63400000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0860000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.621,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.92000000000000004,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1799999999999999,"5min":1.232,"15min":1.232},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.216,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.181,"5min":1.679,"15min":1.679},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97299999999999998,"15min":0.98099999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2470000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.036}]},{"osd":5,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3380000000000001,"5min":1.617,"15min":1.617},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.79100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2729999999999999,"5min":1.496,"15min":1.496},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.80100000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.534,"5min":1.593,"15min":1.593},"last":1.167},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2549999999999999,"5min":1.462,"15min":1.462},"last":1.23}]}]},{"osd":5,"up_from":14,"seq":60129542195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":116344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.86699999999999999,"15min":0.90600000000000003},"min":{"1min":0.54600000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83599999999999997,"15min":0.85299999999999998},"min":{"1min":0.55500000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3700000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.89100000000000001},"min":{"1min":0.64800000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.878},"min":{"1min":0.64800000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0109999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91600000000000004,"15min":0.93799999999999994},"min":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.115,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.014,"15min":1.046},"min":{"1min":0.74399999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.534,"5min":1.536,"15min":1.536},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.70499999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2430000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.04},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93600000000000005,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.97399999999999998}]},{"osd":4,"last update":"Thu Apr 18 03:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.006,"15min":1.038},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2370000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":1.0329999999999999,"15min":1.079},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.506,"5min":1.631,"15min":1.631},"last":1.0609999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.006},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1220000000000001,"15min":1.1499999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4059999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.214}]},{"osd":7,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.014,"15min":1.046},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.196,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.256},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2230000000000001,"15min":1.26},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.46,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.1599999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":12932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":13242368,"data_stored":13068331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.228,"5min":2.202,"15min":2.202},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.2290000000000001,"5min":1.629,"15min":1.629},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.622,"5min":0.38,"15min":0.38},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.748,"15min":0.749},"min":{"1min":0.59399999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.026,"5min":0.86399999999999999,"15min":0.86799999999999999},"min":{"1min":0.73399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.5900000000000001,"5min":1.821,"15min":1.821},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.98099999999999998,"15min":0.97999999999999998},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.94099999999999995,"15min":0.93799999999999994},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3839999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.75800000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0449999999999999,"15min":1.024},"min":{"1min":0.84699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.1659999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0669999999999999,"15min":1.0680000000000001},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.0920000000000001,"15min":1.0720000000000001},"min":{"1min":0.97699999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.022,"15min":1.012},"min":{"1min":0.86799999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.198},{"interface":"front","average":{"1min":1.238,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.98699999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8149999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.089}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35844,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335996,"statfs":{"total":96636764160,"available":96600059904,"internally_reserved":0,"allocated":651264,"data_stored":484747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63300000000000001,"15min":0.65000000000000002},"min":{"1min":0.33200000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.94599999999999995,"5min":0.995,"15min":0.995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.39900000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.145,"5min":1.532,"15min":1.532},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.316,"15min":0.316},"max":{"1min":1.0880000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.44400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.55400000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Apr 18 03:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.409,"15min":1.409},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96899999999999997,"15min":0.98499999999999999},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1,"15min":1.016},"min":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":1.0169999999999999},"min":{"1min":0.63400000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.048,"15min":1.0589999999999999},"min":{"1min":0.76600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.03,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.137}]},{"osd":7,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0529999999999999,"15min":1.081},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.143,"5min":1.0620000000000001,"15min":1.0740000000000001},"min":{"1min":0.78600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.03}]}]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35492,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336348,"statfs":{"total":96636764160,"available":96600420352,"internally_reserved":0,"allocated":290816,"data_stored":116414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.504,"5min":0.25,"15min":0.25},"max":{"1min":0.78300000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.48999999999999999,"5min":0.215,"15min":0.215},"max":{"1min":1.1020000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.50600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.64000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3169999999999999,"5min":1.321,"15min":1.321},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80500000000000005,"15min":0.83499999999999996},"min":{"1min":0.58199999999999996,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.028,"5min":1.583,"15min":1.583},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.69899999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1180000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2190000000000001,"5min":1.337,"15min":1.337},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.70399999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.244,"5min":1.274,"15min":1.274},"last":0.748}]},{"osd":5,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98999999999999999,"15min":1.006},"min":{"1min":0.73499999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2649999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.84399999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.304,"5min":1.353,"15min":1.353},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.095,"15min":1.143},"min":{"1min":0.81599999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4179999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.099,"5min":1.0900000000000001,"15min":1.123},"min":{"1min":0.83099999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.407,"5min":2.242,"15min":2.242},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1020000000000001,"15min":1.137},"min":{"1min":0.997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3640000000000001,"5min":2.044,"15min":2.044},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.96299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4590000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.012}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44264,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94327576,"statfs":{"total":96636764160,"available":96591437824,"internally_reserved":0,"allocated":9273344,"data_stored":9094201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.51300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.49099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.68700000000000006,"15min":0.69599999999999995},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.66600000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99099999999999999,"5min":1.103,"15min":1.103},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.70699999999999996,"15min":0.68100000000000005},"min":{"1min":0.52800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.751},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.58399999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68799999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.048},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98799999999999999,"15min":0.96799999999999997},"min":{"1min":0.85399999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.077},{"interface":"front","average":{"1min":1.129,"5min":1.0600000000000001,"15min":1.0549999999999999},"min":{"1min":0.85799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4890000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0389999999999999,"15min":1.0329999999999999},"min":{"1min":0.84599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4910000000000001,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.077,"15min":1.0640000000000001},"min":{"1min":0.82399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.1299999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.048,"15min":1.0600000000000001},"min":{"1min":0.79700000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2989999999999999,"5min":1.484,"15min":1.484},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.127,"15min":1.123},"min":{"1min":0.78200000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.97599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14004224,"data_stored":13993949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18194432,"data_stored":18188163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:41:29.982 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T03:41:29.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:41:30.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.090+0000 7f7017fff700 1 Processor -- start 2024-04-18T03:41:30.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.090+0000 7f7017fff700 1 -- start start 2024-04-18T03:41:30.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.090+0000 7f7017fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7018141c00 0x7f701815b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.090+0000 7f7017fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f70181445a0 0x7f70181433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.090+0000 7f7017fff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701815bad0 con 0x7f701806e810 2024-04-18T03:41:30.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.090+0000 7f7017fff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7018142f80 con 0x7f70181445a0 2024-04-18T03:41:30.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.090+0000 7f7017fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7018142060 con 0x7f7018141c00 2024-04-18T03:41:30.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f700ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7018141c00 0x7f701815b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70177fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f70181445a0 0x7f70181433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70177fe700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f70181445a0 0x7f70181433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:43064/0 (socket says 172.21.15.157:43064) 2024-04-18T03:41:30.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f700ffff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7018141c00 0x7f701815b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:54022/0 (socket says 172.21.15.157:54022) 2024-04-18T03:41:30.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7016ffd700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f701806e810 0x7f701806ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:52476/0 (socket says 172.21.15.157:52476) 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f700ffff700 1 -- 172.21.15.157:0/417348690 learned_addr learned my addr 172.21.15.157:0/417348690 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70177fe700 1 -- 172.21.15.157:0/417348690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7018141c00 msgr2=0x7f701815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70177fe700 1 --2- 172.21.15.157:0/417348690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7018141c00 0x7f701815b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70177fe700 1 -- 172.21.15.157:0/417348690 >> v1:172.21.15.175:6789/0 conn(0x7f701806e810 legacy=0x7f701806ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70177fe700 1 -- 172.21.15.157:0/417348690 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018142300 con 0x7f70181445a0 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f700ffff700 1 --2- 172.21.15.157:0/417348690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7018141c00 0x7f701815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70177fe700 1 --2- 172.21.15.157:0/417348690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70181445a0 0x7f70181433a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7010009d90 tx=0x7f701000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a0a678b3a1196d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70167fc700 1 -- 172.21.15.157:0/417348690 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000e070 con 0x7f70181445a0 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70167fc700 1 -- 172.21.15.157:0/417348690 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701000bb20 con 0x7f70181445a0 2024-04-18T03:41:30.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f70167fc700 1 -- 172.21.15.157:0/417348690 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010012430 con 0x7f70181445a0 2024-04-18T03:41:30.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 -- 172.21.15.157:0/417348690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70181445a0 msgr2=0x7f70181433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 --2- 172.21.15.157:0/417348690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70181445a0 0x7f70181433a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7010009d90 tx=0x7f701000b330 comp rx=0 tx=0).stop 2024-04-18T03:41:30.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 -- 172.21.15.157:0/417348690 shutdown_connections 2024-04-18T03:41:30.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 --2- 172.21.15.157:0/417348690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70181445a0 0x7f70181433a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 --2- 172.21.15.157:0/417348690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7018141c00 0x7f701815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 -- 172.21.15.157:0/417348690 >> 172.21.15.157:0/417348690 conn(0x7f70180b1330 msgr2=0x7f701806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:30.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 -- 172.21.15.157:0/417348690 shutdown_connections 2024-04-18T03:41:30.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 -- 172.21.15.157:0/417348690 wait complete. 2024-04-18T03:41:30.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.094+0000 7f7017fff700 1 Processor -- start 2024-04-18T03:41:30.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 -- start start 2024-04-18T03:41:30.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701806e810 0x7f70181f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7018141c00 0x7f701813a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70181445a0 0x7f7018143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701813b7a0 con 0x7f70181445a0 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70180ae5f0 con 0x7f7018141c00 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70181f2d20 con 0x7f701806e810 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70181445a0 0x7f7018143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70181445a0 0x7f7018143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55284/0 (socket says 172.21.15.157:55284) 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 -- 172.21.15.157:0/3906426997 learned_addr learned my addr 172.21.15.157:0/3906426997 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f700ffff700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7018141c00 0x7f701813a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7016ffd700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701806e810 0x7f70181f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 -- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701806e810 msgr2=0x7f70181f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701806e810 0x7f70181f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 -- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7018141c00 msgr2=0x7f701813a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7018141c00 0x7f701813a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 -- 172.21.15.157:0/3906426997 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000009570 con 0x7f70181445a0 2024-04-18T03:41:30.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f70177fe700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70181445a0 0x7f7018143260 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7010014040 tx=0x7f7010004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:30.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f700f7fe700 1 -- 172.21.15.157:0/3906426997 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010012430 con 0x7f70181445a0 2024-04-18T03:41:30.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7010009a70 con 0x7f70181445a0 2024-04-18T03:41:30.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f700f7fe700 1 -- 172.21.15.157:0/3906426997 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7010020070 con 0x7f70181445a0 2024-04-18T03:41:30.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f700f7fe700 1 -- 172.21.15.157:0/3906426997 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010004280 con 0x7f70181445a0 2024-04-18T03:41:30.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.098+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70181f32e0 con 0x7f70181445a0 2024-04-18T03:41:30.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.102+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701804e650 con 0x7f70181445a0 2024-04-18T03:41:30.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.102+0000 7f700f7fe700 1 -- 172.21.15.157:0/3906426997 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f70100043e0 con 0x7f70181445a0 2024-04-18T03:41:30.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.102+0000 7f700f7fe700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ffc066730 0x7f6ffc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.102+0000 7f700f7fe700 1 -- 172.21.15.157:0/3906426997 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7010022070 con 0x7f70181445a0 2024-04-18T03:41:30.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.102+0000 7f7016ffd700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ffc066730 0x7f6ffc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.102+0000 7f7016ffd700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ffc066730 0x7f6ffc068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7008000f60 tx=0x7f7008007f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:30.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.106+0000 7f700f7fe700 1 -- 172.21.15.157:0/3906426997 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f70100b7be0 con 0x7f70181445a0 2024-04-18T03:41:30.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.278+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7018142ba0 con 0x7f6ffc066730 2024-04-18T03:41:30.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.302+0000 7f700f7fe700 1 -- 172.21.15.157:0/3906426997 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368945 (secure 0 0 0) 0x7f7008004b30 con 0x7f6ffc066730 2024-04-18T03:41:30.310 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ffc066730 msgr2=0x7f6ffc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ffc066730 0x7f6ffc068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7008000f60 tx=0x7f7008007f30 comp rx=0 tx=0).stop 2024-04-18T03:41:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70181445a0 msgr2=0x7f7018143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70181445a0 0x7f7018143260 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7010014040 tx=0x7f7010004af0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 shutdown_connections 2024-04-18T03:41:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6ffc066730 0x7f6ffc068bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7018141c00 0x7f701813a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70181445a0 0x7f7018143260 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 --2- 172.21.15.157:0/3906426997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701806e810 0x7f70181f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 >> 172.21.15.157:0/3906426997 conn(0x7f70180b1330 msgr2=0x7f701806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:30.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 shutdown_connections 2024-04-18T03:41:30.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.306+0000 7f7017fff700 1 -- 172.21.15.157:0/3906426997 wait complete. 2024-04-18T03:41:30.314 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:41:30.326 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-18T03:41:29.858587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31730824,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":488,"num_write":3272,"num_write_kb":34003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8652,"ondisk_log_size":8652,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":333616,"kb_used_data":64240,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754641104,"statfs":{"total":773094113280,"available":772752490496,"internally_reserved":0,"allocated":65781760,"data_stored":64389399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005062"},"pg_stats":[{"pgid":"2.1f","version":"27'41","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.601078+0000","last_change":"2024-04-18T03:37:33.922528+0000","last_active":"2024-04-18T03:40:39.601078+0000","last_peered":"2024-04-18T03:40:39.601078+0000","last_clean":"2024-04-18T03:40:39.601078+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:40:39.601078+0000","last_undegraded":"2024-04-18T03:40:39.601078+0000","last_fullsized":"2024-04-18T03:40:39.601078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:05:10.328715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551062+0000","last_change":"2024-04-18T03:37:34.316836+0000","last_active":"2024-04-18T03:40:52.551062+0000","last_peered":"2024-04-18T03:40:52.551062+0000","last_clean":"2024-04-18T03:40:52.551062+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:40:52.551062+0000","last_undegraded":"2024-04-18T03:40:52.551062+0000","last_fullsized":"2024-04-18T03:40:52.551062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'49","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845576+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:40:47.845576+0000","last_peered":"2024-04-18T03:40:47.845576+0000","last_clean":"2024-04-18T03:40:47.845576+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:40:47.845576+0000","last_undegraded":"2024-04-18T03:40:47.845576+0000","last_fullsized":"2024-04-18T03:40:47.845576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:51:07.334398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'30","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.112956+0000","last_change":"2024-04-18T03:37:33.925462+0000","last_active":"2024-04-18T03:40:42.112956+0000","last_peered":"2024-04-18T03:40:42.112956+0000","last_clean":"2024-04-18T03:40:42.112956+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:40:42.112956+0000","last_undegraded":"2024-04-18T03:40:42.112956+0000","last_fullsized":"2024-04-18T03:40:42.112956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:23.795590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'57","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553108+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:40:52.553108+0000","last_peered":"2024-04-18T03:40:52.553108+0000","last_clean":"2024-04-18T03:40:52.553108+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:40:52.553108+0000","last_undegraded":"2024-04-18T03:40:52.553108+0000","last_fullsized":"2024-04-18T03:40:52.553108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851456+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:40:47.851456+0000","last_peered":"2024-04-18T03:40:47.851456+0000","last_clean":"2024-04-18T03:40:47.851456+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:40:47.851456+0000","last_undegraded":"2024-04-18T03:40:47.851456+0000","last_fullsized":"2024-04-18T03:40:47.851456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'64","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:12.605809+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:41:12.605809+0000","last_peered":"2024-04-18T03:41:12.605809+0000","last_clean":"2024-04-18T03:41:12.605809+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:41:12.605809+0000","last_undegraded":"2024-04-18T03:41:12.605809+0000","last_fullsized":"2024-04-18T03:41:12.605809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604669,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562731+0000","last_change":"2024-04-18T03:37:34.306151+0000","last_active":"2024-04-18T03:40:52.562731+0000","last_peered":"2024-04-18T03:40:52.562731+0000","last_clean":"2024-04-18T03:40:52.562731+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:40:52.562731+0000","last_undegraded":"2024-04-18T03:40:52.562731+0000","last_fullsized":"2024-04-18T03:40:52.562731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'44","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847304+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:40:47.847304+0000","last_peered":"2024-04-18T03:40:47.847304+0000","last_clean":"2024-04-18T03:40:47.847304+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:40:47.847304+0000","last_undegraded":"2024-04-18T03:40:47.847304+0000","last_fullsized":"2024-04-18T03:40:47.847304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.587521+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:40:39.587521+0000","last_peered":"2024-04-18T03:40:39.587521+0000","last_clean":"2024-04-18T03:40:39.587521+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:40:39.587521+0000","last_undegraded":"2024-04-18T03:40:39.587521+0000","last_fullsized":"2024-04-18T03:40:39.587521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:12.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559721+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:40:52.559721+0000","last_peered":"2024-04-18T03:40:52.559721+0000","last_clean":"2024-04-18T03:40:52.559721+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:40:52.559721+0000","last_undegraded":"2024-04-18T03:40:52.559721+0000","last_fullsized":"2024-04-18T03:40:52.559721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'40","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847344+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:40:47.847344+0000","last_peered":"2024-04-18T03:40:47.847344+0000","last_clean":"2024-04-18T03:40:47.847344+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:40:47.847344+0000","last_undegraded":"2024-04-18T03:40:47.847344+0000","last_fullsized":"2024-04-18T03:40:47.847344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:29:44.713922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'42","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.542046+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:40:52.542046+0000","last_peered":"2024-04-18T03:40:52.542046+0000","last_clean":"2024-04-18T03:40:52.542046+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:40:52.542046+0000","last_undegraded":"2024-04-18T03:40:52.542046+0000","last_fullsized":"2024-04-18T03:40:52.542046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'527","reported_seq":545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598960+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:40:39.598960+0000","last_peered":"2024-04-18T03:40:39.598960+0000","last_clean":"2024-04-18T03:40:39.598960+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:40:39.598960+0000","last_undegraded":"2024-04-18T03:40:39.598960+0000","last_fullsized":"2024-04-18T03:40:39.598960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:08.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'41","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838531+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:40:47.838531+0000","last_peered":"2024-04-18T03:40:47.838531+0000","last_clean":"2024-04-18T03:40:47.838531+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:40:47.838531+0000","last_undegraded":"2024-04-18T03:40:47.838531+0000","last_fullsized":"2024-04-18T03:40:47.838531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:09:17.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543682+0000","last_change":"2024-04-18T03:38:23.517111+0000","last_active":"2024-04-18T03:40:52.543682+0000","last_peered":"2024-04-18T03:40:52.543682+0000","last_clean":"2024-04-18T03:40:52.543682+0000","last_became_active":"2024-04-18T03:38:23.516790+0000","last_became_peered":"2024-04-18T03:38:23.516790+0000","last_unstale":"2024-04-18T03:40:52.543682+0000","last_undegraded":"2024-04-18T03:40:52.543682+0000","last_fullsized":"2024-04-18T03:40:52.543682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:10:09.506622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"27'31","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.577011+0000","last_change":"2024-04-18T03:37:33.928257+0000","last_active":"2024-04-18T03:40:39.577011+0000","last_peered":"2024-04-18T03:40:39.577011+0000","last_clean":"2024-04-18T03:40:39.577011+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:40:39.577011+0000","last_undegraded":"2024-04-18T03:40:39.577011+0000","last_fullsized":"2024-04-18T03:40:39.577011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'48","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838662+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:40:47.838662+0000","last_peered":"2024-04-18T03:40:47.838662+0000","last_clean":"2024-04-18T03:40:47.838662+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:40:47.838662+0000","last_undegraded":"2024-04-18T03:40:47.838662+0000","last_fullsized":"2024-04-18T03:40:47.838662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552324+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:40:52.552324+0000","last_peered":"2024-04-18T03:40:52.552324+0000","last_clean":"2024-04-18T03:40:52.552324+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:40:52.552324+0000","last_undegraded":"2024-04-18T03:40:52.552324+0000","last_fullsized":"2024-04-18T03:40:52.552324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:15:10.489560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'28","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.722721+0000","last_change":"2024-04-18T03:37:33.921368+0000","last_active":"2024-04-18T03:40:49.722721+0000","last_peered":"2024-04-18T03:40:49.722721+0000","last_clean":"2024-04-18T03:40:49.722721+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:40:49.722721+0000","last_undegraded":"2024-04-18T03:40:49.722721+0000","last_fullsized":"2024-04-18T03:40:49.722721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'40","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857384+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:40:47.857384+0000","last_peered":"2024-04-18T03:40:47.857384+0000","last_clean":"2024-04-18T03:40:47.857384+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:40:47.857384+0000","last_undegraded":"2024-04-18T03:40:47.857384+0000","last_fullsized":"2024-04-18T03:40:47.857384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:44:26.586052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.524278+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:40:52.524278+0000","last_peered":"2024-04-18T03:40:52.524278+0000","last_clean":"2024-04-18T03:40:52.524278+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:40:52.524278+0000","last_undegraded":"2024-04-18T03:40:52.524278+0000","last_fullsized":"2024-04-18T03:40:52.524278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:55.630435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.595207+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:40:39.595207+0000","last_peered":"2024-04-18T03:40:39.595207+0000","last_clean":"2024-04-18T03:40:39.595207+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:40:39.595207+0000","last_undegraded":"2024-04-18T03:40:39.595207+0000","last_fullsized":"2024-04-18T03:40:39.595207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:07:09.652439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'42","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845971+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:40:47.845971+0000","last_peered":"2024-04-18T03:40:47.845971+0000","last_clean":"2024-04-18T03:40:47.845971+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:40:47.845971+0000","last_undegraded":"2024-04-18T03:40:47.845971+0000","last_fullsized":"2024-04-18T03:40:47.845971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549472+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:40:52.549472+0000","last_peered":"2024-04-18T03:40:52.549472+0000","last_clean":"2024-04-18T03:40:52.549472+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:40:52.549472+0000","last_undegraded":"2024-04-18T03:40:52.549472+0000","last_fullsized":"2024-04-18T03:40:52.549472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'26","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.731034+0000","last_change":"2024-04-18T03:37:33.929905+0000","last_active":"2024-04-18T03:40:49.731034+0000","last_peered":"2024-04-18T03:40:49.731034+0000","last_clean":"2024-04-18T03:40:49.731034+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:40:49.731034+0000","last_undegraded":"2024-04-18T03:40:49.731034+0000","last_fullsized":"2024-04-18T03:40:49.731034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'46","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.849762+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:40:47.849762+0000","last_peered":"2024-04-18T03:40:47.849762+0000","last_clean":"2024-04-18T03:40:47.849762+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:40:47.849762+0000","last_undegraded":"2024-04-18T03:40:47.849762+0000","last_fullsized":"2024-04-18T03:40:47.849762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559720+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:40:52.559720+0000","last_peered":"2024-04-18T03:40:52.559720+0000","last_clean":"2024-04-18T03:40:52.559720+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:40:52.559720+0000","last_undegraded":"2024-04-18T03:40:52.559720+0000","last_fullsized":"2024-04-18T03:40:52.559720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:16.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'38","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:48.070931+0000","last_change":"2024-04-18T03:37:33.932828+0000","last_active":"2024-04-18T03:40:48.070931+0000","last_peered":"2024-04-18T03:40:48.070931+0000","last_clean":"2024-04-18T03:40:48.070931+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:40:48.070931+0000","last_undegraded":"2024-04-18T03:40:48.070931+0000","last_fullsized":"2024-04-18T03:40:48.070931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:54.616136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'51","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.815270+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:40:47.815270+0000","last_peered":"2024-04-18T03:40:47.815270+0000","last_clean":"2024-04-18T03:40:47.815270+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:40:47.815270+0000","last_undegraded":"2024-04-18T03:40:47.815270+0000","last_fullsized":"2024-04-18T03:40:47.815270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:45.707050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'45","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549693+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:40:52.549693+0000","last_peered":"2024-04-18T03:40:52.549693+0000","last_clean":"2024-04-18T03:40:52.549693+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:40:52.549693+0000","last_undegraded":"2024-04-18T03:40:52.549693+0000","last_fullsized":"2024-04-18T03:40:52.549693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'28","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.591466+0000","last_change":"2024-04-18T03:37:33.924320+0000","last_active":"2024-04-18T03:40:39.591466+0000","last_peered":"2024-04-18T03:40:39.591466+0000","last_clean":"2024-04-18T03:40:39.591466+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:40:39.591466+0000","last_undegraded":"2024-04-18T03:40:39.591466+0000","last_fullsized":"2024-04-18T03:40:39.591466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851656+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:40:47.851656+0000","last_peered":"2024-04-18T03:40:47.851656+0000","last_clean":"2024-04-18T03:40:47.851656+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:40:47.851656+0000","last_undegraded":"2024-04-18T03:40:47.851656+0000","last_fullsized":"2024-04-18T03:40:47.851656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547280+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:40:52.547280+0000","last_peered":"2024-04-18T03:40:52.547280+0000","last_clean":"2024-04-18T03:40:52.547280+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:40:52.547280+0000","last_undegraded":"2024-04-18T03:40:52.547280+0000","last_fullsized":"2024-04-18T03:40:52.547280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'22","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.590635+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:40:39.590635+0000","last_peered":"2024-04-18T03:40:39.590635+0000","last_clean":"2024-04-18T03:40:39.590635+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:40:39.590635+0000","last_undegraded":"2024-04-18T03:40:39.590635+0000","last_fullsized":"2024-04-18T03:40:39.590635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:09.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'45","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.792824+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:40:47.792824+0000","last_peered":"2024-04-18T03:40:47.792824+0000","last_clean":"2024-04-18T03:40:47.792824+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:40:47.792824+0000","last_undegraded":"2024-04-18T03:40:47.792824+0000","last_fullsized":"2024-04-18T03:40:47.792824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549805+0000","last_change":"2024-04-18T03:37:34.308669+0000","last_active":"2024-04-18T03:40:52.549805+0000","last_peered":"2024-04-18T03:40:52.549805+0000","last_clean":"2024-04-18T03:40:52.549805+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:40:52.549805+0000","last_undegraded":"2024-04-18T03:40:52.549805+0000","last_fullsized":"2024-04-18T03:40:52.549805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:07.525115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598437+0000","last_change":"2024-04-18T03:37:33.921017+0000","last_active":"2024-04-18T03:40:39.598437+0000","last_peered":"2024-04-18T03:40:39.598437+0000","last_clean":"2024-04-18T03:40:39.598437+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:40:39.598437+0000","last_undegraded":"2024-04-18T03:40:39.598437+0000","last_fullsized":"2024-04-18T03:40:39.598437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857321+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:40:47.857321+0000","last_peered":"2024-04-18T03:40:47.857321+0000","last_clean":"2024-04-18T03:40:47.857321+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:40:47.857321+0000","last_undegraded":"2024-04-18T03:40:47.857321+0000","last_fullsized":"2024-04-18T03:40:47.857321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'45","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543795+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:40:52.543795+0000","last_peered":"2024-04-18T03:40:52.543795+0000","last_clean":"2024-04-18T03:40:52.543795+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:40:52.543795+0000","last_undegraded":"2024-04-18T03:40:52.543795+0000","last_fullsized":"2024-04-18T03:40:52.543795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'73","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.684345+0000","last_change":"2024-04-18T03:37:33.916761+0000","last_active":"2024-04-18T03:40:52.684345+0000","last_peered":"2024-04-18T03:40:52.684345+0000","last_clean":"2024-04-18T03:40:52.684345+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:40:52.684345+0000","last_undegraded":"2024-04-18T03:40:52.684345+0000","last_fullsized":"2024-04-18T03:40:52.684345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":44,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'49","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.798919+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:40:47.798919+0000","last_peered":"2024-04-18T03:40:47.798919+0000","last_clean":"2024-04-18T03:40:47.798919+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:40:47.798919+0000","last_undegraded":"2024-04-18T03:40:47.798919+0000","last_fullsized":"2024-04-18T03:40:47.798919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543231+0000","last_change":"2024-04-18T03:37:34.301044+0000","last_active":"2024-04-18T03:40:52.543231+0000","last_peered":"2024-04-18T03:40:52.543231+0000","last_clean":"2024-04-18T03:40:52.543231+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:40:52.543231+0000","last_undegraded":"2024-04-18T03:40:52.543231+0000","last_fullsized":"2024-04-18T03:40:52.543231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599677+0000","last_change":"2024-04-18T03:37:33.922934+0000","last_active":"2024-04-18T03:40:39.599677+0000","last_peered":"2024-04-18T03:40:39.599677+0000","last_clean":"2024-04-18T03:40:39.599677+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:40:39.599677+0000","last_undegraded":"2024-04-18T03:40:39.599677+0000","last_fullsized":"2024-04-18T03:40:39.599677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:21.818428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'40","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843748+0000","last_change":"2024-04-18T03:38:23.756539+0000","last_active":"2024-04-18T03:40:47.843748+0000","last_peered":"2024-04-18T03:40:47.843748+0000","last_clean":"2024-04-18T03:40:47.843748+0000","last_became_active":"2024-04-18T03:38:23.755354+0000","last_became_peered":"2024-04-18T03:38:23.755354+0000","last_unstale":"2024-04-18T03:40:47.843748+0000","last_undegraded":"2024-04-18T03:40:47.843748+0000","last_fullsized":"2024-04-18T03:40:47.843748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:48:13.146033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'57","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561718+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:40:52.561718+0000","last_peered":"2024-04-18T03:40:52.561718+0000","last_clean":"2024-04-18T03:40:52.561718+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:40:52.561718+0000","last_undegraded":"2024-04-18T03:40:52.561718+0000","last_fullsized":"2024-04-18T03:40:52.561718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599918+0000","last_change":"2024-04-18T03:37:33.919255+0000","last_active":"2024-04-18T03:40:39.599918+0000","last_peered":"2024-04-18T03:40:39.599918+0000","last_clean":"2024-04-18T03:40:39.599918+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:40:39.599918+0000","last_undegraded":"2024-04-18T03:40:39.599918+0000","last_fullsized":"2024-04-18T03:40:39.599918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:38:23.750319+0000","last_change":"2024-04-18T03:37:28.881821+0000","last_active":"2024-04-18T03:38:23.750319+0000","last_peered":"2024-04-18T03:38:23.750319+0000","last_clean":"2024-04-18T03:38:23.750319+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:38:23.750319+0000","last_undegraded":"2024-04-18T03:38:23.750319+0000","last_fullsized":"2024-04-18T03:38:23.750319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_clean_scrub_stamp":"2024-04-18T03:37:27.828246+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:15.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'35","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.829690+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:40:47.829690+0000","last_peered":"2024-04-18T03:40:47.829690+0000","last_clean":"2024-04-18T03:40:47.829690+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:40:47.829690+0000","last_undegraded":"2024-04-18T03:40:47.829690+0000","last_fullsized":"2024-04-18T03:40:47.829690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562621+0000","last_change":"2024-04-18T03:37:34.308036+0000","last_active":"2024-04-18T03:40:52.562621+0000","last_peered":"2024-04-18T03:40:52.562621+0000","last_clean":"2024-04-18T03:40:52.562621+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:40:52.562621+0000","last_undegraded":"2024-04-18T03:40:52.562621+0000","last_fullsized":"2024-04-18T03:40:52.562621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'29","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.601414+0000","last_change":"2024-04-18T03:37:33.922748+0000","last_active":"2024-04-18T03:40:39.601414+0000","last_peered":"2024-04-18T03:40:39.601414+0000","last_clean":"2024-04-18T03:40:39.601414+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:40:39.601414+0000","last_undegraded":"2024-04-18T03:40:39.601414+0000","last_fullsized":"2024-04-18T03:40:39.601414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'34","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.823501+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:40:47.823501+0000","last_peered":"2024-04-18T03:40:47.823501+0000","last_clean":"2024-04-18T03:40:47.823501+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:40:47.823501+0000","last_undegraded":"2024-04-18T03:40:47.823501+0000","last_fullsized":"2024-04-18T03:40:47.823501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:02.179174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560420+0000","last_change":"2024-04-18T03:37:34.300176+0000","last_active":"2024-04-18T03:40:52.560420+0000","last_peered":"2024-04-18T03:40:52.560420+0000","last_clean":"2024-04-18T03:40:52.560420+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:40:52.560420+0000","last_undegraded":"2024-04-18T03:40:52.560420+0000","last_fullsized":"2024-04-18T03:40:52.560420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.600329+0000","last_change":"2024-04-18T03:37:33.916221+0000","last_active":"2024-04-18T03:40:39.600329+0000","last_peered":"2024-04-18T03:40:39.600329+0000","last_clean":"2024-04-18T03:40:39.600329+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:40:39.600329+0000","last_undegraded":"2024-04-18T03:40:39.600329+0000","last_fullsized":"2024-04-18T03:40:39.600329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:06.510816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'55","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856820+0000","last_change":"2024-04-18T03:38:23.707932+0000","last_active":"2024-04-18T03:40:47.856820+0000","last_peered":"2024-04-18T03:40:47.856820+0000","last_clean":"2024-04-18T03:40:47.856820+0000","last_became_active":"2024-04-18T03:38:23.706819+0000","last_became_peered":"2024-04-18T03:38:23.706819+0000","last_unstale":"2024-04-18T03:40:47.856820+0000","last_undegraded":"2024-04-18T03:40:47.856820+0000","last_fullsized":"2024-04-18T03:40:47.856820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:51:19.448927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561853+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:40:52.561853+0000","last_peered":"2024-04-18T03:40:52.561853+0000","last_clean":"2024-04-18T03:40:52.561853+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:40:52.561853+0000","last_undegraded":"2024-04-18T03:40:52.561853+0000","last_fullsized":"2024-04-18T03:40:52.561853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.596947+0000","last_change":"2024-04-18T03:37:33.923743+0000","last_active":"2024-04-18T03:40:39.596947+0000","last_peered":"2024-04-18T03:40:39.596947+0000","last_clean":"2024-04-18T03:40:39.596947+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:40:39.596947+0000","last_undegraded":"2024-04-18T03:40:39.596947+0000","last_fullsized":"2024-04-18T03:40:39.596947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'50","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.853932+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:40:47.853932+0000","last_peered":"2024-04-18T03:40:47.853932+0000","last_clean":"2024-04-18T03:40:47.853932+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:40:47.853932+0000","last_undegraded":"2024-04-18T03:40:47.853932+0000","last_fullsized":"2024-04-18T03:40:47.853932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:26:14.663224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'39","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.544372+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:40:52.544372+0000","last_peered":"2024-04-18T03:40:52.544372+0000","last_clean":"2024-04-18T03:40:52.544372+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:40:52.544372+0000","last_undegraded":"2024-04-18T03:40:52.544372+0000","last_fullsized":"2024-04-18T03:40:52.544372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'23","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599132+0000","last_change":"2024-04-18T03:37:33.923624+0000","last_active":"2024-04-18T03:40:39.599132+0000","last_peered":"2024-04-18T03:40:39.599132+0000","last_clean":"2024-04-18T03:40:39.599132+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:40:39.599132+0000","last_undegraded":"2024-04-18T03:40:39.599132+0000","last_fullsized":"2024-04-18T03:40:39.599132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:30:29.619675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'47","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.830977+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:40:47.830977+0000","last_peered":"2024-04-18T03:40:47.830977+0000","last_clean":"2024-04-18T03:40:47.830977+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:40:47.830977+0000","last_undegraded":"2024-04-18T03:40:47.830977+0000","last_fullsized":"2024-04-18T03:40:47.830977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:42:56.306731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.539345+0000","last_change":"2024-04-18T03:37:34.304075+0000","last_active":"2024-04-18T03:40:52.539345+0000","last_peered":"2024-04-18T03:40:52.539345+0000","last_clean":"2024-04-18T03:40:52.539345+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:40:52.539345+0000","last_undegraded":"2024-04-18T03:40:52.539345+0000","last_fullsized":"2024-04-18T03:40:52.539345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'33","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.692279+0000","last_change":"2024-04-18T03:37:33.917032+0000","last_active":"2024-04-18T03:40:50.692279+0000","last_peered":"2024-04-18T03:40:50.692279+0000","last_clean":"2024-04-18T03:40:50.692279+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:40:50.692279+0000","last_undegraded":"2024-04-18T03:40:50.692279+0000","last_fullsized":"2024-04-18T03:40:50.692279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'54","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.835036+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:40:47.835036+0000","last_peered":"2024-04-18T03:40:47.835036+0000","last_clean":"2024-04-18T03:40:47.835036+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:40:47.835036+0000","last_undegraded":"2024-04-18T03:40:47.835036+0000","last_fullsized":"2024-04-18T03:40:47.835036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545077+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:40:52.545077+0000","last_peered":"2024-04-18T03:40:52.545077+0000","last_clean":"2024-04-18T03:40:52.545077+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:40:52.545077+0000","last_undegraded":"2024-04-18T03:40:52.545077+0000","last_fullsized":"2024-04-18T03:40:52.545077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'30","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.638004+0000","last_change":"2024-04-18T03:37:33.930343+0000","last_active":"2024-04-18T03:40:42.638004+0000","last_peered":"2024-04-18T03:40:42.638004+0000","last_clean":"2024-04-18T03:40:42.638004+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:40:42.638004+0000","last_undegraded":"2024-04-18T03:40:42.638004+0000","last_fullsized":"2024-04-18T03:40:42.638004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.839352+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:40:47.839352+0000","last_peered":"2024-04-18T03:40:47.839352+0000","last_clean":"2024-04-18T03:40:47.839352+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:40:47.839352+0000","last_undegraded":"2024-04-18T03:40:47.839352+0000","last_fullsized":"2024-04-18T03:40:47.839352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:57.028939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'63","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562675+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:40:52.562675+0000","last_peered":"2024-04-18T03:40:52.562675+0000","last_clean":"2024-04-18T03:40:52.562675+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:40:52.562675+0000","last_undegraded":"2024-04-18T03:40:52.562675+0000","last_fullsized":"2024-04-18T03:40:52.562675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'35","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.657282+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:40:42.657282+0000","last_peered":"2024-04-18T03:40:42.657282+0000","last_clean":"2024-04-18T03:40:42.657282+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:40:42.657282+0000","last_undegraded":"2024-04-18T03:40:42.657282+0000","last_fullsized":"2024-04-18T03:40:42.657282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'34","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.839304+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:40:47.839304+0000","last_peered":"2024-04-18T03:40:47.839304+0000","last_clean":"2024-04-18T03:40:47.839304+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:40:47.839304+0000","last_undegraded":"2024-04-18T03:40:47.839304+0000","last_fullsized":"2024-04-18T03:40:47.839304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:00:18.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563388+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:40:52.563388+0000","last_peered":"2024-04-18T03:40:52.563388+0000","last_clean":"2024-04-18T03:40:52.563388+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:40:52.563388+0000","last_undegraded":"2024-04-18T03:40:52.563388+0000","last_fullsized":"2024-04-18T03:40:52.563388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'17","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.592478+0000","last_change":"2024-04-18T03:37:33.927394+0000","last_active":"2024-04-18T03:40:39.592478+0000","last_peered":"2024-04-18T03:40:39.592478+0000","last_clean":"2024-04-18T03:40:39.592478+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:40:39.592478+0000","last_undegraded":"2024-04-18T03:40:39.592478+0000","last_fullsized":"2024-04-18T03:40:39.592478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'38","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.823050+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:40:47.823050+0000","last_peered":"2024-04-18T03:40:47.823050+0000","last_clean":"2024-04-18T03:40:47.823050+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:40:47.823050+0000","last_undegraded":"2024-04-18T03:40:47.823050+0000","last_fullsized":"2024-04-18T03:40:47.823050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:08.435358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562533+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:40:52.562533+0000","last_peered":"2024-04-18T03:40:52.562533+0000","last_clean":"2024-04-18T03:40:52.562533+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:40:52.562533+0000","last_undegraded":"2024-04-18T03:40:52.562533+0000","last_fullsized":"2024-04-18T03:40:52.562533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:16:02.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'909","reported_seq":927,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:02.522993+0000","last_change":"2024-04-18T03:37:33.929970+0000","last_active":"2024-04-18T03:41:02.522993+0000","last_peered":"2024-04-18T03:41:02.522993+0000","last_clean":"2024-04-18T03:41:02.522993+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:41:02.522993+0000","last_undegraded":"2024-04-18T03:41:02.522993+0000","last_fullsized":"2024-04-18T03:41:02.522993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.472626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.849440+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:40:47.849440+0000","last_peered":"2024-04-18T03:40:47.849440+0000","last_clean":"2024-04-18T03:40:47.849440+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:40:47.849440+0000","last_undegraded":"2024-04-18T03:40:47.849440+0000","last_fullsized":"2024-04-18T03:40:47.849440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.539661+0000","last_change":"2024-04-18T03:37:34.299294+0000","last_active":"2024-04-18T03:40:52.539661+0000","last_peered":"2024-04-18T03:40:52.539661+0000","last_clean":"2024-04-18T03:40:52.539661+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:40:52.539661+0000","last_undegraded":"2024-04-18T03:40:52.539661+0000","last_fullsized":"2024-04-18T03:40:52.539661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:10.767359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'48","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.706214+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:40:50.706214+0000","last_peered":"2024-04-18T03:40:50.706214+0000","last_clean":"2024-04-18T03:40:50.706214+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:40:50.706214+0000","last_undegraded":"2024-04-18T03:40:50.706214+0000","last_fullsized":"2024-04-18T03:40:50.706214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:42.808326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'45","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.840857+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:40:47.840857+0000","last_peered":"2024-04-18T03:40:47.840857+0000","last_clean":"2024-04-18T03:40:47.840857+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:40:47.840857+0000","last_undegraded":"2024-04-18T03:40:47.840857+0000","last_fullsized":"2024-04-18T03:40:47.840857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:40:51.668813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553243+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:40:52.553243+0000","last_peered":"2024-04-18T03:40:52.553243+0000","last_clean":"2024-04-18T03:40:52.553243+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:40:52.553243+0000","last_undegraded":"2024-04-18T03:40:52.553243+0000","last_fullsized":"2024-04-18T03:40:52.553243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:21:39.123576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599913+0000","last_change":"2024-04-18T03:37:33.931236+0000","last_active":"2024-04-18T03:40:39.599913+0000","last_peered":"2024-04-18T03:40:39.599913+0000","last_clean":"2024-04-18T03:40:39.599913+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:40:39.599913+0000","last_undegraded":"2024-04-18T03:40:39.599913+0000","last_fullsized":"2024-04-18T03:40:39.599913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'39","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843384+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:40:47.843384+0000","last_peered":"2024-04-18T03:40:47.843384+0000","last_clean":"2024-04-18T03:40:47.843384+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:40:47.843384+0000","last_undegraded":"2024-04-18T03:40:47.843384+0000","last_fullsized":"2024-04-18T03:40:47.843384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:23.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'73","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561939+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:40:52.561939+0000","last_peered":"2024-04-18T03:40:52.561939+0000","last_clean":"2024-04-18T03:40:52.561939+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:40:52.561939+0000","last_undegraded":"2024-04-18T03:40:52.561939+0000","last_fullsized":"2024-04-18T03:40:52.561939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'23","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598903+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:40:39.598903+0000","last_peered":"2024-04-18T03:40:39.598903+0000","last_clean":"2024-04-18T03:40:39.598903+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:40:39.598903+0000","last_undegraded":"2024-04-18T03:40:39.598903+0000","last_fullsized":"2024-04-18T03:40:39.598903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'42","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.819889+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:40:47.819889+0000","last_peered":"2024-04-18T03:40:47.819889+0000","last_clean":"2024-04-18T03:40:47.819889+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:40:47.819889+0000","last_undegraded":"2024-04-18T03:40:47.819889+0000","last_fullsized":"2024-04-18T03:40:47.819889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:29:14.484508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.818602+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:40:47.818602+0000","last_peered":"2024-04-18T03:40:47.818602+0000","last_clean":"2024-04-18T03:40:47.818602+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:40:47.818602+0000","last_undegraded":"2024-04-18T03:40:47.818602+0000","last_fullsized":"2024-04-18T03:40:47.818602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552611+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:40:52.552611+0000","last_peered":"2024-04-18T03:40:52.552611+0000","last_clean":"2024-04-18T03:40:52.552611+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:40:52.552611+0000","last_undegraded":"2024-04-18T03:40:52.552611+0000","last_fullsized":"2024-04-18T03:40:52.552611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:38.556875+0000","last_change":"2024-04-18T03:37:33.925286+0000","last_active":"2024-04-18T03:40:38.556875+0000","last_peered":"2024-04-18T03:40:38.556875+0000","last_clean":"2024-04-18T03:40:38.556875+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:40:38.556875+0000","last_undegraded":"2024-04-18T03:40:38.556875+0000","last_fullsized":"2024-04-18T03:40:38.556875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'50","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.850145+0000","last_change":"2024-04-18T03:38:23.708738+0000","last_active":"2024-04-18T03:40:47.850145+0000","last_peered":"2024-04-18T03:40:47.850145+0000","last_clean":"2024-04-18T03:40:47.850145+0000","last_became_active":"2024-04-18T03:38:23.707524+0000","last_became_peered":"2024-04-18T03:38:23.707524+0000","last_unstale":"2024-04-18T03:40:47.850145+0000","last_undegraded":"2024-04-18T03:40:47.850145+0000","last_fullsized":"2024-04-18T03:40:47.850145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:49:54.313746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'65","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551506+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:40:52.551506+0000","last_peered":"2024-04-18T03:40:52.551506+0000","last_clean":"2024-04-18T03:40:52.551506+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:40:52.551506+0000","last_undegraded":"2024-04-18T03:40:52.551506+0000","last_fullsized":"2024-04-18T03:40:52.551506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:14:23.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'19","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.591356+0000","last_change":"2024-04-18T03:37:33.932436+0000","last_active":"2024-04-18T03:40:39.591356+0000","last_peered":"2024-04-18T03:40:39.591356+0000","last_clean":"2024-04-18T03:40:39.591356+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:40:39.591356+0000","last_undegraded":"2024-04-18T03:40:39.591356+0000","last_fullsized":"2024-04-18T03:40:39.591356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:11.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'42","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598520+0000","last_change":"2024-04-18T03:37:33.929695+0000","last_active":"2024-04-18T03:40:39.598520+0000","last_peered":"2024-04-18T03:40:39.598520+0000","last_clean":"2024-04-18T03:40:39.598520+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:40:39.598520+0000","last_undegraded":"2024-04-18T03:40:39.598520+0000","last_fullsized":"2024-04-18T03:40:39.598520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:29.848633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554295+0000","last_change":"2024-04-18T03:37:34.306548+0000","last_active":"2024-04-18T03:40:52.554295+0000","last_peered":"2024-04-18T03:40:52.554295+0000","last_clean":"2024-04-18T03:40:52.554295+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:40:52.554295+0000","last_undegraded":"2024-04-18T03:40:52.554295+0000","last_fullsized":"2024-04-18T03:40:52.554295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843692+0000","last_change":"2024-04-18T03:37:38.336681+0000","last_active":"2024-04-18T03:40:47.843692+0000","last_peered":"2024-04-18T03:40:47.843692+0000","last_clean":"2024-04-18T03:40:47.843692+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:40:47.843692+0000","last_undegraded":"2024-04-18T03:40:47.843692+0000","last_fullsized":"2024-04-18T03:40:47.843692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:16.022475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1515","reported_seq":1533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.603653+0000","last_change":"2024-04-18T03:37:33.923165+0000","last_active":"2024-04-18T03:40:39.603653+0000","last_peered":"2024-04-18T03:40:39.603653+0000","last_clean":"2024-04-18T03:40:39.603653+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:40:39.603653+0000","last_undegraded":"2024-04-18T03:40:39.603653+0000","last_fullsized":"2024-04-18T03:40:39.603653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1515,"log_dups_size":0,"ondisk_log_size":1515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1489,"num_write_kb":4584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'44","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.542586+0000","last_change":"2024-04-18T03:37:34.289192+0000","last_active":"2024-04-18T03:40:52.542586+0000","last_peered":"2024-04-18T03:40:52.542586+0000","last_clean":"2024-04-18T03:40:52.542586+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:40:52.542586+0000","last_undegraded":"2024-04-18T03:40:52.542586+0000","last_fullsized":"2024-04-18T03:40:52.542586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:35.397966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'55","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856434+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:40:47.856434+0000","last_peered":"2024-04-18T03:40:47.856434+0000","last_clean":"2024-04-18T03:40:47.856434+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:40:47.856434+0000","last_undegraded":"2024-04-18T03:40:47.856434+0000","last_fullsized":"2024-04-18T03:40:47.856434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:57.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'69","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.548740+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:40:52.548740+0000","last_peered":"2024-04-18T03:40:52.548740+0000","last_clean":"2024-04-18T03:40:52.548740+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:40:52.548740+0000","last_undegraded":"2024-04-18T03:40:52.548740+0000","last_fullsized":"2024-04-18T03:40:52.548740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'59","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553815+0000","last_change":"2024-04-18T03:37:34.295362+0000","last_active":"2024-04-18T03:40:52.553815+0000","last_peered":"2024-04-18T03:40:52.553815+0000","last_clean":"2024-04-18T03:40:52.553815+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:40:52.553815+0000","last_undegraded":"2024-04-18T03:40:52.553815+0000","last_fullsized":"2024-04-18T03:40:52.553815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:13.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554725+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:40:52.554725+0000","last_peered":"2024-04-18T03:40:52.554725+0000","last_clean":"2024-04-18T03:40:52.554725+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:40:52.554725+0000","last_undegraded":"2024-04-18T03:40:52.554725+0000","last_fullsized":"2024-04-18T03:40:52.554725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'52","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553829+0000","last_change":"2024-04-18T03:37:34.305580+0000","last_active":"2024-04-18T03:40:52.553829+0000","last_peered":"2024-04-18T03:40:52.553829+0000","last_clean":"2024-04-18T03:40:52.553829+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:40:52.553829+0000","last_undegraded":"2024-04-18T03:40:52.553829+0000","last_fullsized":"2024-04-18T03:40:52.553829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.550134+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:40:52.550134+0000","last_peered":"2024-04-18T03:40:52.550134+0000","last_clean":"2024-04-18T03:40:52.550134+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:40:52.550134+0000","last_undegraded":"2024-04-18T03:40:52.550134+0000","last_fullsized":"2024-04-18T03:40:52.550134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'37","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546218+0000","last_change":"2024-04-18T03:37:34.298453+0000","last_active":"2024-04-18T03:40:52.546218+0000","last_peered":"2024-04-18T03:40:52.546218+0000","last_clean":"2024-04-18T03:40:52.546218+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:40:52.546218+0000","last_undegraded":"2024-04-18T03:40:52.546218+0000","last_fullsized":"2024-04-18T03:40:52.546218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:52.623649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'66","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.558555+0000","last_change":"2024-04-18T03:38:23.515116+0000","last_active":"2024-04-18T03:40:52.558555+0000","last_peered":"2024-04-18T03:40:52.558555+0000","last_clean":"2024-04-18T03:40:52.558555+0000","last_became_active":"2024-04-18T03:38:23.514633+0000","last_became_peered":"2024-04-18T03:38:23.514633+0000","last_unstale":"2024-04-18T03:40:52.558555+0000","last_undegraded":"2024-04-18T03:40:52.558555+0000","last_fullsized":"2024-04-18T03:40:52.558555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:04.434087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'42","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547910+0000","last_change":"2024-04-18T03:37:34.310319+0000","last_active":"2024-04-18T03:40:52.547910+0000","last_peered":"2024-04-18T03:40:52.547910+0000","last_clean":"2024-04-18T03:40:52.547910+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:40:52.547910+0000","last_undegraded":"2024-04-18T03:40:52.547910+0000","last_fullsized":"2024-04-18T03:40:52.547910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:44.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560802+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:40:52.560802+0000","last_peered":"2024-04-18T03:40:52.560802+0000","last_clean":"2024-04-18T03:40:52.560802+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:40:52.560802+0000","last_undegraded":"2024-04-18T03:40:52.560802+0000","last_fullsized":"2024-04-18T03:40:52.560802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551501+0000","last_change":"2024-04-18T03:37:34.310229+0000","last_active":"2024-04-18T03:40:52.551501+0000","last_peered":"2024-04-18T03:40:52.551501+0000","last_clean":"2024-04-18T03:40:52.551501+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:40:52.551501+0000","last_undegraded":"2024-04-18T03:40:52.551501+0000","last_fullsized":"2024-04-18T03:40:52.551501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'58","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563696+0000","last_change":"2024-04-18T03:38:23.754521+0000","last_active":"2024-04-18T03:40:52.563696+0000","last_peered":"2024-04-18T03:40:52.563696+0000","last_clean":"2024-04-18T03:40:52.563696+0000","last_became_active":"2024-04-18T03:38:23.753851+0000","last_became_peered":"2024-04-18T03:38:23.753851+0000","last_unstale":"2024-04-18T03:40:52.563696+0000","last_undegraded":"2024-04-18T03:40:52.563696+0000","last_fullsized":"2024-04-18T03:40:52.563696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:13:50.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"27'63","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.564060+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:40:52.564060+0000","last_peered":"2024-04-18T03:40:52.564060+0000","last_clean":"2024-04-18T03:40:52.564060+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:40:52.564060+0000","last_undegraded":"2024-04-18T03:40:52.564060+0000","last_fullsized":"2024-04-18T03:40:52.564060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:50:31.602454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'62","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545598+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:40:52.545598+0000","last_peered":"2024-04-18T03:40:52.545598+0000","last_clean":"2024-04-18T03:40:52.545598+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:40:52.545598+0000","last_undegraded":"2024-04-18T03:40:52.545598+0000","last_fullsized":"2024-04-18T03:40:52.545598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561058+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:40:52.561058+0000","last_peered":"2024-04-18T03:40:52.561058+0000","last_clean":"2024-04-18T03:40:52.561058+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:40:52.561058+0000","last_undegraded":"2024-04-18T03:40:52.561058+0000","last_fullsized":"2024-04-18T03:40:52.561058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551885+0000","last_change":"2024-04-18T03:37:34.313079+0000","last_active":"2024-04-18T03:40:52.551885+0000","last_peered":"2024-04-18T03:40:52.551885+0000","last_clean":"2024-04-18T03:40:52.551885+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:40:52.551885+0000","last_undegraded":"2024-04-18T03:40:52.551885+0000","last_fullsized":"2024-04-18T03:40:52.551885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:50.485855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562415+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:40:52.562415+0000","last_peered":"2024-04-18T03:40:52.562415+0000","last_clean":"2024-04-18T03:40:52.562415+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:40:52.562415+0000","last_undegraded":"2024-04-18T03:40:52.562415+0000","last_fullsized":"2024-04-18T03:40:52.562415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551256+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:40:52.551256+0000","last_peered":"2024-04-18T03:40:52.551256+0000","last_clean":"2024-04-18T03:40:52.551256+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:40:52.551256+0000","last_undegraded":"2024-04-18T03:40:52.551256+0000","last_fullsized":"2024-04-18T03:40:52.551256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'53","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547747+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:40:52.547747+0000","last_peered":"2024-04-18T03:40:52.547747+0000","last_clean":"2024-04-18T03:40:52.547747+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:40:52.547747+0000","last_undegraded":"2024-04-18T03:40:52.547747+0000","last_fullsized":"2024-04-18T03:40:52.547747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:38.075625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'59","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547235+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:40:52.547235+0000","last_peered":"2024-04-18T03:40:52.547235+0000","last_clean":"2024-04-18T03:40:52.547235+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:40:52.547235+0000","last_undegraded":"2024-04-18T03:40:52.547235+0000","last_fullsized":"2024-04-18T03:40:52.547235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551542+0000","last_change":"2024-04-18T03:37:34.314282+0000","last_active":"2024-04-18T03:40:52.551542+0000","last_peered":"2024-04-18T03:40:52.551542+0000","last_clean":"2024-04-18T03:40:52.551542+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:40:52.551542+0000","last_undegraded":"2024-04-18T03:40:52.551542+0000","last_fullsized":"2024-04-18T03:40:52.551542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'44","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.527773+0000","last_change":"2024-04-18T03:37:34.299168+0000","last_active":"2024-04-18T03:40:52.527773+0000","last_peered":"2024-04-18T03:40:52.527773+0000","last_clean":"2024-04-18T03:40:52.527773+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:40:52.527773+0000","last_undegraded":"2024-04-18T03:40:52.527773+0000","last_fullsized":"2024-04-18T03:40:52.527773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:43.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551884+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:40:52.551884+0000","last_peered":"2024-04-18T03:40:52.551884+0000","last_clean":"2024-04-18T03:40:52.551884+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:40:52.551884+0000","last_undegraded":"2024-04-18T03:40:52.551884+0000","last_fullsized":"2024-04-18T03:40:52.551884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'53","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560125+0000","last_change":"2024-04-18T03:38:23.515120+0000","last_active":"2024-04-18T03:40:52.560125+0000","last_peered":"2024-04-18T03:40:52.560125+0000","last_clean":"2024-04-18T03:40:52.560125+0000","last_became_active":"2024-04-18T03:38:23.514732+0000","last_became_peered":"2024-04-18T03:38:23.514732+0000","last_unstale":"2024-04-18T03:40:52.560125+0000","last_undegraded":"2024-04-18T03:40:52.560125+0000","last_fullsized":"2024-04-18T03:40:52.560125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:10.490370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561761+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:40:52.561761+0000","last_peered":"2024-04-18T03:40:52.561761+0000","last_clean":"2024-04-18T03:40:52.561761+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:40:52.561761+0000","last_undegraded":"2024-04-18T03:40:52.561761+0000","last_fullsized":"2024-04-18T03:40:52.561761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561804+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:40:52.561804+0000","last_peered":"2024-04-18T03:40:52.561804+0000","last_clean":"2024-04-18T03:40:52.561804+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:40:52.561804+0000","last_undegraded":"2024-04-18T03:40:52.561804+0000","last_fullsized":"2024-04-18T03:40:52.561804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552286+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:40:52.552286+0000","last_peered":"2024-04-18T03:40:52.552286+0000","last_clean":"2024-04-18T03:40:52.552286+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:40:52.552286+0000","last_undegraded":"2024-04-18T03:40:52.552286+0000","last_fullsized":"2024-04-18T03:40:52.552286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547093+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:40:52.547093+0000","last_peered":"2024-04-18T03:40:52.547093+0000","last_clean":"2024-04-18T03:40:52.547093+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:40:52.547093+0000","last_undegraded":"2024-04-18T03:40:52.547093+0000","last_fullsized":"2024-04-18T03:40:52.547093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562460+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:40:52.562460+0000","last_peered":"2024-04-18T03:40:52.562460+0000","last_clean":"2024-04-18T03:40:52.562460+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:40:52.562460+0000","last_undegraded":"2024-04-18T03:40:52.562460+0000","last_fullsized":"2024-04-18T03:40:52.562460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'40","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560874+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:40:52.560874+0000","last_peered":"2024-04-18T03:40:52.560874+0000","last_clean":"2024-04-18T03:40:52.560874+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:40:52.560874+0000","last_undegraded":"2024-04-18T03:40:52.560874+0000","last_fullsized":"2024-04-18T03:40:52.560874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545925+0000","last_change":"2024-04-18T03:37:34.300927+0000","last_active":"2024-04-18T03:40:52.545925+0000","last_peered":"2024-04-18T03:40:52.545925+0000","last_clean":"2024-04-18T03:40:52.545925+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:40:52.545925+0000","last_undegraded":"2024-04-18T03:40:52.545925+0000","last_fullsized":"2024-04-18T03:40:52.545925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546623+0000","last_change":"2024-04-18T03:37:34.289446+0000","last_active":"2024-04-18T03:40:52.546623+0000","last_peered":"2024-04-18T03:40:52.546623+0000","last_clean":"2024-04-18T03:40:52.546623+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:40:52.546623+0000","last_undegraded":"2024-04-18T03:40:52.546623+0000","last_fullsized":"2024-04-18T03:40:52.546623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:02:23.019029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560712+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:40:52.560712+0000","last_peered":"2024-04-18T03:40:52.560712+0000","last_clean":"2024-04-18T03:40:52.560712+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:40:52.560712+0000","last_undegraded":"2024-04-18T03:40:52.560712+0000","last_fullsized":"2024-04-18T03:40:52.560712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:49.338554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31140456,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":3113,"num_write_kb":31587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62341120,"data_stored":62280912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3821,"ondisk_log_size":3821,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49160,"kb_used_data":13952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94322680,"statfs":{"total":96636764160,"available":96586424320,"internally_reserved":0,"allocated":14286848,"data_stored":14110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83799999999999997,"15min":0.86699999999999999},"min":{"1min":0.48899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1299999999999999,"5min":1.286,"15min":1.286},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.87,"15min":0.89100000000000001},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2110000000000001,"5min":1.331,"15min":1.331},"last":1.0249999999999999}]},{"osd":1,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.88200000000000001},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1000000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.879},"min":{"1min":0.59599999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.133,"5min":1.724,"15min":1.724},"last":1.1559999999999999}]},{"osd":2,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96999999999999997,"15min":0.98999999999999999},"min":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.298,"5min":1.329,"15min":1.329},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86499999999999999,"15min":0.89000000000000001},"min":{"1min":0.59999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0669999999999999,"5min":1.228,"15min":1.228},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83599999999999997,"15min":0.83399999999999996},"min":{"1min":0.69699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.097,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90000000000000002,"15min":0.88},"min":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.081,"15min":1.101},"min":{"1min":0.86899999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7350000000000001,"5min":2.198,"15min":2.198},"last":1.113}]},{"osd":5,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90500000000000003,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":1.0109999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0700000000000001,"15min":1.0760000000000001},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.206},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.0620000000000001},"min":{"1min":0.78200000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4450000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1799999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39588,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94332252,"statfs":{"total":96636764160,"available":96596226048,"internally_reserved":0,"allocated":8679424,"data_stored":8504374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77200000000000002,"15min":0.77600000000000002},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.105,"15min":1.105},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"min":{"1min":0.61499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.006},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95099999999999996,"15min":0.96699999999999997},"min":{"1min":0.65000000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2529999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.83699999999999997,"15min":0.81100000000000005},"min":{"1min":0.67800000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2769999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90200000000000002,"15min":0.91500000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.157,"5min":1.224,"15min":1.224},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.72199999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.0629999999999999},{"interface":"front","average":{"1min":1,"5min":0.94199999999999995,"15min":0.92400000000000004},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93100000000000005,"15min":0.92700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95699999999999996,"15min":0.96299999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.234,"5min":1.236,"15min":1.236},"last":1.123}]},{"osd":6,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0149999999999999,"15min":0.98299999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.133,"5min":1.1240000000000001,"15min":1.127},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.032}]},{"osd":7,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.054,"15min":1.054},"min":{"1min":0.747,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3740000000000001,"5min":1.395,"15min":1.395},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.155,"15min":1.125},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.1539999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57928,"kb_used_data":18624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94313912,"statfs":{"total":96636764160,"available":96577445888,"internally_reserved":0,"allocated":19070976,"data_stored":18894785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77900000000000003,"15min":0.80400000000000005},"min":{"1min":0.52900000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0309999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1579999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.093}]},{"osd":1,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1479999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.495,"15min":0.495},"max":{"1min":1.034,"5min":1.123,"15min":1.123},"last":1.1220000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.63400000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0860000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.621,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.92000000000000004,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1799999999999999,"5min":1.232,"15min":1.232},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.216,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.181,"5min":1.679,"15min":1.679},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97299999999999998,"15min":0.98099999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2470000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.036}]},{"osd":5,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3380000000000001,"5min":1.617,"15min":1.617},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.79100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2729999999999999,"5min":1.496,"15min":1.496},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.80100000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.534,"5min":1.593,"15min":1.593},"last":1.167},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2549999999999999,"5min":1.462,"15min":1.462},"last":1.23}]}]},{"osd":5,"up_from":14,"seq":60129542195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":116344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.86699999999999999,"15min":0.90600000000000003},"min":{"1min":0.54600000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.008,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83599999999999997,"15min":0.85299999999999998},"min":{"1min":0.55500000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3700000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.89100000000000001},"min":{"1min":0.64800000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.878},"min":{"1min":0.64800000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0109999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91600000000000004,"15min":0.93799999999999994},"min":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.115,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.014,"15min":1.046},"min":{"1min":0.74399999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.534,"5min":1.536,"15min":1.536},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.70499999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.2430000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.04},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93600000000000005,"15min":0.92900000000000005},"min":{"1min":0.629,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.97399999999999998}]},{"osd":4,"last update":"Thu Apr 18 03:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.006,"15min":1.038},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2370000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":1.0329999999999999,"15min":1.079},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.506,"5min":1.631,"15min":1.631},"last":1.0609999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.006},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1220000000000001,"15min":1.1499999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4059999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.214}]},{"osd":7,"last update":"Thu Apr 18 03:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.014,"15min":1.046},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.196,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.256},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.2230000000000001,"15min":1.26},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.46,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.1599999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":12932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":13242368,"data_stored":13068331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.228,"5min":2.202,"15min":2.202},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.2290000000000001,"5min":1.629,"15min":1.629},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.622,"5min":0.38,"15min":0.38},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.748,"15min":0.749},"min":{"1min":0.59399999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":1.026,"5min":0.86399999999999999,"15min":0.86799999999999999},"min":{"1min":0.73399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.5900000000000001,"5min":1.821,"15min":1.821},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.98099999999999998,"15min":0.97999999999999998},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.94099999999999995,"15min":0.93799999999999994},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3839999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.75800000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0449999999999999,"15min":1.024},"min":{"1min":0.84699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.1659999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0669999999999999,"15min":1.0680000000000001},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.0920000000000001,"15min":1.0720000000000001},"min":{"1min":0.97699999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.022,"15min":1.012},"min":{"1min":0.86799999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":1.198},{"interface":"front","average":{"1min":1.238,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.98699999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8149999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.089}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35844,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335996,"statfs":{"total":96636764160,"available":96600059904,"internally_reserved":0,"allocated":651264,"data_stored":484747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63300000000000001,"15min":0.65000000000000002},"min":{"1min":0.33200000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.94599999999999995,"5min":0.995,"15min":0.995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.39900000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.145,"5min":1.532,"15min":1.532},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.316,"15min":0.316},"max":{"1min":1.0880000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.44400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.55400000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Apr 18 03:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.409,"15min":1.409},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96899999999999997,"15min":0.98499999999999999},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1,"15min":1.016},"min":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":1.0169999999999999},"min":{"1min":0.63400000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.048,"15min":1.0589999999999999},"min":{"1min":0.76600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.03,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.137}]},{"osd":7,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0529999999999999,"15min":1.081},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.143,"5min":1.0620000000000001,"15min":1.0740000000000001},"min":{"1min":0.78600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.03}]}]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35492,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336348,"statfs":{"total":96636764160,"available":96600420352,"internally_reserved":0,"allocated":290816,"data_stored":116414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.504,"5min":0.25,"15min":0.25},"max":{"1min":0.78300000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.48999999999999999,"5min":0.215,"15min":0.215},"max":{"1min":1.1020000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.50600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.64000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3169999999999999,"5min":1.321,"15min":1.321},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80500000000000005,"15min":0.83499999999999996},"min":{"1min":0.58199999999999996,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.028,"5min":1.583,"15min":1.583},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.69899999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1180000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2190000000000001,"5min":1.337,"15min":1.337},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.70399999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.244,"5min":1.274,"15min":1.274},"last":0.748}]},{"osd":5,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98999999999999999,"15min":1.006},"min":{"1min":0.73499999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2649999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.84399999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.304,"5min":1.353,"15min":1.353},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.095,"15min":1.143},"min":{"1min":0.81599999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4179999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.099,"5min":1.0900000000000001,"15min":1.123},"min":{"1min":0.83099999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.407,"5min":2.242,"15min":2.242},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1020000000000001,"15min":1.137},"min":{"1min":0.997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3640000000000001,"5min":2.044,"15min":2.044},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.96299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4590000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.012}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44264,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94327576,"statfs":{"total":96636764160,"available":96591437824,"internally_reserved":0,"allocated":9273344,"data_stored":9094201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.51300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.49099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.68700000000000006,"15min":0.69599999999999995},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.66600000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99099999999999999,"5min":1.103,"15min":1.103},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.70699999999999996,"15min":0.68100000000000005},"min":{"1min":0.52800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.751},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.58399999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68799999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.048},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98799999999999999,"15min":0.96799999999999997},"min":{"1min":0.85399999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.077},{"interface":"front","average":{"1min":1.129,"5min":1.0600000000000001,"15min":1.0549999999999999},"min":{"1min":0.85799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4890000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0389999999999999,"15min":1.0329999999999999},"min":{"1min":0.84599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4910000000000001,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.077,"15min":1.0640000000000001},"min":{"1min":0.82399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.1299999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.048,"15min":1.0600000000000001},"min":{"1min":0.79700000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2989999999999999,"5min":1.484,"15min":1.484},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.127,"15min":1.123},"min":{"1min":0.78200000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.97599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14004224,"data_stored":13993949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18194432,"data_stored":18188163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:41:30.332 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:41:30.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.438+0000 7ff9a9507700 1 Processor -- start 2024-04-18T03:41:30.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.438+0000 7ff9a9507700 1 -- start start 2024-04-18T03:41:30.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a9507700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a41596c0 0x7ff9a4070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a9507700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9a415dab0 0x7ff9a40b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a9507700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40af900 con 0x7ff9a4159aa0 2024-04-18T03:41:30.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a9507700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a40afb50 con 0x7ff9a415dab0 2024-04-18T03:41:30.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a9507700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40afe30 con 0x7ff9a41596c0 2024-04-18T03:41:30.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a8d06700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9a415dab0 0x7ff9a40b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a41596c0 0x7ff9a4070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a41596c0 0x7ff9a4070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:54034/0 (socket says 172.21.15.157:54034) 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff99b7fe700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff9a4159aa0 0x7ff9a415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:52480/0 (socket says 172.21.15.157:52480) 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a3fff700 1 -- 172.21.15.157:0/1753844777 learned_addr learned my addr 172.21.15.157:0/1753844777 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a8d06700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff9a415dab0 0x7ff9a40b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55292/0 (socket says 172.21.15.157:55292) 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a3fff700 1 -- 172.21.15.157:0/1753844777 >> v2:172.21.15.157:3300/0 conn(0x7ff9a415dab0 msgr2=0x7ff9a40b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a3fff700 1 --2- 172.21.15.157:0/1753844777 >> v2:172.21.15.157:3300/0 conn(0x7ff9a415dab0 0x7ff9a40b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a3fff700 1 -- 172.21.15.157:0/1753844777 >> v1:172.21.15.175:6789/0 conn(0x7ff9a4159aa0 legacy=0x7ff9a415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a3fff700 1 -- 172.21.15.157:0/1753844777 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40acb90 con 0x7ff9a41596c0 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a37fe700 1 -- 172.21.15.157:0/1753844777 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343029433 0 0) 0x7ff9a40af900 con 0x7ff9a4159aa0 2024-04-18T03:41:30.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a8d06700 1 --2- 172.21.15.157:0/1753844777 >> v2:172.21.15.157:3300/0 conn(0x7ff9a415dab0 0x7ff9a40b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a3fff700 1 --2- 172.21.15.157:0/1753844777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a41596c0 0x7ff9a4070900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff994006fd0 tx=0x7ff99400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de363ff27e6b0805 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a37fe700 1 -- 172.21.15.157:0/1753844777 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99400dc20 con 0x7ff9a41596c0 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a37fe700 1 -- 172.21.15.157:0/1753844777 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99400dd80 con 0x7ff9a41596c0 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.442+0000 7ff9a37fe700 1 -- 172.21.15.157:0/1753844777 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994004250 con 0x7ff9a41596c0 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 -- 172.21.15.157:0/1753844777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a41596c0 msgr2=0x7ff9a4070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1753844777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a41596c0 0x7ff9a4070900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff994006fd0 tx=0x7ff99400bea0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 -- 172.21.15.157:0/1753844777 shutdown_connections 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1753844777 >> v2:172.21.15.157:3300/0 conn(0x7ff9a415dab0 0x7ff9a40b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1753844777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a41596c0 0x7ff9a4070900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 -- 172.21.15.157:0/1753844777 >> 172.21.15.157:0/1753844777 conn(0x7ff9a4098a50 msgr2=0x7ff9a40b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 -- 172.21.15.157:0/1753844777 shutdown_connections 2024-04-18T03:41:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 -- 172.21.15.157:0/1753844777 wait complete. 2024-04-18T03:41:30.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 Processor -- start 2024-04-18T03:41:30.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.446+0000 7ff9a9507700 1 -- start start 2024-04-18T03:41:30.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9a41596c0 0x7ff9a40ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a4159aa0 0x7ff9a4158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a415dab0 0x7ff9a414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4158fc0 con 0x7ff9a41596c0 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a415a3b0 con 0x7ff9a4159aa0 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4158a00 con 0x7ff9a415dab0 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9a41596c0 0x7ff9a40ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9a41596c0 0x7ff9a40ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55300/0 (socket says 172.21.15.157:55300) 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 -- 172.21.15.157:0/1156087602 learned_addr learned my addr 172.21.15.157:0/1156087602 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a8d06700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a415dab0 0x7ff9a414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff99b7fe700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a4159aa0 0x7ff9a4158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 -- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a415dab0 msgr2=0x7ff9a414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a415dab0 0x7ff9a414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 -- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a4159aa0 msgr2=0x7ff9a4158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a4159aa0 0x7ff9a4158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 -- 172.21.15.157:0/1156087602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c009a70 con 0x7ff9a41596c0 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff99b7fe700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a4159aa0 0x7ff9a4158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a3fff700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9a41596c0 0x7ff9a40ce910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff99400d6d0 tx=0x7ff994004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a17fa700 1 -- 172.21.15.157:0/1156087602 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994004610 con 0x7ff9a41596c0 2024-04-18T03:41:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a17fa700 1 -- 172.21.15.157:0/1156087602 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994004030 con 0x7ff9a41596c0 2024-04-18T03:41:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99400b820 con 0x7ff9a41596c0 2024-04-18T03:41:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a17fa700 1 -- 172.21.15.157:0/1156087602 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994021450 con 0x7ff9a41596c0 2024-04-18T03:41:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a415a040 con 0x7ff9a41596c0 2024-04-18T03:41:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.450+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a4159ea0 con 0x7ff9a41596c0 2024-04-18T03:41:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.454+0000 7ff9a17fa700 1 -- 172.21.15.157:0/1156087602 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff994015070 con 0x7ff9a41596c0 2024-04-18T03:41:30.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.454+0000 7ff9a17fa700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff984066730 0x7ff984068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:30.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.454+0000 7ff9a17fa700 1 -- 172.21.15.157:0/1156087602 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff994087fe0 con 0x7ff9a41596c0 2024-04-18T03:41:30.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.454+0000 7ff99b7fe700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff984066730 0x7ff984068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:30.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.454+0000 7ff99b7fe700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff984066730 0x7ff984068bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40aeb80 tx=0x7ff98c007d00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.458+0000 7ff9a17fa700 1 -- 172.21.15.157:0/1156087602 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7ff9a4159ea0 con 0x7ff9a41596c0 2024-04-18T03:41:30.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.630+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9a4159ea0 con 0x7ff9a41596c0 2024-04-18T03:41:30.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a17fa700 1 -- 172.21.15.157:0/1156087602 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7ff9a4159ea0 con 0x7ff9a41596c0 2024-04-18T03:41:30.639 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:30.639 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:41:30.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff984066730 msgr2=0x7ff984068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff984066730 0x7ff984068bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff9a40aeb80 tx=0x7ff98c007d00 comp rx=0 tx=0).stop 2024-04-18T03:41:30.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9a41596c0 msgr2=0x7ff9a40ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:30.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9a41596c0 0x7ff9a40ce910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff99400d6d0 tx=0x7ff994004770 comp rx=0 tx=0).stop 2024-04-18T03:41:30.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 shutdown_connections 2024-04-18T03:41:30.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7ff984066730 0x7ff984068bf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9a4159aa0 0x7ff9a4158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9a415dab0 0x7ff9a414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 --2- 172.21.15.157:0/1156087602 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff9a41596c0 0x7ff9a40ce910 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:30.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 >> 172.21.15.157:0/1156087602 conn(0x7ff9a4098a50 msgr2=0x7ff9a40adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:30.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 shutdown_connections 2024-04-18T03:41:30.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:30.634+0000 7ff9a9507700 1 -- 172.21.15.157:0/1156087602 wait complete. 2024-04-18T03:41:31.655 INFO:tasks.ceph:Scrubbing osd.0 2024-04-18T03:41:31.656 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-18T03:41:31.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.782+0000 7f245b59e700 1 Processor -- start 2024-04-18T03:41:31.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.782+0000 7f245b59e700 1 -- start start 2024-04-18T03:41:31.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c15e3d0 0x7f245c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245b59e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c0b67c0 con 0x7f245c071080 2024-04-18T03:41:31.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245b59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c0b6aa0 con 0x7f245c146a90 2024-04-18T03:41:31.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0b6d80 con 0x7f245c15e3d0 2024-04-18T03:41:31.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245ad9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f245c071080 0x7f245c0d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56350/0 (socket says 172.21.15.157:56350) 2024-04-18T03:41:31.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245ad9d700 1 -- 172.21.15.157:0/182550445 learned_addr learned my addr 172.21.15.157:0/182550445 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:31.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f2459d9b700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c15e3d0 0x7f245c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039634934 0 0) 0x7f245c0b67c0 con 0x7f245c071080 2024-04-18T03:41:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24480035d0 con 0x7f245c071080 2024-04-18T03:41:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2825450522 0 0) 0x7f24480035d0 con 0x7f245c071080 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c15e3d0 msgr2=0x7f245c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c15e3d0 0x7f245c06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 >> v1:172.21.15.175:6789/0 conn(0x7f245c146a90 legacy=0x7f245c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0d1850 con 0x7f245c071080 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7f24540019f0 con 0x7f245c071080 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 >> v1:172.21.15.157:6789/0 conn(0x7f245c071080 legacy=0x7f245c0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2448003a50 0x7f2448003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c15e3d0 0x7f2448004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2448004db0 0x7f2448005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0b6d80 con 0x7f2448003a50 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244800ba30 con 0x7f2448004db0 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244800bbf0 con 0x7f245c15e3d0 2024-04-18T03:41:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245a59c700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2448003a50 0x7f2448003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245ad9d700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2448004db0 0x7f2448005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f2459d9b700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c15e3d0 0x7f2448004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245a59c700 1 -- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c15e3d0 msgr2=0x7f2448004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245a59c700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c15e3d0 0x7f2448004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245a59c700 1 -- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2448004db0 msgr2=0x7f2448005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245a59c700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2448004db0 0x7f2448005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245a59c700 1 -- 172.21.15.157:0/182550445 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480035d0 con 0x7f2448003a50 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245ad9d700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2448004db0 0x7f2448005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245a59c700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2448003a50 0x7f2448003e30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f24440018f0 tx=0x7f24480058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f4f343894d43dd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444001390 con 0x7f2448003a50 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444012620 con 0x7f2448003a50 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.786+0000 7f245959a700 1 -- 172.21.15.157:0/182550445 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24440129d0 con 0x7f2448003a50 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- 172.21.15.157:0/182550445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2448003a50 msgr2=0x7f2448003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 --2- 172.21.15.157:0/182550445 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2448003a50 0x7f2448003e30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f24440018f0 tx=0x7f24480058a0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245ad9d700 1 -- 172.21.15.157:0/182550445 reap_dead start 2024-04-18T03:41:31.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- 172.21.15.157:0/182550445 shutdown_connections 2024-04-18T03:41:31.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- 172.21.15.157:0/182550445 >> 172.21.15.157:0/182550445 conn(0x7f245c06e200 msgr2=0x7f245c06e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:31.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- 172.21.15.157:0/182550445 shutdown_connections 2024-04-18T03:41:31.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- 172.21.15.157:0/182550445 wait complete. 2024-04-18T03:41:31.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 Processor -- start 2024-04-18T03:41:31.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- start start 2024-04-18T03:41:31.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245c1f5a00 0x7f245c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c15c290 0x7f245c1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c145610 0x7f245c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c145a90 con 0x7f245c15c290 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c15d950 con 0x7f245c1f5a00 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.790+0000 7f245b59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c15cd40 con 0x7f245c145610 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c15c290 0x7f245c1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c15c290 0x7f245c1450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55326/0 (socket says 172.21.15.157:55326) 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 -- 172.21.15.157:0/2588743586 learned_addr learned my addr 172.21.15.157:0/2588743586 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f245a59c700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245c1f5a00 0x7f245c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f245ad9d700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c145610 0x7f245c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 -- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c145610 msgr2=0x7f245c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c145610 0x7f245c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 -- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245c1f5a00 msgr2=0x7f245c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245c1f5a00 0x7f245c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 -- 172.21.15.157:0/2588743586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c15d020 con 0x7f245c15c290 2024-04-18T03:41:31.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f245a59c700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245c1f5a00 0x7f245c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:31.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f245ad9d700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f245c145610 0x7f245c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:31.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2459d9b700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c15c290 0x7f245c1450d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f244c0119d0 tx=0x7f244c011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:31.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c004240 con 0x7f245c15c290 2024-04-18T03:41:31.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c0043a0 con 0x7f245c15c290 2024-04-18T03:41:31.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c15d300 con 0x7f245c15c290 2024-04-18T03:41:31.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00f730 con 0x7f245c15c290 2024-04-18T03:41:31.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c15c930 con 0x7f245c15c290 2024-04-18T03:41:31.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f245c04e650 con 0x7f245c15c290 2024-04-18T03:41:31.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.794+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f244c00f890 con 0x7f245c15c290 2024-04-18T03:41:31.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f2452ffd700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f243c066730 0x7f243c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f244c085010 con 0x7f245c15c290 2024-04-18T03:41:31.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f2452ffd700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f243c070010 0x7f243c0724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 --> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f243c072b80 con 0x7f243c070010 2024-04-18T03:41:31.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f244c085460 con 0x7f245c15c290 2024-04-18T03:41:31.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f245a59c700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f243c066730 0x7f243c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f245ad9d700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f243c070010 0x7f243c0724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f245ad9d700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f243c070010 0x7f243c0724b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:31.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f245a59c700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f243c066730 0x7f243c068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f245c06f390 tx=0x7f2444005040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:31.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.798+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 <== osd.0 v2:172.21.15.157:6820/26046 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f243c072b80 con 0x7f243c070010 2024-04-18T03:41:31.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.818+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 --> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f245c0b8280 con 0x7f243c070010 2024-04-18T03:41:31.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.818+0000 7f2452ffd700 1 -- 172.21.15.157:0/2588743586 <== osd.0 v2:172.21.15.157:6820/26046 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f245c0b8280 con 0x7f243c070010 2024-04-18T03:41:31.824 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:41:31.825 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T03:41:31.825 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.818+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f243c070010 msgr2=0x7f243c0724b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.818+0000 7f245b59e700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.157:6820/26046,v1:172.21.15.157:6822/26046] conn(0x7f243c070010 0x7f243c0724b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f243c066730 msgr2=0x7f243c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245b59e700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f243c066730 0x7f243c068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f245c06f390 tx=0x7f2444005040 comp rx=0 tx=0).stop 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c15c290 msgr2=0x7f245c1450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245b59e700 1 --2- 172.21.15.157:0/2588743586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f245c15c290 0x7f245c1450d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f244c0119d0 tx=0x7f244c011d90 comp rx=0 tx=0).stop 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245ad9d700 1 -- 172.21.15.157:0/2588743586 reap_dead start 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 shutdown_connections 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 >> 172.21.15.157:0/2588743586 conn(0x7f245c06e200 msgr2=0x7f245c070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 shutdown_connections 2024-04-18T03:41:31.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.822+0000 7f245b59e700 1 -- 172.21.15.157:0/2588743586 wait complete. 2024-04-18T03:41:31.839 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-18T03:41:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.954+0000 7f2b74cbe700 1 Processor -- start 2024-04-18T03:41:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.954+0000 7f2b74cbe700 1 -- start start 2024-04-18T03:41:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.954+0000 7f2b74cbe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b7015b4e0 0x7f2b70071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.954+0000 7f2b74cbe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b700715c0 0x7f2b7006b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.954+0000 7f2b74cbe700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7006b220 con 0x7f2b70143fa0 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.954+0000 7f2b74cbe700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b70071a50 con 0x7f2b700715c0 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.954+0000 7f2b74cbe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7006a650 con 0x7f2b7015b4e0 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.954+0000 7f2b6ed9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b700715c0 0x7f2b7006b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6ed9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b700715c0 0x7f2b7006b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55340/0 (socket says 172.21.15.157:55340) 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6ed9d700 1 -- 172.21.15.157:0/557801868 learned_addr learned my addr 172.21.15.157:0/557801868 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6e59c700 1 --1- 172.21.15.157:0/557801868 >> v1:172.21.15.157:6789/0 conn(0x7f2b70143fa0 0x7f2b700ce260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:56362/0 (socket says 172.21.15.157:56362) 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6dd9b700 1 --2- 172.21.15.157:0/557801868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b7015b4e0 0x7f2b70071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6ed9d700 1 -- 172.21.15.157:0/557801868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b7015b4e0 msgr2=0x7f2b70071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6ed9d700 1 --2- 172.21.15.157:0/557801868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b7015b4e0 0x7f2b70071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6ed9d700 1 -- 172.21.15.157:0/557801868 >> v1:172.21.15.157:6789/0 conn(0x7f2b70143fa0 legacy=0x7f2b700ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6ed9d700 1 -- 172.21.15.157:0/557801868 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7006a8f0 con 0x7f2b700715c0 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6dd9b700 1 --2- 172.21.15.157:0/557801868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b7015b4e0 0x7f2b70071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:31.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6ed9d700 1 --2- 172.21.15.157:0/557801868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b700715c0 0x7f2b7006b6b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009940 tx=0x7f2b68009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2179b66cf5e160 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6d59a700 1 -- 172.21.15.157:0/557801868 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800ba20 con 0x7f2b700715c0 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6d59a700 1 -- 172.21.15.157:0/557801868 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b68009e90 con 0x7f2b700715c0 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b6d59a700 1 -- 172.21.15.157:0/557801868 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800bda0 con 0x7f2b700715c0 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b74cbe700 1 -- 172.21.15.157:0/557801868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b700715c0 msgr2=0x7f2b7006b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/557801868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b700715c0 0x7f2b7006b6b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009940 tx=0x7f2b68009c50 comp rx=0 tx=0).stop 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b74cbe700 1 -- 172.21.15.157:0/557801868 shutdown_connections 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/557801868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b700715c0 0x7f2b7006b6b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/557801868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b7015b4e0 0x7f2b70071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b74cbe700 1 -- 172.21.15.157:0/557801868 >> 172.21.15.157:0/557801868 conn(0x7f2b7006e190 msgr2=0x7f2b7006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b74cbe700 1 -- 172.21.15.157:0/557801868 shutdown_connections 2024-04-18T03:41:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.958+0000 7f2b74cbe700 1 -- 172.21.15.157:0/557801868 wait complete. 2024-04-18T03:41:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 Processor -- start 2024-04-18T03:41:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 -- start start 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b700715c0 0x7f2b701f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b70143fa0 0x7f2b701332f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7015b4e0 0x7f2b70136460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70135fd0 con 0x7f2b7015b4e0 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700c81e0 con 0x7f2b700715c0 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701f6550 con 0x7f2b70143fa0 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7015b4e0 0x7f2b70136460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6dd9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b70143fa0 0x7f2b701332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7015b4e0 0x7f2b70136460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:55346/0 (socket says 172.21.15.157:55346) 2024-04-18T03:41:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6dd9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b70143fa0 0x7f2b701332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:54088/0 (socket says 172.21.15.157:54088) 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 -- 172.21.15.157:0/3463154294 learned_addr learned my addr 172.21.15.157:0/3463154294 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6e59c700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b700715c0 0x7f2b701f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 -- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b70143fa0 msgr2=0x7f2b701332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b70143fa0 0x7f2b701332f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 -- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b700715c0 msgr2=0x7f2b701f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b700715c0 0x7f2b701f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 -- 172.21.15.157:0/3463154294 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68009570 con 0x7f2b7015b4e0 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6dd9b700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b70143fa0 0x7f2b701332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:31.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b6ed9d700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7015b4e0 0x7f2b70136460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2b70066dc0 tx=0x7f2b68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b66ffd700 1 -- 172.21.15.157:0/3463154294 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68004300 con 0x7f2b7015b4e0 2024-04-18T03:41:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b66ffd700 1 -- 172.21.15.157:0/3463154294 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6801f070 con 0x7f2b7015b4e0 2024-04-18T03:41:31.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b701f6830 con 0x7f2b7015b4e0 2024-04-18T03:41:31.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b66ffd700 1 -- 172.21.15.157:0/3463154294 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b680036c0 con 0x7f2b7015b4e0 2024-04-18T03:41:31.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.962+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b70135c60 con 0x7f2b7015b4e0 2024-04-18T03:41:31.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.966+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b70136180 con 0x7f2b7015b4e0 2024-04-18T03:41:31.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.966+0000 7f2b66ffd700 1 -- 172.21.15.157:0/3463154294 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b68021030 con 0x7f2b7015b4e0 2024-04-18T03:41:31.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.966+0000 7f2b66ffd700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2b50066760 0x7f2b50068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:31.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.966+0000 7f2b66ffd700 1 -- 172.21.15.157:0/3463154294 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b68085670 con 0x7f2b7015b4e0 2024-04-18T03:41:31.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.966+0000 7f2b6e59c700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2b50066760 0x7f2b50068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:31.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.970+0000 7f2b6e59c700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2b50066760 0x7f2b50068c20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b58000f60 tx=0x7f2b58007f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:31.974+0000 7f2b66ffd700 1 -- 172.21.15.157:0/3463154294 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2b70136180 con 0x7f2b7015b4e0 2024-04-18T03:41:32.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.138+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b700ce970 con 0x7f2b50066760 2024-04-18T03:41:32.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b66ffd700 1 -- 172.21.15.157:0/3463154294 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2b58004b30 con 0x7f2b50066760 2024-04-18T03:41:32.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2b50066760 msgr2=0x7f2b50068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2b50066760 0x7f2b50068c20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b58000f60 tx=0x7f2b58007f30 comp rx=0 tx=0).stop 2024-04-18T03:41:32.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7015b4e0 msgr2=0x7f2b70136460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7015b4e0 0x7f2b70136460 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2b70066dc0 tx=0x7f2b68004770 comp rx=0 tx=0).stop 2024-04-18T03:41:32.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 shutdown_connections 2024-04-18T03:41:32.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2b50066760 0x7f2b50068c20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b7015b4e0 0x7f2b70136460 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b70143fa0 0x7f2b701332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 --2- 172.21.15.157:0/3463154294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b700715c0 0x7f2b701f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 >> 172.21.15.157:0/3463154294 conn(0x7f2b7006e190 msgr2=0x7f2b700aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:32.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 shutdown_connections 2024-04-18T03:41:32.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.142+0000 7f2b74cbe700 1 -- 172.21.15.157:0/3463154294 wait complete. 2024-04-18T03:41:32.149 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 0 to deep-scrub 2024-04-18T03:41:32.162 INFO:tasks.ceph:Scrubbing osd.1 2024-04-18T03:41:32.163 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-18T03:41:32.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f5544873700 1 Processor -- start 2024-04-18T03:41:32.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f5544873700 1 -- start start 2024-04-18T03:41:32.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f5544873700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f554015bcf0 0x7f554006a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f5544873700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f554006b900 0x7f5540070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f5544873700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554006be20 con 0x7f554006a9f0 2024-04-18T03:41:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f5544873700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554006aea0 con 0x7f554006b900 2024-04-18T03:41:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f5544873700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5540161bf0 con 0x7f554015bcf0 2024-04-18T03:41:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f553ed9d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f554006b900 0x7f5540070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f553e59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f554015bcf0 0x7f554006a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f553dd9b700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f554006a9f0 0x7f554006b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:58300/0 (socket says 172.21.15.157:58300) 2024-04-18T03:41:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f553dd9b700 1 -- 172.21.15.157:0/1771964368 learned_addr learned my addr 172.21.15.157:0/1771964368 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f553e59c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f554015bcf0 0x7f554006a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:57774/0 (socket says 172.21.15.157:57774) 2024-04-18T03:41:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.274+0000 7f553ed9d700 1 --2- 172.21.15.157:0/1771964368 >> v2:172.21.15.157:3300/0 conn(0x7f554006b900 0x7f5540070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57730/0 (socket says 172.21.15.157:57730) 2024-04-18T03:41:32.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553ed9d700 1 -- 172.21.15.157:0/1771964368 >> v2:172.21.15.175:3300/0 conn(0x7f554015bcf0 msgr2=0x7f554006a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:32.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553ed9d700 1 --2- 172.21.15.157:0/1771964368 >> v2:172.21.15.175:3300/0 conn(0x7f554015bcf0 0x7f554006a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553ed9d700 1 -- 172.21.15.157:0/1771964368 >> v1:172.21.15.175:6789/0 conn(0x7f554006a9f0 legacy=0x7f554006b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553d59a700 1 -- 172.21.15.157:0/1771964368 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127230525 0 0) 0x7f5530001490 con 0x7f554006a9f0 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553ed9d700 1 -- 172.21.15.157:0/1771964368 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554015c0d0 con 0x7f554006b900 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553ed9d700 1 --2- 172.21.15.157:0/1771964368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006b900 0x7f5540070070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5540071b80 tx=0x7f5538009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a927f0fa55e4789 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553d59a700 1 -- 172.21.15.157:0/1771964368 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538011830 con 0x7f554006b900 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553d59a700 1 -- 172.21.15.157:0/1771964368 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538011990 con 0x7f554006b900 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f553d59a700 1 -- 172.21.15.157:0/1771964368 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538011d20 con 0x7f554006b900 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f5544873700 1 -- 172.21.15.157:0/1771964368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006b900 msgr2=0x7f5540070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f5544873700 1 --2- 172.21.15.157:0/1771964368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006b900 0x7f5540070070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5540071b80 tx=0x7f5538009b30 comp rx=0 tx=0).stop 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f5544873700 1 -- 172.21.15.157:0/1771964368 shutdown_connections 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f5544873700 1 --2- 172.21.15.157:0/1771964368 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006b900 0x7f5540070070 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f5544873700 1 --2- 172.21.15.157:0/1771964368 >> v2:172.21.15.175:3300/0 conn(0x7f554015bcf0 0x7f554006a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f5544873700 1 -- 172.21.15.157:0/1771964368 >> 172.21.15.157:0/1771964368 conn(0x7f55400b1040 msgr2=0x7f55400cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f5544873700 1 -- 172.21.15.157:0/1771964368 shutdown_connections 2024-04-18T03:41:32.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.278+0000 7f5544873700 1 -- 172.21.15.157:0/1771964368 wait complete. 2024-04-18T03:41:32.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f5544873700 1 Processor -- start 2024-04-18T03:41:32.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f5544873700 1 -- start start 2024-04-18T03:41:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f5544873700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006a9f0 0x7f554015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f5544873700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554006b900 0x7f55401453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f5544873700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554015bcf0 0x7f5540145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f5544873700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554015b130 con 0x7f554006a9f0 2024-04-18T03:41:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f5544873700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5540146150 con 0x7f554015bcf0 2024-04-18T03:41:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f5544873700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5540146430 con 0x7f554006b900 2024-04-18T03:41:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006a9f0 0x7f554015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553e59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006a9f0 0x7f554015f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57740/0 (socket says 172.21.15.157:57740) 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553e59c700 1 -- 172.21.15.157:0/3628276246 learned_addr learned my addr 172.21.15.157:0/3628276246 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553dd9b700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554006b900 0x7f55401453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553ed9d700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554015bcf0 0x7f5540145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553e59c700 1 -- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554006b900 msgr2=0x7f55401453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553e59c700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554006b900 0x7f55401453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553e59c700 1 -- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554015bcf0 msgr2=0x7f5540145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553e59c700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554015bcf0 0x7f5540145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.282+0000 7f553e59c700 1 -- 172.21.15.157:0/3628276246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55380094b0 con 0x7f554006a9f0 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f553e59c700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006a9f0 0x7f554015f1e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f552800e840 tx=0x7f552800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280095a0 con 0x7f554006a9f0 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528013680 con 0x7f554006a9f0 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5540146710 con 0x7f554006a9f0 2024-04-18T03:41:32.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280139f0 con 0x7f554006a9f0 2024-04-18T03:41:32.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554015f720 con 0x7f554006a9f0 2024-04-18T03:41:32.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5540161e00 con 0x7f554006a9f0 2024-04-18T03:41:32.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5528013b50 con 0x7f554006a9f0 2024-04-18T03:41:32.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5520066730 0x7f5520068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f55280843e0 con 0x7f554006a9f0 2024-04-18T03:41:32.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f553dd9b700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5520066730 0x7f5520068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f5520070010 0x7f55200724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 --> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5520072b80 con 0x7f5520070010 2024-04-18T03:41:32.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55280869c0 con 0x7f554006a9f0 2024-04-18T03:41:32.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.286+0000 7f553ed9d700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f5520070010 0x7f55200724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.290+0000 7f553dd9b700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5520066730 0x7f5520068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55400b3170 tx=0x7f5530001b40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.290+0000 7f553ed9d700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f5520070010 0x7f55200724b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.290+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 <== osd.1 v2:172.21.15.157:6808/26043 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f5520072b80 con 0x7f5520070010 2024-04-18T03:41:32.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 --> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5540162bc0 con 0x7f5520070010 2024-04-18T03:41:32.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5536ffd700 1 -- 172.21.15.157:0/3628276246 <== osd.1 v2:172.21.15.157:6808/26043 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5538022040 con 0x7f5520070010 2024-04-18T03:41:32.312 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:41:32.312 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T03:41:32.312 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:41:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f5520070010 msgr2=0x7f55200724b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.157:6808/26043,v1:172.21.15.157:6809/26043] conn(0x7f5520070010 0x7f55200724b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5520066730 msgr2=0x7f5520068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f5520066730 0x7f5520068bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55400b3170 tx=0x7f5530001b40 comp rx=0 tx=0).stop 2024-04-18T03:41:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006a9f0 msgr2=0x7f554015f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 --2- 172.21.15.157:0/3628276246 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f554006a9f0 0x7f554015f1e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f552800e840 tx=0x7f552800eb50 comp rx=0 tx=0).stop 2024-04-18T03:41:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f553ed9d700 1 -- 172.21.15.157:0/3628276246 reap_dead start 2024-04-18T03:41:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 shutdown_connections 2024-04-18T03:41:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 >> 172.21.15.157:0/3628276246 conn(0x7f55400b1040 msgr2=0x7f55400b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 shutdown_connections 2024-04-18T03:41:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.306+0000 7f5544873700 1 -- 172.21.15.157:0/3628276246 wait complete. 2024-04-18T03:41:32.325 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-18T03:41:32.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985df10700 1 Processor -- start 2024-04-18T03:41:32.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985df10700 1 -- start start 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985df10700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9858071080 0x7f9858071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985df10700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 0x7f985806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985df10700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580719a0 con 0x7f98580b5f90 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985df10700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985806a770 con 0x7f9858071080 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985df10700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985806aa50 con 0x7f9858161660 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985d70f700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f98580b5f90 0x7f98580b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59616/0 (socket says 172.21.15.157:59616) 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985d70f700 1 -- 172.21.15.157:0/283624815 learned_addr learned my addr 172.21.15.157:0/283624815 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f985cf0e700 1 --2- 172.21.15.157:0/283624815 >> v2:172.21.15.175:3300/0 conn(0x7f9858071080 0x7f9858071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f9857fff700 1 --2- 172.21.15.157:0/283624815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 0x7f985806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.434+0000 7f98577fe700 1 -- 172.21.15.157:0/283624815 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881160061 0 0) 0x7f98580719a0 con 0x7f98580b5f90 2024-04-18T03:41:32.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f98577fe700 1 -- 172.21.15.157:0/283624815 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98400035d0 con 0x7f98580b5f90 2024-04-18T03:41:32.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985cf0e700 1 -- 172.21.15.157:0/283624815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 msgr2=0x7f985806c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:32.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985cf0e700 1 --2- 172.21.15.157:0/283624815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 0x7f985806c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985cf0e700 1 -- 172.21.15.157:0/283624815 >> v1:172.21.15.157:6789/0 conn(0x7f98580b5f90 legacy=0x7f98580b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985cf0e700 1 -- 172.21.15.157:0/283624815 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985806ad30 con 0x7f9858071080 2024-04-18T03:41:32.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985cf0e700 1 --2- 172.21.15.157:0/283624815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 0x7f9858071460 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9848009850 tx=0x7f9848009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58e7137bf1c577a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f98577fe700 1 -- 172.21.15.157:0/283624815 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848011830 con 0x7f9858071080 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f98577fe700 1 -- 172.21.15.157:0/283624815 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9848011990 con 0x7f9858071080 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f98577fe700 1 -- 172.21.15.157:0/283624815 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848011d00 con 0x7f9858071080 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985df10700 1 -- 172.21.15.157:0/283624815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 msgr2=0x7f9858071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985df10700 1 --2- 172.21.15.157:0/283624815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 0x7f9858071460 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9848009850 tx=0x7f9848009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985df10700 1 -- 172.21.15.157:0/283624815 shutdown_connections 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985df10700 1 --2- 172.21.15.157:0/283624815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 0x7f985806c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985df10700 1 --2- 172.21.15.157:0/283624815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 0x7f9858071460 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985df10700 1 -- 172.21.15.157:0/283624815 >> 172.21.15.157:0/283624815 conn(0x7f985806e020 msgr2=0x7f985806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985df10700 1 -- 172.21.15.157:0/283624815 shutdown_connections 2024-04-18T03:41:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.438+0000 7f985df10700 1 -- 172.21.15.157:0/283624815 wait complete. 2024-04-18T03:41:32.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 Processor -- start 2024-04-18T03:41:32.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 -- start start 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 0x7f9858155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98580b5f90 0x7f98581e6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 0x7f98580b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98581e71b0 con 0x7f98580b5f90 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98581e7490 con 0x7f9858071080 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98581e7770 con 0x7f9858161660 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f9857fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98580b5f90 0x7f98581e6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f9857fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98580b5f90 0x7f98581e6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57744/0 (socket says 172.21.15.157:57744) 2024-04-18T03:41:32.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f9857fff700 1 -- 172.21.15.157:0/1927822930 learned_addr learned my addr 172.21.15.157:0/1927822930 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985cf0e700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 0x7f9858155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985d70f700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 0x7f98580b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985cf0e700 1 -- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 msgr2=0x7f98580b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985cf0e700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 0x7f98580b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985cf0e700 1 -- 172.21.15.157:0/1927822930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98580b5f90 msgr2=0x7f98581e6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985cf0e700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98580b5f90 0x7f98581e6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985cf0e700 1 -- 172.21.15.157:0/1927822930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480094b0 con 0x7f9858071080 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985cf0e700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 0x7f9858155ed0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9848016000 tx=0x7f9848004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f98557fa700 1 -- 172.21.15.157:0/1927822930 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98480044d0 con 0x7f9858071080 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f98557fa700 1 -- 172.21.15.157:0/1927822930 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984801e070 con 0x7f9858071080 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f98557fa700 1 -- 172.21.15.157:0/1927822930 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848003900 con 0x7f9858071080 2024-04-18T03:41:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98581e7a50 con 0x7f9858071080 2024-04-18T03:41:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.442+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9858156410 con 0x7f9858071080 2024-04-18T03:41:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.446+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98581e7f70 con 0x7f9858071080 2024-04-18T03:41:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.446+0000 7f98557fa700 1 -- 172.21.15.157:0/1927822930 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9848003a60 con 0x7f9858071080 2024-04-18T03:41:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.446+0000 7f98557fa700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9844066730 0x7f9844068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.446+0000 7f98557fa700 1 -- 172.21.15.157:0/1927822930 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9848085700 con 0x7f9858071080 2024-04-18T03:41:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.446+0000 7f9857fff700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9844066730 0x7f9844068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.446+0000 7f9857fff700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9844066730 0x7f9844068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f985815c080 tx=0x7f984c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.454+0000 7f98557fa700 1 -- 172.21.15.157:0/1927822930 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f9848052740 con 0x7f9858071080 2024-04-18T03:41:32.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.630+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f985806c8e0 con 0x7f9844066730 2024-04-18T03:41:32.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.630+0000 7f98557fa700 1 -- 172.21.15.157:0/1927822930 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f984c011830 con 0x7f9844066730 2024-04-18T03:41:32.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9844066730 msgr2=0x7f9844068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9844066730 0x7f9844068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f985815c080 tx=0x7f984c009240 comp rx=0 tx=0).stop 2024-04-18T03:41:32.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 msgr2=0x7f9858155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 0x7f9858155ed0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9848016000 tx=0x7f9848004770 comp rx=0 tx=0).stop 2024-04-18T03:41:32.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 shutdown_connections 2024-04-18T03:41:32.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9844066730 0x7f9844068bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9858161660 0x7f98580b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98580b5f90 0x7f98581e6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 --2- 172.21.15.157:0/1927822930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9858071080 0x7f9858155ed0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 >> 172.21.15.157:0/1927822930 conn(0x7f985806e020 msgr2=0x7f98580b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:32.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 shutdown_connections 2024-04-18T03:41:32.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.634+0000 7f985df10700 1 -- 172.21.15.157:0/1927822930 wait complete. 2024-04-18T03:41:32.641 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 1 to deep-scrub 2024-04-18T03:41:32.655 INFO:tasks.ceph:Scrubbing osd.2 2024-04-18T03:41:32.656 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-18T03:41:32.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.774+0000 7f3eebfff700 1 Processor -- start 2024-04-18T03:41:32.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.774+0000 7f3eebfff700 1 -- start start 2024-04-18T03:41:32.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3eec146a90 0x7f3eec06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec15e3d0 0x7f3eec0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0b67c0 con 0x7f3eec071080 2024-04-18T03:41:32.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0b6aa0 con 0x7f3eec146a90 2024-04-18T03:41:32.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0b6d80 con 0x7f3eec15e3d0 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eeb7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f3eec071080 0x7f3eec0d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59624/0 (socket says 172.21.15.157:59624) 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eeaffd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3eec146a90 0x7f3eec06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eeb7fe700 1 -- 172.21.15.157:0/3520589099 learned_addr learned my addr 172.21.15.157:0/3520589099 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eea7fc700 1 --2- 172.21.15.157:0/3520589099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec15e3d0 0x7f3eec0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3ee9ffb700 1 -- 172.21.15.157:0/3520589099 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943406915 0 0) 0x7f3eec0b67c0 con 0x7f3eec071080 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3ee9ffb700 1 -- 172.21.15.157:0/3520589099 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed40035d0 con 0x7f3eec071080 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eeaffd700 1 -- 172.21.15.157:0/3520589099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec15e3d0 msgr2=0x7f3eec0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eeaffd700 1 --2- 172.21.15.157:0/3520589099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec15e3d0 0x7f3eec0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eeaffd700 1 -- 172.21.15.157:0/3520589099 >> v1:172.21.15.157:6789/0 conn(0x7f3eec071080 legacy=0x7f3eec0d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eeaffd700 1 -- 172.21.15.157:0/3520589099 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0d1850 con 0x7f3eec146a90 2024-04-18T03:41:32.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eeaffd700 1 --2- 172.21.15.157:0/3520589099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 0x7f3eec06a770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009850 tx=0x7f3ee0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb7b451ec60da5c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3ee9ffb700 1 -- 172.21.15.157:0/3520589099 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011830 con 0x7f3eec146a90 2024-04-18T03:41:32.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3ee9ffb700 1 -- 172.21.15.157:0/3520589099 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0011990 con 0x7f3eec146a90 2024-04-18T03:41:32.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3ee9ffb700 1 -- 172.21.15.157:0/3520589099 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011d40 con 0x7f3eec146a90 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 -- 172.21.15.157:0/3520589099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 msgr2=0x7f3eec06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 --2- 172.21.15.157:0/3520589099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 0x7f3eec06a770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009850 tx=0x7f3ee0009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 -- 172.21.15.157:0/3520589099 shutdown_connections 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 --2- 172.21.15.157:0/3520589099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec15e3d0 0x7f3eec0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 --2- 172.21.15.157:0/3520589099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 0x7f3eec06a770 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 -- 172.21.15.157:0/3520589099 >> 172.21.15.157:0/3520589099 conn(0x7f3eec06e200 msgr2=0x7f3eec06e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 -- 172.21.15.157:0/3520589099 shutdown_connections 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.778+0000 7f3eebfff700 1 -- 172.21.15.157:0/3520589099 wait complete. 2024-04-18T03:41:32.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 Processor -- start 2024-04-18T03:41:32.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 -- start start 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec071080 0x7f3eec13c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 0x7f3eec06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eec15e3d0 0x7f3eec06b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec15cb70 con 0x7f3eec146a90 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec15bcf0 con 0x7f3eec15e3d0 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec15bef0 con 0x7f3eec071080 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 0x7f3eec06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 0x7f3eec06b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57758/0 (socket says 172.21.15.157:57758) 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 -- 172.21.15.157:0/380060540 learned_addr learned my addr 172.21.15.157:0/380060540 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eeaffd700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec071080 0x7f3eec13c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eeb7fe700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eec15e3d0 0x7f3eec06b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 -- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec071080 msgr2=0x7f3eec13c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eec071080 0x7f3eec13c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 -- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eec15e3d0 msgr2=0x7f3eec06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eec15e3d0 0x7f3eec06b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 -- 172.21.15.157:0/380060540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee00094b0 con 0x7f3eec146a90 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eea7fc700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 0x7f3eec06b2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009fd0 tx=0x7f3edc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0095a0 con 0x7f3eec146a90 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc013680 con 0x7f3eec146a90 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.782+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec15c1d0 con 0x7f3eec146a90 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc013a30 con 0x7f3eec146a90 2024-04-18T03:41:32.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec15c790 con 0x7f3eec146a90 2024-04-18T03:41:32.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3eec0d1540 con 0x7f3eec146a90 2024-04-18T03:41:32.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3edc013b90 con 0x7f3eec146a90 2024-04-18T03:41:32.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3ed37fe700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3ed8066730 0x7f3ed8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3edc084b80 con 0x7f3eec146a90 2024-04-18T03:41:32.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3ed37fe700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f3ed8070010 0x7f3ed80724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3eeaffd700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3ed8066730 0x7f3ed8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 --> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ed8072b80 con 0x7f3ed8070010 2024-04-18T03:41:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3edc084ef0 con 0x7f3eec146a90 2024-04-18T03:41:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.786+0000 7f3eeb7fe700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f3ed8070010 0x7f3ed80724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.790+0000 7f3eeb7fe700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f3ed8070010 0x7f3ed80724b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.790+0000 7f3eeaffd700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3ed8066730 0x7f3ed8068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ee00090b0 tx=0x7f3ee0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.790+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 <== osd.2 v2:172.21.15.157:6800/26044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f3ed8072b80 con 0x7f3ed8070010 2024-04-18T03:41:32.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.806+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 --> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3eec04e650 con 0x7f3ed8070010 2024-04-18T03:41:32.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3ed37fe700 1 -- 172.21.15.157:0/380060540 <== osd.2 v2:172.21.15.157:6800/26044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3eec04e650 con 0x7f3ed8070010 2024-04-18T03:41:32.813 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:41:32.813 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T03:41:32.814 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:41:32.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f3ed8070010 msgr2=0x7f3ed80724b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.157:6800/26044,v1:172.21.15.157:6801/26044] conn(0x7f3ed8070010 0x7f3ed80724b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3ed8066730 msgr2=0x7f3ed8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f3ed8066730 0x7f3ed8068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ee00090b0 tx=0x7f3ee0008030 comp rx=0 tx=0).stop 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 msgr2=0x7f3eec06b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 --2- 172.21.15.157:0/380060540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3eec146a90 0x7f3eec06b2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009fd0 tx=0x7f3edc00eb20 comp rx=0 tx=0).stop 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eeb7fe700 1 -- 172.21.15.157:0/380060540 reap_dead start 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 shutdown_connections 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 >> 172.21.15.157:0/380060540 conn(0x7f3eec06e200 msgr2=0x7f3eec0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 shutdown_connections 2024-04-18T03:41:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.810+0000 7f3eebfff700 1 -- 172.21.15.157:0/380060540 wait complete. 2024-04-18T03:41:32.827 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-18T03:41:32.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.938+0000 7f46cf59e700 1 Processor -- start 2024-04-18T03:41:32.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.938+0000 7f46cf59e700 1 -- start start 2024-04-18T03:41:32.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f46d0071080 0x7f46d0071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 0x7f46d006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d00719a0 con 0x7f46d00b5f90 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d006a770 con 0x7f46d0071080 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d006aa50 con 0x7f46d0161660 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ce59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f46d0071080 0x7f46d0071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ce59c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f46d0071080 0x7f46d0071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57764/0 (socket says 172.21.15.157:57764) 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46c5d9b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 0x7f46d006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ced9d700 1 --1- 172.21.15.157:0/3468908036 >> v1:172.21.15.175:6789/0 conn(0x7f46d00b5f90 0x7f46d00b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:58310/0 (socket says 172.21.15.157:58310) 2024-04-18T03:41:32.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ce59c700 1 -- 172.21.15.157:0/3468908036 learned_addr learned my addr 172.21.15.157:0/3468908036 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:32.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cdd9b700 1 -- 172.21.15.157:0/3468908036 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719011943 0 0) 0x7f46d00719a0 con 0x7f46d00b5f90 2024-04-18T03:41:32.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ce59c700 1 -- 172.21.15.157:0/3468908036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 msgr2=0x7f46d006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:32.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ce59c700 1 --2- 172.21.15.157:0/3468908036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 0x7f46d006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ce59c700 1 -- 172.21.15.157:0/3468908036 >> v1:172.21.15.175:6789/0 conn(0x7f46d00b5f90 legacy=0x7f46d00b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ce59c700 1 -- 172.21.15.157:0/3468908036 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d006ad30 con 0x7f46d0071080 2024-04-18T03:41:32.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46ce59c700 1 --2- 172.21.15.157:0/3468908036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d0071080 0x7f46d0071460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009910 tx=0x7f46c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f1f7ba31b822ce server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cdd9b700 1 -- 172.21.15.157:0/3468908036 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0011830 con 0x7f46d0071080 2024-04-18T03:41:32.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cdd9b700 1 -- 172.21.15.157:0/3468908036 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c0011990 con 0x7f46d0071080 2024-04-18T03:41:32.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cdd9b700 1 -- 172.21.15.157:0/3468908036 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0011d40 con 0x7f46d0071080 2024-04-18T03:41:32.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 -- 172.21.15.157:0/3468908036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d0071080 msgr2=0x7f46d0071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3468908036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d0071080 0x7f46d0071460 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009910 tx=0x7f46c0009c20 comp rx=0 tx=0).stop 2024-04-18T03:41:32.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 -- 172.21.15.157:0/3468908036 shutdown_connections 2024-04-18T03:41:32.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3468908036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 0x7f46d006c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3468908036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d0071080 0x7f46d0071460 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 -- 172.21.15.157:0/3468908036 >> 172.21.15.157:0/3468908036 conn(0x7f46d006e020 msgr2=0x7f46d006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:32.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 -- 172.21.15.157:0/3468908036 shutdown_connections 2024-04-18T03:41:32.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.942+0000 7f46cf59e700 1 -- 172.21.15.157:0/3468908036 wait complete. 2024-04-18T03:41:32.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 Processor -- start 2024-04-18T03:41:32.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 -- start start 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d0071080 0x7f46d014f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d00b5f90 0x7f46d01f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 0x7f46d0152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d0152140 con 0x7f46d00b5f90 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d015a910 con 0x7f46d0071080 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00b4380 con 0x7f46d0161660 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d00b5f90 0x7f46d01f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d00b5f90 0x7f46d01f3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57776/0 (socket says 172.21.15.157:57776) 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 -- 172.21.15.157:0/3592929100 learned_addr learned my addr 172.21.15.157:0/3592929100 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:32.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46ce59c700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d0071080 0x7f46d014f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46ced9d700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 0x7f46d0152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 -- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 msgr2=0x7f46d0152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 0x7f46d0152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 -- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d0071080 msgr2=0x7f46d014f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d0071080 0x7f46d014f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 -- 172.21.15.157:0/3592929100 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c0009570 con 0x7f46d00b5f90 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c5d9b700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d00b5f90 0x7f46d01f3ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f46b800e870 tx=0x7f46b800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c77fe700 1 -- 172.21.15.157:0/3592929100 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b80095a0 con 0x7f46d00b5f90 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c77fe700 1 -- 172.21.15.157:0/3592929100 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b800ee70 con 0x7f46d00b5f90 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d015ab80 con 0x7f46d00b5f90 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46c77fe700 1 -- 172.21.15.157:0/3592929100 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800ca50 con 0x7f46d00b5f90 2024-04-18T03:41:32.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.946+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d00b4660 con 0x7f46d00b5f90 2024-04-18T03:41:32.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.950+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d00b5db0 con 0x7f46d00b5f90 2024-04-18T03:41:32.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.950+0000 7f46c77fe700 1 -- 172.21.15.157:0/3592929100 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f46b800cbb0 con 0x7f46d00b5f90 2024-04-18T03:41:32.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.950+0000 7f46c77fe700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46b4066730 0x7f46b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:32.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.950+0000 7f46c77fe700 1 -- 172.21.15.157:0/3592929100 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46b8084420 con 0x7f46d00b5f90 2024-04-18T03:41:32.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.950+0000 7f46ce59c700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46b4066730 0x7f46b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:32.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.950+0000 7f46ce59c700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46b4066730 0x7f46b4068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f46c0014040 tx=0x7f46c0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:32.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:32.958+0000 7f46c77fe700 1 -- 172.21.15.157:0/3592929100 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f46b8051460 con 0x7f46d00b5f90 2024-04-18T03:41:33.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.134+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f46d006c8e0 con 0x7f46b4066730 2024-04-18T03:41:33.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.134+0000 7f46c77fe700 1 -- 172.21.15.157:0/3592929100 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46c0011b80 con 0x7f46b4066730 2024-04-18T03:41:33.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46b4066730 msgr2=0x7f46b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46b4066730 0x7f46b4068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f46c0014040 tx=0x7f46c0008030 comp rx=0 tx=0).stop 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d00b5f90 msgr2=0x7f46d01f3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d00b5f90 0x7f46d01f3ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f46b800e870 tx=0x7f46b800ec30 comp rx=0 tx=0).stop 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 shutdown_connections 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f46b4066730 0x7f46b4068bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46d0161660 0x7f46d0152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46d00b5f90 0x7f46d01f3ca0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 --2- 172.21.15.157:0/3592929100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46d0071080 0x7f46d014f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 >> 172.21.15.157:0/3592929100 conn(0x7f46d006e020 msgr2=0x7f46d01581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 shutdown_connections 2024-04-18T03:41:33.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.138+0000 7f46cf59e700 1 -- 172.21.15.157:0/3592929100 wait complete. 2024-04-18T03:41:33.143 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 2 to deep-scrub 2024-04-18T03:41:33.155 INFO:tasks.ceph:Scrubbing osd.3 2024-04-18T03:41:33.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-18T03:41:33.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.270+0000 7fb3e0965700 1 Processor -- start 2024-04-18T03:41:33.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.270+0000 7fb3e0965700 1 -- start start 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3dc146970 0x7fb3dc0b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb3dc161200 0x7fb3dc06e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc146d50 con 0x7fb3dc0b6fa0 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b80a0 con 0x7fb3dc161200 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b7490 con 0x7fb3dc146970 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3db59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb3dc161200 0x7fb3dc06e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3da59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb3dc0b6fa0 0x7fb3dc160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59640/0 (socket says 172.21.15.157:59640) 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3da59c700 1 -- 172.21.15.157:0/3271955946 learned_addr learned my addr 172.21.15.157:0/3271955946 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3dad9d700 1 --2- 172.21.15.157:0/3271955946 >> v2:172.21.15.175:3300/0 conn(0x7fb3dc146970 0x7fb3dc0b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3d9d9b700 1 -- 172.21.15.157:0/3271955946 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960442777 0 0) 0x7fb3dc146d50 con 0x7fb3dc0b6fa0 2024-04-18T03:41:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3db59e700 1 -- 172.21.15.157:0/3271955946 >> v2:172.21.15.175:3300/0 conn(0x7fb3dc146970 msgr2=0x7fb3dc0b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3db59e700 1 --2- 172.21.15.157:0/3271955946 >> v2:172.21.15.175:3300/0 conn(0x7fb3dc146970 0x7fb3dc0b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3db59e700 1 -- 172.21.15.157:0/3271955946 >> v1:172.21.15.157:6789/0 conn(0x7fb3dc0b6fa0 legacy=0x7fb3dc160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3db59e700 1 -- 172.21.15.157:0/3271955946 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0b7770 con 0x7fb3dc161200 2024-04-18T03:41:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3db59e700 1 --2- 172.21.15.157:0/3271955946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 0x7fb3dc06e3a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc066cf0 tx=0x7fb3d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f173564bd082dae server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3d9d9b700 1 -- 172.21.15.157:0/3271955946 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d400e070 con 0x7fb3dc161200 2024-04-18T03:41:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3d9d9b700 1 -- 172.21.15.157:0/3271955946 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d400bb20 con 0x7fb3dc161200 2024-04-18T03:41:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3d9d9b700 1 -- 172.21.15.157:0/3271955946 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4012430 con 0x7fb3dc161200 2024-04-18T03:41:33.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 -- 172.21.15.157:0/3271955946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 msgr2=0x7fb3dc06e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 --2- 172.21.15.157:0/3271955946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 0x7fb3dc06e3a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc066cf0 tx=0x7fb3d400b330 comp rx=0 tx=0).stop 2024-04-18T03:41:33.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 -- 172.21.15.157:0/3271955946 shutdown_connections 2024-04-18T03:41:33.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 --2- 172.21.15.157:0/3271955946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 0x7fb3dc06e3a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 --2- 172.21.15.157:0/3271955946 >> v2:172.21.15.175:3300/0 conn(0x7fb3dc146970 0x7fb3dc0b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 -- 172.21.15.157:0/3271955946 >> 172.21.15.157:0/3271955946 conn(0x7fb3dc070070 msgr2=0x7fb3dc070480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:33.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 -- 172.21.15.157:0/3271955946 shutdown_connections 2024-04-18T03:41:33.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.274+0000 7fb3e0965700 1 -- 172.21.15.157:0/3271955946 wait complete. 2024-04-18T03:41:33.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 Processor -- start 2024-04-18T03:41:33.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 -- start start 2024-04-18T03:41:33.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3dc0b6fa0 0x7fb3dc15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3dc146970 0x7fb3dc15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 0x7fb3dc1f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15daa0 con 0x7fb3dc161200 2024-04-18T03:41:33.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc143d30 con 0x7fb3dc146970 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc144010 con 0x7fb3dc0b6fa0 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 0x7fb3dc1f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 0x7fb3dc1f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57794/0 (socket says 172.21.15.157:57794) 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 -- 172.21.15.157:0/1065253869 learned_addr learned my addr 172.21.15.157:0/1065253869 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3dad9d700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3dc0b6fa0 0x7fb3dc15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3da59c700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3dc146970 0x7fb3dc15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 -- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3dc0b6fa0 msgr2=0x7fb3dc15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3dc0b6fa0 0x7fb3dc15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 -- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3dc146970 msgr2=0x7fb3dc15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3dc146970 0x7fb3dc15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 -- 172.21.15.157:0/1065253869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009a70 con 0x7fb3dc161200 2024-04-18T03:41:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3db59e700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 0x7fb3dc1f3260 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4013000 tx=0x7fb3d4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4012430 con 0x7fb3dc161200 2024-04-18T03:41:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4020070 con 0x7fb3dc161200 2024-04-18T03:41:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4004280 con 0x7fb3dc161200 2024-04-18T03:41:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc1442f0 con 0x7fb3dc161200 2024-04-18T03:41:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.278+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc15ece0 con 0x7fb3dc161200 2024-04-18T03:41:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3dc0b7d30 con 0x7fb3dc161200 2024-04-18T03:41:33.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb3d40043e0 con 0x7fb3dc161200 2024-04-18T03:41:33.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3c37fe700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3c8066760 0x7fb3c8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb3d4022070 con 0x7fb3dc161200 2024-04-18T03:41:33.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3c37fe700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7fb3c8070040 0x7fb3c80724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 --> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3c8072bb0 con 0x7fb3c8070040 2024-04-18T03:41:33.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3dad9d700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3c8066760 0x7fb3c8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3d4086aa0 con 0x7fb3dc161200 2024-04-18T03:41:33.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.282+0000 7fb3da59c700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7fb3c8070040 0x7fb3c80724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.286+0000 7fb3dad9d700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3c8066760 0x7fb3c8068c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009b80 tx=0x7fb3d0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.286+0000 7fb3da59c700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7fb3c8070040 0x7fb3c80724e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.286+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 <== osd.3 v2:172.21.15.157:6816/26045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fb3c8072bb0 con 0x7fb3c8070040 2024-04-18T03:41:33.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 --> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb3dc144810 con 0x7fb3c8070040 2024-04-18T03:41:33.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3c37fe700 1 -- 172.21.15.157:0/1065253869 <== osd.3 v2:172.21.15.157:6816/26045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb3dc144810 con 0x7fb3c8070040 2024-04-18T03:41:33.308 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:41:33.308 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T03:41:33.308 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:41:33.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7fb3c8070040 msgr2=0x7fb3c80724e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.157:6816/26045,v1:172.21.15.157:6817/26045] conn(0x7fb3c8070040 0x7fb3c80724e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3c8066760 msgr2=0x7fb3c8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb3c8066760 0x7fb3c8068c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009b80 tx=0x7fb3d0008040 comp rx=0 tx=0).stop 2024-04-18T03:41:33.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 msgr2=0x7fb3dc1f3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 --2- 172.21.15.157:0/1065253869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3dc161200 0x7fb3dc1f3260 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4013000 tx=0x7fb3d4004af0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3db59e700 1 -- 172.21.15.157:0/1065253869 reap_dead start 2024-04-18T03:41:33.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 shutdown_connections 2024-04-18T03:41:33.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 >> 172.21.15.157:0/1065253869 conn(0x7fb3dc070070 msgr2=0x7fb3dc0b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:33.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 shutdown_connections 2024-04-18T03:41:33.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.302+0000 7fb3e0965700 1 -- 172.21.15.157:0/1065253869 wait complete. 2024-04-18T03:41:33.321 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-18T03:41:33.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6f59e700 1 Processor -- start 2024-04-18T03:41:33.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6f59e700 1 -- start start 2024-04-18T03:41:33.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6f59e700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faf70161660 0x7faf7006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6f59e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7006a770 con 0x7faf70071080 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6f59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7006aa50 con 0x7faf700d12b0 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6f59e700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7006ad30 con 0x7faf70161660 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6e59c700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7faf70071080 0x7faf70071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59648/0 (socket says 172.21.15.157:59648) 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6e59c700 1 -- 172.21.15.157:0/1021301197 learned_addr learned my addr 172.21.15.157:0/1021301197 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6dd9b700 1 --2- 172.21.15.157:0/1021301197 >> v2:172.21.15.157:3300/0 conn(0x7faf70161660 0x7faf7006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6d59a700 1 -- 172.21.15.157:0/1021301197 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240866780 0 0) 0x7faf7006a770 con 0x7faf70071080 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6d59a700 1 -- 172.21.15.157:0/1021301197 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf500035d0 con 0x7faf70071080 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6dd9b700 1 -- 172.21.15.157:0/1021301197 >> v1:172.21.15.175:6789/0 conn(0x7faf700d12b0 legacy=0x7faf700d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6dd9b700 1 -- 172.21.15.157:0/1021301197 >> v1:172.21.15.157:6789/0 conn(0x7faf70071080 legacy=0x7faf70071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6dd9b700 1 -- 172.21.15.157:0/1021301197 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7006b010 con 0x7faf70161660 2024-04-18T03:41:33.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6dd9b700 1 --2- 172.21.15.157:0/1021301197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf70161660 0x7faf7006c3a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faf58009850 tx=0x7faf58009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e38ca1e6bde1db server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6d59a700 1 -- 172.21.15.157:0/1021301197 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58011830 con 0x7faf70161660 2024-04-18T03:41:33.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6d59a700 1 -- 172.21.15.157:0/1021301197 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58011990 con 0x7faf70161660 2024-04-18T03:41:33.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.434+0000 7faf6d59a700 1 -- 172.21.15.157:0/1021301197 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58011d00 con 0x7faf70161660 2024-04-18T03:41:33.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 -- 172.21.15.157:0/1021301197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf70161660 msgr2=0x7faf7006c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 --2- 172.21.15.157:0/1021301197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf70161660 0x7faf7006c3a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faf58009850 tx=0x7faf58009b60 comp rx=0 tx=0).stop 2024-04-18T03:41:33.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 -- 172.21.15.157:0/1021301197 shutdown_connections 2024-04-18T03:41:33.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 --2- 172.21.15.157:0/1021301197 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf70161660 0x7faf7006c3a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 -- 172.21.15.157:0/1021301197 >> 172.21.15.157:0/1021301197 conn(0x7faf7006e020 msgr2=0x7faf7006e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:33.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 -- 172.21.15.157:0/1021301197 shutdown_connections 2024-04-18T03:41:33.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 -- 172.21.15.157:0/1021301197 wait complete. 2024-04-18T03:41:33.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 Processor -- start 2024-04-18T03:41:33.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.438+0000 7faf6f59e700 1 -- start start 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6f59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf70071080 0x7faf701f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6f59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf700d12b0 0x7faf700ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6f59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf70161660 0x7faf701f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6f59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015ded0 con 0x7faf700d12b0 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6f59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf701f3710 con 0x7faf70161660 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6f59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015d530 con 0x7faf70071080 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf700d12b0 0x7faf700ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf700d12b0 0x7faf700ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57808/0 (socket says 172.21.15.157:57808) 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 -- 172.21.15.157:0/1611776965 learned_addr learned my addr 172.21.15.157:0/1611776965 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:33.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6e59c700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf70071080 0x7faf701f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6ed9d700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf70161660 0x7faf701f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 -- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf70071080 msgr2=0x7faf701f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf70071080 0x7faf701f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 -- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf70161660 msgr2=0x7faf701f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf70161660 0x7faf701f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 -- 172.21.15.157:0/1611776965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580094b0 con 0x7faf700d12b0 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6dd9b700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf700d12b0 0x7faf700ca0c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faf58009ba0 tx=0x7faf58004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf66ffd700 1 -- 172.21.15.157:0/1611776965 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf580036c0 con 0x7faf700d12b0 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf66ffd700 1 -- 172.21.15.157:0/1611776965 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5801e070 con 0x7faf700d12b0 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7015d810 con 0x7faf700d12b0 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf66ffd700 1 -- 172.21.15.157:0/1611776965 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58003a80 con 0x7faf700d12b0 2024-04-18T03:41:33.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.442+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf700ca9d0 con 0x7faf700d12b0 2024-04-18T03:41:33.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.446+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7015e010 con 0x7faf700d12b0 2024-04-18T03:41:33.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.446+0000 7faf66ffd700 1 -- 172.21.15.157:0/1611776965 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf58003be0 con 0x7faf700d12b0 2024-04-18T03:41:33.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.446+0000 7faf66ffd700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faf54066730 0x7faf54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.446+0000 7faf66ffd700 1 -- 172.21.15.157:0/1611776965 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf580853e0 con 0x7faf700d12b0 2024-04-18T03:41:33.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.446+0000 7faf6e59c700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faf54066730 0x7faf54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.446+0000 7faf6e59c700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faf54066730 0x7faf54068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faf68001560 tx=0x7faf68009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.454+0000 7faf66ffd700 1 -- 172.21.15.157:0/1611776965 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7faf7015e010 con 0x7faf700d12b0 2024-04-18T03:41:33.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.622+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7faf7006b810 con 0x7faf54066730 2024-04-18T03:41:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.626+0000 7faf66ffd700 1 -- 172.21.15.157:0/1611776965 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faf6800e6d0 con 0x7faf54066730 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faf54066730 msgr2=0x7faf54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faf54066730 0x7faf54068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faf68001560 tx=0x7faf68009040 comp rx=0 tx=0).stop 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf700d12b0 msgr2=0x7faf700ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf700d12b0 0x7faf700ca0c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faf58009ba0 tx=0x7faf58004770 comp rx=0 tx=0).stop 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 shutdown_connections 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7faf54066730 0x7faf54068bf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf70161660 0x7faf701f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf700d12b0 0x7faf700ca0c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 --2- 172.21.15.157:0/1611776965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf70071080 0x7faf701f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 >> 172.21.15.157:0/1611776965 conn(0x7faf7006e020 msgr2=0x7faf70159850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:33.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 shutdown_connections 2024-04-18T03:41:33.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.630+0000 7faf6f59e700 1 -- 172.21.15.157:0/1611776965 wait complete. 2024-04-18T03:41:33.636 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 3 to deep-scrub 2024-04-18T03:41:33.649 INFO:tasks.ceph:Scrubbing osd.4 2024-04-18T03:41:33.649 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-18T03:41:33.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122e93f700 1 Processor -- start 2024-04-18T03:41:33.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122e93f700 1 -- start start 2024-04-18T03:41:33.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122e93f700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f122815cfc0 0x7f122815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122e93f700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f12280ccdf0 0x7f12280b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122e93f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280cd280 0x7f12280b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122e93f700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122815e6b0 con 0x7f12280ccdf0 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122e93f700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280718d0 con 0x7f122815cfc0 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122e93f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122815daa0 con 0x7f12280cd280 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f12277fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f12280ccdf0 0x7f12280b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f12277fe700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f12280ccdf0 0x7f12280b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57818/0 (socket says 172.21.15.157:57818) 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f12277fe700 1 -- 172.21.15.157:0/1539513377 learned_addr learned my addr 172.21.15.157:0/1539513377 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f1227fff700 1 --2- 172.21.15.157:0/1539513377 >> v2:172.21.15.175:3300/0 conn(0x7f122815cfc0 0x7f122815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.766+0000 7f122cedc700 1 --2- 172.21.15.157:0/1539513377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280cd280 0x7f12280b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 -- 172.21.15.157:0/1539513377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280cd280 msgr2=0x7f12280b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 --2- 172.21.15.157:0/1539513377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280cd280 0x7f12280b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 -- 172.21.15.157:0/1539513377 >> v2:172.21.15.175:3300/0 conn(0x7f122815cfc0 msgr2=0x7f122815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 --2- 172.21.15.157:0/1539513377 >> v2:172.21.15.175:3300/0 conn(0x7f122815cfc0 0x7f122815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 -- 172.21.15.157:0/1539513377 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122815dd80 con 0x7f12280ccdf0 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 --2- 172.21.15.157:0/1539513377 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280ccdf0 0x7f12280b27a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f12280b34c0 tx=0x7f1218009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d9e7ef30adfb78 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f1226ffd700 1 -- 172.21.15.157:0/1539513377 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800b8a0 con 0x7f12280ccdf0 2024-04-18T03:41:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f1226ffd700 1 -- 172.21.15.157:0/1539513377 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121800ba00 con 0x7f12280ccdf0 2024-04-18T03:41:33.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f1226ffd700 1 -- 172.21.15.157:0/1539513377 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800bd90 con 0x7f12280ccdf0 2024-04-18T03:41:33.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- 172.21.15.157:0/1539513377 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280ccdf0 msgr2=0x7f12280b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 --2- 172.21.15.157:0/1539513377 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280ccdf0 0x7f12280b27a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f12280b34c0 tx=0x7f1218009bf0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- 172.21.15.157:0/1539513377 shutdown_connections 2024-04-18T03:41:33.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 --2- 172.21.15.157:0/1539513377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280cd280 0x7f12280b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 --2- 172.21.15.157:0/1539513377 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280ccdf0 0x7f12280b27a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 --2- 172.21.15.157:0/1539513377 >> v2:172.21.15.175:3300/0 conn(0x7f122815cfc0 0x7f122815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- 172.21.15.157:0/1539513377 >> 172.21.15.157:0/1539513377 conn(0x7f12280cd7a0 msgr2=0x7f12280cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- 172.21.15.157:0/1539513377 shutdown_connections 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- 172.21.15.157:0/1539513377 wait complete. 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 Processor -- start 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- start start 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280ccdf0 0x7f12280c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280cd280 0x7f12280c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122815cfc0 0x7f12280c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12280c9bb0 con 0x7f12280cd280 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12280c9e90 con 0x7f122815cfc0 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122e93f700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280ca170 con 0x7f12280ccdf0 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280cd280 0x7f12280c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280cd280 0x7f12280c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57820/0 (socket says 172.21.15.157:57820) 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f12277fe700 1 -- 172.21.15.157:0/3641263478 learned_addr learned my addr 172.21.15.157:0/3641263478 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f122cedc700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122815cfc0 0x7f12280c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.770+0000 7f1227fff700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280ccdf0 0x7f12280c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f12277fe700 1 -- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280ccdf0 msgr2=0x7f12280c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f12277fe700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280ccdf0 0x7f12280c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f12277fe700 1 -- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122815cfc0 msgr2=0x7f12280c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f12277fe700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122815cfc0 0x7f12280c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f12277fe700 1 -- 172.21.15.157:0/3641263478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218009570 con 0x7f12280cd280 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f12277fe700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280cd280 0x7f12280c59d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f12280b3720 tx=0x7f1218004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180036c0 con 0x7f12280cd280 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12280ca450 con 0x7f12280cd280 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121801f070 con 0x7f12280cd280 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12280cac50 con 0x7f12280cd280 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218003a20 con 0x7f12280cd280 2024-04-18T03:41:33.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f122815e340 con 0x7f12280cd280 2024-04-18T03:41:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1218021030 con 0x7f12280cd280 2024-04-18T03:41:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1214066760 0x7f1214068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1218085cb0 con 0x7f12280cd280 2024-04-18T03:41:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f121406ffc0 0x7f1214072460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 --> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1214072b30 con 0x7f121406ffc0 2024-04-18T03:41:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1218086100 con 0x7f12280cd280 2024-04-18T03:41:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f1227fff700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1214066760 0x7f1214068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.774+0000 7f122cedc700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f121406ffc0 0x7f1214072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.778+0000 7f1227fff700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1214066760 0x7f1214068c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f121c0079e0 tx=0x7f121c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.778+0000 7f122cedc700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f121406ffc0 0x7f1214072460 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.778+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 <== osd.4 v2:172.21.15.175:6800/26209 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f1214072b30 con 0x7f121406ffc0 2024-04-18T03:41:33.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 --> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12280ca970 con 0x7f121406ffc0 2024-04-18T03:41:33.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f1224ff9700 1 -- 172.21.15.157:0/3641263478 <== osd.4 v2:172.21.15.175:6800/26209 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f12280ca970 con 0x7f121406ffc0 2024-04-18T03:41:33.802 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:41:33.803 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T03:41:33.803 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:41:33.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f121406ffc0 msgr2=0x7f1214072460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6800/26209,v1:172.21.15.175:6801/26209] conn(0x7f121406ffc0 0x7f1214072460 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1214066760 msgr2=0x7f1214068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1214066760 0x7f1214068c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f121c0079e0 tx=0x7f121c008040 comp rx=0 tx=0).stop 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280cd280 msgr2=0x7f12280c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 --2- 172.21.15.157:0/3641263478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12280cd280 0x7f12280c59d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f12280b3720 tx=0x7f1218004770 comp rx=0 tx=0).stop 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122cedc700 1 -- 172.21.15.157:0/3641263478 reap_dead start 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 shutdown_connections 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 >> 172.21.15.157:0/3641263478 conn(0x7f12280cd7a0 msgr2=0x7f122815c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 shutdown_connections 2024-04-18T03:41:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.798+0000 7f122e93f700 1 -- 172.21.15.157:0/3641263478 wait complete. 2024-04-18T03:41:33.815 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-18T03:41:33.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 Processor -- start 2024-04-18T03:41:33.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- start start 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca440adf00 0x7fca44071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4415bef0 con 0x7fca4415ac70 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440ae2e0 con 0x7fca440716c0 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca44071b40 con 0x7fca440adf00 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca493bd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca440adf00 0x7fca44071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca493bd700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca440adf00 0x7fca44071180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57836/0 (socket says 172.21.15.157:57836) 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca493bd700 1 -- 172.21.15.157:0/3650054310 learned_addr learned my addr 172.21.15.157:0/3650054310 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca493bd700 1 -- 172.21.15.157:0/3650054310 >> v1:172.21.15.175:6789/0 conn(0x7fca440716c0 legacy=0x7fca4415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca493bd700 1 -- 172.21.15.157:0/3650054310 >> v1:172.21.15.157:6789/0 conn(0x7fca4415ac70 legacy=0x7fca4415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca493bd700 1 -- 172.21.15.157:0/3650054310 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4415b2c0 con 0x7fca440adf00 2024-04-18T03:41:33.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca43fff700 1 -- 172.21.15.157:0/3650054310 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582223380 0 0) 0x7fca4415bef0 con 0x7fca4415ac70 2024-04-18T03:41:33.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca493bd700 1 --2- 172.21.15.157:0/3650054310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca440adf00 0x7fca44071180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009e50 tx=0x7fca3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395741dcb9eddf00 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca43fff700 1 -- 172.21.15.157:0/3650054310 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00bbc0 con 0x7fca440adf00 2024-04-18T03:41:33.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca43fff700 1 -- 172.21.15.157:0/3650054310 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c00bd20 con 0x7fca440adf00 2024-04-18T03:41:33.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca43fff700 1 -- 172.21.15.157:0/3650054310 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0116a0 con 0x7fca440adf00 2024-04-18T03:41:33.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- 172.21.15.157:0/3650054310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca440adf00 msgr2=0x7fca44071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 --2- 172.21.15.157:0/3650054310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca440adf00 0x7fca44071180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009e50 tx=0x7fca3c00b330 comp rx=0 tx=0).stop 2024-04-18T03:41:33.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- 172.21.15.157:0/3650054310 shutdown_connections 2024-04-18T03:41:33.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 --2- 172.21.15.157:0/3650054310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca440adf00 0x7fca44071180 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- 172.21.15.157:0/3650054310 >> 172.21.15.157:0/3650054310 conn(0x7fca440b12d0 msgr2=0x7fca4406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:33.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- 172.21.15.157:0/3650054310 shutdown_connections 2024-04-18T03:41:33.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.930+0000 7fca4a3bf700 1 -- 172.21.15.157:0/3650054310 wait complete. 2024-04-18T03:41:33.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.934+0000 7fca4a3bf700 1 Processor -- start 2024-04-18T03:41:33.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.934+0000 7fca4a3bf700 1 -- start start 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca440716c0 0x7fca440cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca440adf00 0x7fca4413f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4415ac70 0x7fca44159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4415d840 con 0x7fca4415ac70 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4413fc20 con 0x7fca440716c0 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca44157fa0 con 0x7fca440adf00 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca49bbe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4415ac70 0x7fca44159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca48bbc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca440adf00 0x7fca4413f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca493bd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca440716c0 0x7fca440cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca49bbe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4415ac70 0x7fca44159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57840/0 (socket says 172.21.15.157:57840) 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca48bbc700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca440adf00 0x7fca4413f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:49972/0 (socket says 172.21.15.157:49972) 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca49bbe700 1 -- 172.21.15.157:0/2754452504 learned_addr learned my addr 172.21.15.157:0/2754452504 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca48bbc700 1 -- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca440716c0 msgr2=0x7fca440cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca48bbc700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca440716c0 0x7fca440cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca48bbc700 1 -- 172.21.15.157:0/2754452504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4415ac70 msgr2=0x7fca44159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca48bbc700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4415ac70 0x7fca44159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca48bbc700 1 -- 172.21.15.157:0/2754452504 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c009b30 con 0x7fca440adf00 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca48bbc700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca440adf00 0x7fca4413f6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c480 tx=0x7fca3800c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca41ffb700 1 -- 172.21.15.157:0/2754452504 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380052d0 con 0x7fca440adf00 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca41ffb700 1 -- 172.21.15.157:0/2754452504 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca38005430 con 0x7fca440adf00 2024-04-18T03:41:33.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca41ffb700 1 -- 172.21.15.157:0/2754452504 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380055a0 con 0x7fca440adf00 2024-04-18T03:41:33.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4415da90 con 0x7fca440adf00 2024-04-18T03:41:33.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4415e050 con 0x7fca440adf00 2024-04-18T03:41:33.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.938+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4404e650 con 0x7fca440adf00 2024-04-18T03:41:33.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.942+0000 7fca41ffb700 1 -- 172.21.15.157:0/2754452504 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca380038e0 con 0x7fca440adf00 2024-04-18T03:41:33.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.942+0000 7fca41ffb700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fca30066730 0x7fca30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:33.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.942+0000 7fca41ffb700 1 -- 172.21.15.157:0/2754452504 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fca380837e0 con 0x7fca440adf00 2024-04-18T03:41:33.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.942+0000 7fca493bd700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fca30066730 0x7fca30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:33.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.942+0000 7fca493bd700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fca30066730 0x7fca30068bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00b370 tx=0x7fca3c009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:33.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:33.950+0000 7fca41ffb700 1 -- 172.21.15.157:0/2754452504 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fca380507a0 con 0x7fca440adf00 2024-04-18T03:41:34.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.122+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fca4415bb80 con 0x7fca30066730 2024-04-18T03:41:34.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.122+0000 7fca41ffb700 1 -- 172.21.15.157:0/2754452504 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fca3c021040 con 0x7fca30066730 2024-04-18T03:41:34.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fca30066730 msgr2=0x7fca30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fca30066730 0x7fca30068bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00b370 tx=0x7fca3c009000 comp rx=0 tx=0).stop 2024-04-18T03:41:34.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca440adf00 msgr2=0x7fca4413f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca440adf00 0x7fca4413f6e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c480 tx=0x7fca3800c790 comp rx=0 tx=0).stop 2024-04-18T03:41:34.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 shutdown_connections 2024-04-18T03:41:34.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fca30066730 0x7fca30068bf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca4415ac70 0x7fca44159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca440adf00 0x7fca4413f6e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 --2- 172.21.15.157:0/2754452504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca440716c0 0x7fca440cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 >> 172.21.15.157:0/2754452504 conn(0x7fca440b12d0 msgr2=0x7fca440aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:34.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 shutdown_connections 2024-04-18T03:41:34.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.126+0000 7fca4a3bf700 1 -- 172.21.15.157:0/2754452504 wait complete. 2024-04-18T03:41:34.131 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 4 to deep-scrub 2024-04-18T03:41:34.143 INFO:tasks.ceph:Scrubbing osd.5 2024-04-18T03:41:34.143 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-18T03:41:34.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.258+0000 7f6d81d8c700 1 Processor -- start 2024-04-18T03:41:34.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.258+0000 7f6d81d8c700 1 -- start start 2024-04-18T03:41:34.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c15b050 0x7f6d7c0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6d7c0b0690 0x7f6d7c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7c0c5ab0 con 0x7f6d7c0b1700 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7c0ae820 con 0x7f6d7c0b0690 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6d7c0b0690 0x7f6d7c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c06a860 con 0x7f6d7c15b050 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7bfff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6d7c0b0690 0x7f6d7c0af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57848/0 (socket says 172.21.15.157:57848) 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7bfff700 1 -- 172.21.15.157:0/878143185 learned_addr learned my addr 172.21.15.157:0/878143185 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7b7fe700 1 --2- 172.21.15.157:0/878143185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c15b050 0x7f6d7c0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7bfff700 1 -- 172.21.15.157:0/878143185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c15b050 msgr2=0x7f6d7c0aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7bfff700 1 --2- 172.21.15.157:0/878143185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c15b050 0x7f6d7c0aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7bfff700 1 -- 172.21.15.157:0/878143185 >> v1:172.21.15.175:6789/0 conn(0x7f6d7c0b1700 legacy=0x7f6d7c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7bfff700 1 -- 172.21.15.157:0/878143185 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c0aea30 con 0x7f6d7c0b0690 2024-04-18T03:41:34.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7bfff700 1 --2- 172.21.15.157:0/878143185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 0x7f6d7c0af3a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009e50 tx=0x7f6d7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad183f62717478b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7affd700 1 -- 172.21.15.157:0/878143185 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7400e070 con 0x7f6d7c0b0690 2024-04-18T03:41:34.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7affd700 1 -- 172.21.15.157:0/878143185 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7400b9c0 con 0x7f6d7c0b0690 2024-04-18T03:41:34.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d7affd700 1 -- 172.21.15.157:0/878143185 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7400bd70 con 0x7f6d7c0b0690 2024-04-18T03:41:34.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 -- 172.21.15.157:0/878143185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 msgr2=0x7f6d7c0af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 --2- 172.21.15.157:0/878143185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 0x7f6d7c0af3a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009e50 tx=0x7f6d7400b330 comp rx=0 tx=0).stop 2024-04-18T03:41:34.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 -- 172.21.15.157:0/878143185 shutdown_connections 2024-04-18T03:41:34.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 --2- 172.21.15.157:0/878143185 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 0x7f6d7c0af3a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 --2- 172.21.15.157:0/878143185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c15b050 0x7f6d7c0aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 -- 172.21.15.157:0/878143185 >> 172.21.15.157:0/878143185 conn(0x7f6d7c098a50 msgr2=0x7f6d7c0b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:34.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 -- 172.21.15.157:0/878143185 shutdown_connections 2024-04-18T03:41:34.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.262+0000 7f6d81d8c700 1 -- 172.21.15.157:0/878143185 wait complete. 2024-04-18T03:41:34.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d81d8c700 1 Processor -- start 2024-04-18T03:41:34.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d81d8c700 1 -- start start 2024-04-18T03:41:34.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d81d8c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 0x7f6d7c155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d81d8c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c0b1700 0x7f6d7c156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d81d8c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d7c15b050 0x7f6d7c156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d81d8c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c156db0 con 0x7f6d7c0b0690 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d81d8c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c0cc830 con 0x7f6d7c15b050 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d81d8c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c0c8c60 con 0x7f6d7c0b1700 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d7b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 0x7f6d7c155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.266+0000 7f6d7b7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 0x7f6d7c155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57856/0 (socket says 172.21.15.157:57856) 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d7b7fe700 1 -- 172.21.15.157:0/1410517002 learned_addr learned my addr 172.21.15.157:0/1410517002 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d7bfff700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d7c15b050 0x7f6d7c156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d72ffd700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c0b1700 0x7f6d7c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d7b7fe700 1 -- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c0b1700 msgr2=0x7f6d7c156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d7b7fe700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c0b1700 0x7f6d7c156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d7b7fe700 1 -- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d7c15b050 msgr2=0x7f6d7c156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d7b7fe700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d7c15b050 0x7f6d7c156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d7b7fe700 1 -- 172.21.15.157:0/1410517002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d74009b30 con 0x7f6d7c0b0690 2024-04-18T03:41:34.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d72ffd700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d7c0b1700 0x7f6d7c156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:41:34.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d7b7fe700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 0x7f6d7c155df0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00d800 tx=0x7f6d6c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0125f0 con 0x7f6d7c0b0690 2024-04-18T03:41:34.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c012750 con 0x7f6d7c0b0690 2024-04-18T03:41:34.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7c0cc550 con 0x7f6d7c0b0690 2024-04-18T03:41:34.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c012ac0 con 0x7f6d7c0b0690 2024-04-18T03:41:34.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7c0c91e0 con 0x7f6d7c0b0690 2024-04-18T03:41:34.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d7c0c5740 con 0x7f6d7c0b0690 2024-04-18T03:41:34.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.270+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d6c012c20 con 0x7f6d7c0b0690 2024-04-18T03:41:34.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d78ff9700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d5c066730 0x7f6d5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d6c084860 con 0x7f6d7c0b0690 2024-04-18T03:41:34.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d72ffd700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d5c066730 0x7f6d5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d78ff9700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7f6d5c070010 0x7f6d5c0724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 --> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d5c072b80 con 0x7f6d5c070010 2024-04-18T03:41:34.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d6c0892c0 con 0x7f6d7c0b0690 2024-04-18T03:41:34.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d7bfff700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7f6d5c070010 0x7f6d5c0724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d72ffd700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d5c066730 0x7f6d5c068bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c1516c0 tx=0x7f6d64009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d7bfff700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7f6d5c070010 0x7f6d5c0724b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.274+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 <== osd.5 v2:172.21.15.175:6824/26210 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6d5c072b80 con 0x7f6d5c070010 2024-04-18T03:41:34.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.294+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 --> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d7c0c8ac0 con 0x7f6d5c070010 2024-04-18T03:41:34.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d78ff9700 1 -- 172.21.15.157:0/1410517002 <== osd.5 v2:172.21.15.175:6824/26210 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6d7c0c8ac0 con 0x7f6d5c070010 2024-04-18T03:41:34.301 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:41:34.301 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T03:41:34.302 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:41:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7f6d5c070010 msgr2=0x7f6d5c0724b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6824/26210,v1:172.21.15.175:6825/26210] conn(0x7f6d5c070010 0x7f6d5c0724b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d5c066730 msgr2=0x7f6d5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f6d5c066730 0x7f6d5c068bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c1516c0 tx=0x7f6d64009040 comp rx=0 tx=0).stop 2024-04-18T03:41:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 msgr2=0x7f6d7c155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 --2- 172.21.15.157:0/1410517002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d7c0b0690 0x7f6d7c155df0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00d800 tx=0x7f6d6c00dbc0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d7bfff700 1 -- 172.21.15.157:0/1410517002 reap_dead start 2024-04-18T03:41:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 shutdown_connections 2024-04-18T03:41:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 >> 172.21.15.157:0/1410517002 conn(0x7f6d7c098a50 msgr2=0x7f6d7c06c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 shutdown_connections 2024-04-18T03:41:34.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.298+0000 7f6d81d8c700 1 -- 172.21.15.157:0/1410517002 wait complete. 2024-04-18T03:41:34.317 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-18T03:41:34.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a304c700 1 Processor -- start 2024-04-18T03:41:34.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a304c700 1 -- start start 2024-04-18T03:41:34.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a304c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c15cfe0 0x7f179c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a304c700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f179c071010 0x7f179c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a304c700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c0b4080 con 0x7f179c0b3be0 2024-04-18T03:41:34.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a304c700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0b4360 con 0x7f179c071010 2024-04-18T03:41:34.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a304c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0b4640 con 0x7f179c15cfe0 2024-04-18T03:41:34.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f1793fff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f179c0b3be0 0x7f179c070900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59662/0 (socket says 172.21.15.157:59662) 2024-04-18T03:41:34.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f1793fff700 1 -- 172.21.15.157:0/1830207597 learned_addr learned my addr 172.21.15.157:0/1830207597 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a0de8700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c15cfe0 0x7f179c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a15e9700 1 --2- 172.21.15.157:0/1830207597 >> v2:172.21.15.175:3300/0 conn(0x7f179c071010 0x7f179c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883695320 0 0) 0x7f179c0b4080 con 0x7f179c0b3be0 2024-04-18T03:41:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17840035d0 con 0x7f179c0b3be0 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1801214372 0 0) 0x7f17840035d0 con 0x7f179c0b3be0 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c15cfe0 msgr2=0x7f179c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c15cfe0 0x7f179c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 >> v2:172.21.15.175:3300/0 conn(0x7f179c071010 msgr2=0x7f179c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 --2- 172.21.15.157:0/1830207597 >> v2:172.21.15.175:3300/0 conn(0x7f179c071010 0x7f179c0cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c0cd6f0 con 0x7f179c0b3be0 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7f178c001670 con 0x7f179c0b3be0 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 >> v1:172.21.15.157:6789/0 conn(0x7f179c0b3be0 legacy=0x7f179c070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c15cfe0 0x7f1784003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784003fa0 0x7f1784004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1784004db0 0x7f1784005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0b4360 con 0x7f1784004db0 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0b4640 con 0x7f1784003fa0 2024-04-18T03:41:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178400ba80 con 0x7f179c15cfe0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a15e9700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1784004db0 0x7f1784005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a0de8700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c15cfe0 0x7f1784003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f1793fff700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784003fa0 0x7f1784004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a15e9700 1 -- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c15cfe0 msgr2=0x7f1784003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a15e9700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c15cfe0 0x7f1784003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a15e9700 1 -- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784003fa0 msgr2=0x7f1784004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a15e9700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784003fa0 0x7f1784004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.430+0000 7f17a15e9700 1 -- 172.21.15.157:0/1830207597 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840035d0 con 0x7f1784004db0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a15e9700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1784004db0 0x7f1784005230 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f179400e170 tx=0x7f17840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2187a9741d25e4a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400ec90 con 0x7f1784004db0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400f040 con 0x7f1784004db0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17937fe700 1 -- 172.21.15.157:0/1830207597 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794014480 con 0x7f1784004db0 2024-04-18T03:41:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a304c700 1 -- 172.21.15.157:0/1830207597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1784004db0 msgr2=0x7f1784005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a304c700 1 --2- 172.21.15.157:0/1830207597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1784004db0 0x7f1784005230 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f179400e170 tx=0x7f17840058a0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a15e9700 1 -- 172.21.15.157:0/1830207597 reap_dead start 2024-04-18T03:41:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a304c700 1 -- 172.21.15.157:0/1830207597 shutdown_connections 2024-04-18T03:41:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a304c700 1 -- 172.21.15.157:0/1830207597 >> 172.21.15.157:0/1830207597 conn(0x7f179c06a2a0 msgr2=0x7f179c06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a304c700 1 -- 172.21.15.157:0/1830207597 shutdown_connections 2024-04-18T03:41:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a304c700 1 -- 172.21.15.157:0/1830207597 wait complete. 2024-04-18T03:41:34.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a304c700 1 Processor -- start 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.434+0000 7f17a304c700 1 -- start start 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784004db0 0x7f179c15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c145030 0x7f179c0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179c144250 0x7f179c1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1470c0 con 0x7f179c144250 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1473a0 con 0x7f1784004db0 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c147680 con 0x7f179c145030 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179c144250 0x7f179c1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179c144250 0x7f179c1446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57886/0 (socket says 172.21.15.157:57886) 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 -- 172.21.15.157:0/937393835 learned_addr learned my addr 172.21.15.157:0/937393835 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a0de8700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784004db0 0x7f179c15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f1793fff700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c145030 0x7f179c0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 -- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c145030 msgr2=0x7f179c0afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c145030 0x7f179c0afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 -- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784004db0 msgr2=0x7f179c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784004db0 0x7f179c15de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 -- 172.21.15.157:0/937393835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c147960 con 0x7f179c144250 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a15e9700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179c144250 0x7f179c1446e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1794016000 tx=0x7f1794009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17917fa700 1 -- 172.21.15.157:0/937393835 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794007000 con 0x7f179c144250 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17917fa700 1 -- 172.21.15.157:0/937393835 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400ee80 con 0x7f179c144250 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17917fa700 1 -- 172.21.15.157:0/937393835 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794003c80 con 0x7f179c144250 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c147c40 con 0x7f179c144250 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c15e380 con 0x7f179c144250 2024-04-18T03:41:34.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c06b9b0 con 0x7f179c144250 2024-04-18T03:41:34.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17917fa700 1 -- 172.21.15.157:0/937393835 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1794024020 con 0x7f179c144250 2024-04-18T03:41:34.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.438+0000 7f17917fa700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1788066730 0x7f1788068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.442+0000 7f17917fa700 1 -- 172.21.15.157:0/937393835 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1794085fc0 con 0x7f179c144250 2024-04-18T03:41:34.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.442+0000 7f17a0de8700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1788066730 0x7f1788068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.442+0000 7f17a0de8700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1788066730 0x7f1788068bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1798009bb0 tx=0x7f1798008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.446+0000 7f17917fa700 1 -- 172.21.15.157:0/937393835 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f1794053120 con 0x7f179c144250 2024-04-18T03:41:34.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.614+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f179c15d3c0 con 0x7f1788066730 2024-04-18T03:41:34.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.614+0000 7f17917fa700 1 -- 172.21.15.157:0/937393835 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1798009800 con 0x7f1788066730 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1788066730 msgr2=0x7f1788068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1788066730 0x7f1788068bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1798009bb0 tx=0x7f1798008040 comp rx=0 tx=0).stop 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179c144250 msgr2=0x7f179c1446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179c144250 0x7f179c1446e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1794016000 tx=0x7f1794009750 comp rx=0 tx=0).stop 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 shutdown_connections 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f1788066730 0x7f1788068bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179c144250 0x7f179c1446e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f179c145030 0x7f179c0afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 --2- 172.21.15.157:0/937393835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1784004db0 0x7f179c15de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 >> 172.21.15.157:0/937393835 conn(0x7f179c06a2a0 msgr2=0x7f179c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:34.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 shutdown_connections 2024-04-18T03:41:34.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.618+0000 7f17a304c700 1 -- 172.21.15.157:0/937393835 wait complete. 2024-04-18T03:41:34.624 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 5 to deep-scrub 2024-04-18T03:41:34.635 INFO:tasks.ceph:Scrubbing osd.6 2024-04-18T03:41:34.636 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-18T03:41:34.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.750+0000 7f9752133700 1 Processor -- start 2024-04-18T03:41:34.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.750+0000 7f9752133700 1 -- start start 2024-04-18T03:41:34.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f974c146a90 0x7f974c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f974c15e3d0 0x7f974c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c071080 0x7f974c071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974c071a70 con 0x7f974c146a90 2024-04-18T03:41:34.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974c0b67c0 con 0x7f974c15e3d0 2024-04-18T03:41:34.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974c0b6aa0 con 0x7f974c071080 2024-04-18T03:41:34.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f974c146a90 0x7f974c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f974c146a90 0x7f974c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57900/0 (socket says 172.21.15.157:57900) 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 -- 172.21.15.157:0/2098846761 learned_addr learned my addr 172.21.15.157:0/2098846761 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9750930700 1 --2- 172.21.15.157:0/2098846761 >> v2:172.21.15.175:3300/0 conn(0x7f974c15e3d0 0x7f974c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751932700 1 --2- 172.21.15.157:0/2098846761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c071080 0x7f974c071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 -- 172.21.15.157:0/2098846761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c071080 msgr2=0x7f974c071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 --2- 172.21.15.157:0/2098846761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c071080 0x7f974c071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 -- 172.21.15.157:0/2098846761 >> v2:172.21.15.175:3300/0 conn(0x7f974c15e3d0 msgr2=0x7f974c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 --2- 172.21.15.157:0/2098846761 >> v2:172.21.15.175:3300/0 conn(0x7f974c15e3d0 0x7f974c0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 -- 172.21.15.157:0/2098846761 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c0b6d80 con 0x7f974c146a90 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9750930700 1 --2- 172.21.15.157:0/2098846761 >> v2:172.21.15.175:3300/0 conn(0x7f974c15e3d0 0x7f974c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:34.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9751131700 1 --2- 172.21.15.157:0/2098846761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c146a90 0x7f974c06a770 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f974c0d2eb0 tx=0x7f973c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea33792289e16dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9743fff700 1 -- 172.21.15.157:0/2098846761 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c011830 con 0x7f974c146a90 2024-04-18T03:41:34.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9743fff700 1 -- 172.21.15.157:0/2098846761 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c011990 con 0x7f974c146a90 2024-04-18T03:41:34.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9743fff700 1 -- 172.21.15.157:0/2098846761 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c011d20 con 0x7f974c146a90 2024-04-18T03:41:34.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 -- 172.21.15.157:0/2098846761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c146a90 msgr2=0x7f974c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 --2- 172.21.15.157:0/2098846761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c146a90 0x7f974c06a770 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f974c0d2eb0 tx=0x7f973c009bf0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 -- 172.21.15.157:0/2098846761 shutdown_connections 2024-04-18T03:41:34.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 --2- 172.21.15.157:0/2098846761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c071080 0x7f974c071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 --2- 172.21.15.157:0/2098846761 >> v2:172.21.15.175:3300/0 conn(0x7f974c15e3d0 0x7f974c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 --2- 172.21.15.157:0/2098846761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c146a90 0x7f974c06a770 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 -- 172.21.15.157:0/2098846761 >> 172.21.15.157:0/2098846761 conn(0x7f974c06e200 msgr2=0x7f974c06e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:34.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 -- 172.21.15.157:0/2098846761 shutdown_connections 2024-04-18T03:41:34.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.754+0000 7f9752133700 1 -- 172.21.15.157:0/2098846761 wait complete. 2024-04-18T03:41:34.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 Processor -- start 2024-04-18T03:41:34.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 -- start start 2024-04-18T03:41:34.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c071080 0x7f974c142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c146a90 0x7f974c159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c15e3d0 0x7f974c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c15a410 con 0x7f974c071080 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c159e50 con 0x7f974c15e3d0 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974c15a130 con 0x7f974c146a90 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c071080 0x7f974c142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c071080 0x7f974c142ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57916/0 (socket says 172.21.15.157:57916) 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 -- 172.21.15.157:0/1084334060 learned_addr learned my addr 172.21.15.157:0/1084334060 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751932700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c15e3d0 0x7f974c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9750930700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c146a90 0x7f974c159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 -- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c146a90 msgr2=0x7f974c159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c146a90 0x7f974c159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 -- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c15e3d0 msgr2=0x7f974c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c15e3d0 0x7f974c153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 -- 172.21.15.157:0/1084334060 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480094b0 con 0x7f974c071080 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9750930700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c146a90 0x7f974c159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9751131700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c071080 0x7f974c142ee0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f974c06f4c0 tx=0x7f973c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c004240 con 0x7f974c071080 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c01f070 con 0x7f974c071080 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c009570 con 0x7f974c071080 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0045e0 con 0x7f974c071080 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.758+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974c1560b0 con 0x7f974c071080 2024-04-18T03:41:34.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f974c0d1540 con 0x7f974c071080 2024-04-18T03:41:34.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f973c021030 con 0x7f974c071080 2024-04-18T03:41:34.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9741ffb700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9730066730 0x7f9730068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f973c085b50 con 0x7f974c071080 2024-04-18T03:41:34.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9741ffb700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f973006ff90 0x7f9730072430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 --> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9730072b00 con 0x7f973006ff90 2024-04-18T03:41:34.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f973c085fa0 con 0x7f974c071080 2024-04-18T03:41:34.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9750930700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9730066730 0x7f9730068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.762+0000 7f9751932700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f973006ff90 0x7f9730072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.766+0000 7f9750930700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9730066730 0x7f9730068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f974c15aeb0 tx=0x7f9748008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.766+0000 7f9751932700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f973006ff90 0x7f9730072430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.766+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 <== osd.6 v2:172.21.15.175:6808/26207 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9730072b00 con 0x7f973006ff90 2024-04-18T03:41:34.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 --> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f974c0b64d0 con 0x7f973006ff90 2024-04-18T03:41:34.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9741ffb700 1 -- 172.21.15.157:0/1084334060 <== osd.6 v2:172.21.15.175:6808/26207 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f974400f040 con 0x7f973006ff90 2024-04-18T03:41:34.787 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:41:34.787 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T03:41:34.787 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:41:34.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f973006ff90 msgr2=0x7f9730072430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6808/26207,v1:172.21.15.175:6810/26207] conn(0x7f973006ff90 0x7f9730072430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9730066730 msgr2=0x7f9730068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9730066730 0x7f9730068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f974c15aeb0 tx=0x7f9748008040 comp rx=0 tx=0).stop 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c071080 msgr2=0x7f974c142ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 --2- 172.21.15.157:0/1084334060 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f974c071080 0x7f974c142ee0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f974c06f4c0 tx=0x7f973c004770 comp rx=0 tx=0).stop 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9751932700 1 -- 172.21.15.157:0/1084334060 reap_dead start 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 shutdown_connections 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 >> 172.21.15.157:0/1084334060 conn(0x7f974c06e200 msgr2=0x7f974c06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 shutdown_connections 2024-04-18T03:41:34.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.782+0000 7f9752133700 1 -- 172.21.15.157:0/1084334060 wait complete. 2024-04-18T03:41:34.800 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-18T03:41:34.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.910+0000 7f2884e2d700 1 Processor -- start 2024-04-18T03:41:34.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.910+0000 7f2884e2d700 1 -- start start 2024-04-18T03:41:34.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288015d680 0x7f2880071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f28800715c0 0x7f28800d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2880071a10 con 0x7f288013ff90 2024-04-18T03:41:34.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28801425f0 con 0x7f28800715c0 2024-04-18T03:41:34.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2880142890 con 0x7f288015d680 2024-04-18T03:41:34.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287f7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f288013ff90 0x7f288015df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59674/0 (socket says 172.21.15.157:59674) 2024-04-18T03:41:34.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287ffff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f28800715c0 0x7f28800d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287f7fe700 1 -- 172.21.15.157:0/3653085156 learned_addr learned my addr 172.21.15.157:0/3653085156 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:34.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287effd700 1 --2- 172.21.15.157:0/3653085156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288015d680 0x7f2880071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287ffff700 1 -- 172.21.15.157:0/3653085156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288015d680 msgr2=0x7f2880071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287ffff700 1 --2- 172.21.15.157:0/3653085156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288015d680 0x7f2880071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287ffff700 1 -- 172.21.15.157:0/3653085156 >> v1:172.21.15.157:6789/0 conn(0x7f288013ff90 legacy=0x7f288015df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287e7fc700 1 -- 172.21.15.157:0/3653085156 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533323597 0 0) 0x7f2874001110 con 0x7f288013ff90 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287ffff700 1 -- 172.21.15.157:0/3653085156 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2880142b70 con 0x7f28800715c0 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287effd700 1 --2- 172.21.15.157:0/3653085156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288015d680 0x7f2880071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287ffff700 1 --2- 172.21.15.157:0/3653085156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800d15f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2878009d90 tx=0x7f287800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b573147dd6c32dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287e7fc700 1 -- 172.21.15.157:0/3653085156 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800e070 con 0x7f28800715c0 2024-04-18T03:41:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287e7fc700 1 -- 172.21.15.157:0/3653085156 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287800bb20 con 0x7f28800715c0 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f287e7fc700 1 -- 172.21.15.157:0/3653085156 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878012430 con 0x7f28800715c0 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 -- 172.21.15.157:0/3653085156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 msgr2=0x7f28800d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 --2- 172.21.15.157:0/3653085156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800d15f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2878009d90 tx=0x7f287800b330 comp rx=0 tx=0).stop 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 -- 172.21.15.157:0/3653085156 shutdown_connections 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 --2- 172.21.15.157:0/3653085156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800d15f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 --2- 172.21.15.157:0/3653085156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288015d680 0x7f2880071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 -- 172.21.15.157:0/3653085156 >> 172.21.15.157:0/3653085156 conn(0x7f288006e2e0 msgr2=0x7f288006e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 -- 172.21.15.157:0/3653085156 shutdown_connections 2024-04-18T03:41:34.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.914+0000 7f2884e2d700 1 -- 172.21.15.157:0/3653085156 wait complete. 2024-04-18T03:41:34.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 Processor -- start 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 -- start start 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288013ff90 0x7f2880141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f288015d680 0x7f2880140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28801408b0 con 0x7f28800715c0 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28801416d0 con 0x7f288015d680 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2880140ac0 con 0x7f288013ff90 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57930/0 (socket says 172.21.15.157:57930) 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 -- 172.21.15.157:0/82586331 learned_addr learned my addr 172.21.15.157:0/82586331 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287effd700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288013ff90 0x7f2880141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287ffff700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f288015d680 0x7f2880140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 -- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288013ff90 msgr2=0x7f2880141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288013ff90 0x7f2880141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 -- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f288015d680 msgr2=0x7f2880140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f288015d680 0x7f2880140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 -- 172.21.15.157:0/82586331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700094b0 con 0x7f28800715c0 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287effd700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288013ff90 0x7f2880141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f287f7fe700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800b4640 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f287400c750 tx=0x7f287400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2867fff700 1 -- 172.21.15.157:0/82586331 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874004ca0 con 0x7f28800715c0 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2867fff700 1 -- 172.21.15.157:0/82586331 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2874004e20 con 0x7f28800715c0 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2878009a70 con 0x7f28800715c0 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2867fff700 1 -- 172.21.15.157:0/82586331 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874007310 con 0x7f28800715c0 2024-04-18T03:41:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.918+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2880141080 con 0x7f28800715c0 2024-04-18T03:41:34.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.922+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288004e650 con 0x7f28800715c0 2024-04-18T03:41:34.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.922+0000 7f2867fff700 1 -- 172.21.15.157:0/82586331 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2874007470 con 0x7f28800715c0 2024-04-18T03:41:34.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.922+0000 7f2867fff700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f286c066730 0x7f286c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:34.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.922+0000 7f2867fff700 1 -- 172.21.15.157:0/82586331 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2874083880 con 0x7f28800715c0 2024-04-18T03:41:34.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.922+0000 7f287effd700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f286c066730 0x7f286c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:34.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.922+0000 7f287effd700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f286c066730 0x7f286c068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f28801423d0 tx=0x7f2870008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:34.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:34.930+0000 7f2867fff700 1 -- 172.21.15.157:0/82586331 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2874050790 con 0x7f28800715c0 2024-04-18T03:41:35.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.098+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2880143410 con 0x7f286c066730 2024-04-18T03:41:35.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.098+0000 7f2867fff700 1 -- 172.21.15.157:0/82586331 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2870009e40 con 0x7f286c066730 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f286c066730 msgr2=0x7f286c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f286c066730 0x7f286c068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f28801423d0 tx=0x7f2870008040 comp rx=0 tx=0).stop 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 msgr2=0x7f28800b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800b4640 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f287400c750 tx=0x7f287400cb10 comp rx=0 tx=0).stop 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 shutdown_connections 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f286c066730 0x7f286c068bf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f288015d680 0x7f2880140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f288013ff90 0x7f2880141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 --2- 172.21.15.157:0/82586331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28800715c0 0x7f28800b4640 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.102+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 >> 172.21.15.157:0/82586331 conn(0x7f288006e2e0 msgr2=0x7f288006e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:35.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.106+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 shutdown_connections 2024-04-18T03:41:35.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.106+0000 7f2884e2d700 1 -- 172.21.15.157:0/82586331 wait complete. 2024-04-18T03:41:35.110 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 6 to deep-scrub 2024-04-18T03:41:35.127 INFO:tasks.ceph:Scrubbing osd.7 2024-04-18T03:41:35.127 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-18T03:41:35.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.238+0000 7f9adf2e2700 1 Processor -- start 2024-04-18T03:41:35.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.238+0000 7f9adf2e2700 1 -- start start 2024-04-18T03:41:35.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ad815afa0 0x7f9ad80afa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9ad80cb8e0 0x7f9ad80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80b03c0 con 0x7f9ad80aff60 2024-04-18T03:41:35.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad815b380 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad8070a80 con 0x7f9ad815afa0 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9addadf700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f9ad80aff60 0x7f9ad80cb1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59684/0 (socket says 172.21.15.157:59684) 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adeae1700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9ad80cb8e0 0x7f9ad80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9addadf700 1 -- 172.21.15.157:0/3019236530 learned_addr learned my addr 172.21.15.157:0/3019236530 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9ade2e0700 1 --2- 172.21.15.157:0/3019236530 >> v2:172.21.15.175:3300/0 conn(0x7f9ad815afa0 0x7f9ad80afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adeae1700 1 -- 172.21.15.157:0/3019236530 >> v2:172.21.15.175:3300/0 conn(0x7f9ad815afa0 msgr2=0x7f9ad80afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adeae1700 1 --2- 172.21.15.157:0/3019236530 >> v2:172.21.15.175:3300/0 conn(0x7f9ad815afa0 0x7f9ad80afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adeae1700 1 -- 172.21.15.157:0/3019236530 >> v1:172.21.15.157:6789/0 conn(0x7f9ad80aff60 legacy=0x7f9ad80cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adeae1700 1 -- 172.21.15.157:0/3019236530 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8071600 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9add2de700 1 -- 172.21.15.157:0/3019236530 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884917736 0 0) 0x7f9ad80b03c0 con 0x7f9ad80aff60 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9ade2e0700 1 --2- 172.21.15.157:0/3019236530 >> v2:172.21.15.175:3300/0 conn(0x7f9ad815afa0 0x7f9ad80afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adeae1700 1 --2- 172.21.15.157:0/3019236530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 0x7f9ad80b3940 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009d90 tx=0x7f9ad000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e822d7caf05993 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9add2de700 1 -- 172.21.15.157:0/3019236530 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000e070 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9add2de700 1 -- 172.21.15.157:0/3019236530 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad000bb90 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9add2de700 1 -- 172.21.15.157:0/3019236530 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0012430 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- 172.21.15.157:0/3019236530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 msgr2=0x7f9ad80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 --2- 172.21.15.157:0/3019236530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 0x7f9ad80b3940 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009d90 tx=0x7f9ad000b330 comp rx=0 tx=0).stop 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- 172.21.15.157:0/3019236530 shutdown_connections 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 --2- 172.21.15.157:0/3019236530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 0x7f9ad80b3940 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 --2- 172.21.15.157:0/3019236530 >> v2:172.21.15.175:3300/0 conn(0x7f9ad815afa0 0x7f9ad80afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- 172.21.15.157:0/3019236530 >> 172.21.15.157:0/3019236530 conn(0x7f9ad80b2600 msgr2=0x7f9ad80b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- 172.21.15.157:0/3019236530 shutdown_connections 2024-04-18T03:41:35.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- 172.21.15.157:0/3019236530 wait complete. 2024-04-18T03:41:35.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 Processor -- start 2024-04-18T03:41:35.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.242+0000 7f9adf2e2700 1 -- start start 2024-04-18T03:41:35.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80aff60 0x7f9ad8159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 0x7f9ad80c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad815afa0 0x7f9ad80ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c9480 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad81f62f0 con 0x7f9ad80aff60 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c96d0 con 0x7f9ad815afa0 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 0x7f9ad80c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 0x7f9ad80c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57946/0 (socket says 172.21.15.157:57946) 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 -- 172.21.15.157:0/2397600011 learned_addr learned my addr 172.21.15.157:0/2397600011 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9ade2e0700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80aff60 0x7f9ad8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adeae1700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad815afa0 0x7f9ad80ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 -- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad815afa0 msgr2=0x7f9ad80ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad815afa0 0x7f9ad80ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 -- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80aff60 msgr2=0x7f9ad8159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80aff60 0x7f9ad8159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 -- 172.21.15.157:0/2397600011 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0009a70 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9addadf700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 0x7f9ad80c7be0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400c5b0 tx=0x7f9ad400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4004ca0 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad4004e20 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad80c99b0 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4007310 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad80c9f70 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.246+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ad8071290 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ad4007470 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9aceffd700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9abc066730 0x7f9abc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ad40840d0 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9aceffd700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9abc070010 0x7f9abc0724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 --> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9abc072b80 con 0x7f9abc070010 2024-04-18T03:41:35.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ad4086790 con 0x7f9ad80cb8e0 2024-04-18T03:41:35.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9ade2e0700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9abc066730 0x7f9abc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9adeae1700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9abc070010 0x7f9abc0724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9ade2e0700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9abc066730 0x7f9abc068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800ab60 tx=0x7f9ac8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.250+0000 7f9adeae1700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9abc070010 0x7f9abc0724b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.254+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 <== osd.7 v2:172.21.15.175:6809/26208 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9abc072b80 con 0x7f9abc070010 2024-04-18T03:41:35.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 --> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ad8070fb0 con 0x7f9abc070010 2024-04-18T03:41:35.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9aceffd700 1 -- 172.21.15.157:0/2397600011 <== osd.7 v2:172.21.15.175:6809/26208 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ad0012860 con 0x7f9abc070010 2024-04-18T03:41:35.275 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-04-18T03:41:35.275 INFO:teuthology.orchestra.run.smithi157.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T03:41:35.275 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9abc070010 msgr2=0x7f9abc0724b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6809/26208,v1:172.21.15.175:6811/26208] conn(0x7f9abc070010 0x7f9abc0724b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9abc066730 msgr2=0x7f9abc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f9abc066730 0x7f9abc068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800ab60 tx=0x7f9ac8008040 comp rx=0 tx=0).stop 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 msgr2=0x7f9ad80c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 --2- 172.21.15.157:0/2397600011 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ad80cb8e0 0x7f9ad80c7be0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400c5b0 tx=0x7f9ad400c8c0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adeae1700 1 -- 172.21.15.157:0/2397600011 reap_dead start 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 shutdown_connections 2024-04-18T03:41:35.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 >> 172.21.15.157:0/2397600011 conn(0x7f9ad80b2600 msgr2=0x7f9ad806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:35.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 shutdown_connections 2024-04-18T03:41:35.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.270+0000 7f9adf2e2700 1 -- 172.21.15.157:0/2397600011 wait complete. 2024-04-18T03:41:35.294 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-18T03:41:35.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1415c0b700 1 Processor -- start 2024-04-18T03:41:35.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1415c0b700 1 -- start start 2024-04-18T03:41:35.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1415c0b700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14100717e0 0x7f1410141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1415c0b700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f141006e810 0x7f141006ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1415c0b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1410142140 con 0x7f14101414e0 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1415c0b700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1410071c70 con 0x7f14100717e0 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1415c0b700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1410142f80 con 0x7f141006e810 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1414c09700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f14101414e0 0x7f141015b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59692/0 (socket says 172.21.15.157:59692) 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f1414c09700 1 -- 172.21.15.157:0/1000199105 learned_addr learned my addr 172.21.15.157:0/1000199105 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f140ffff700 1 --2- 172.21.15.157:0/1000199105 >> v2:172.21.15.157:3300/0 conn(0x7f14100717e0 0x7f1410141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f141540a700 1 --2- 172.21.15.157:0/1000199105 >> v2:172.21.15.175:3300/0 conn(0x7f141006e810 0x7f141006ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f140f7fe700 1 -- 172.21.15.157:0/1000199105 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682012752 0 0) 0x7f1410142140 con 0x7f14101414e0 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f140f7fe700 1 -- 172.21.15.157:0/1000199105 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13fc0035d0 con 0x7f14101414e0 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f140ffff700 1 -- 172.21.15.157:0/1000199105 >> v2:172.21.15.175:3300/0 conn(0x7f141006e810 msgr2=0x7f141006ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f140ffff700 1 --2- 172.21.15.157:0/1000199105 >> v2:172.21.15.175:3300/0 conn(0x7f141006e810 0x7f141006ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f140ffff700 1 -- 172.21.15.157:0/1000199105 >> v1:172.21.15.157:6789/0 conn(0x7f14101414e0 legacy=0x7f141015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f140f7fe700 1 -- 172.21.15.157:0/1000199105 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677953822 0 0) 0x7f13fc0035d0 con 0x7f14101414e0 2024-04-18T03:41:35.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.406+0000 7f140ffff700 1 -- 172.21.15.157:0/1000199105 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141006f170 con 0x7f14100717e0 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f140ffff700 1 --2- 172.21.15.157:0/1000199105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14100717e0 0x7f1410141c00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1410144ba0 tx=0x7f13f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1568cd66d33d7a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f140f7fe700 1 -- 172.21.15.157:0/1000199105 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14000019f0 con 0x7f14100717e0 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f140f7fe700 1 -- 172.21.15.157:0/1000199105 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f8004030 con 0x7f14100717e0 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f140f7fe700 1 -- 172.21.15.157:0/1000199105 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80043c0 con 0x7f14100717e0 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- 172.21.15.157:0/1000199105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14100717e0 msgr2=0x7f1410141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1000199105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14100717e0 0x7f1410141c00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1410144ba0 tx=0x7f13f8009b30 comp rx=0 tx=0).stop 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- 172.21.15.157:0/1000199105 shutdown_connections 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1000199105 >> v2:172.21.15.175:3300/0 conn(0x7f141006e810 0x7f141006ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1000199105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14100717e0 0x7f1410141c00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- 172.21.15.157:0/1000199105 >> 172.21.15.157:0/1000199105 conn(0x7f14100b12d0 msgr2=0x7f141006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:35.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- 172.21.15.157:0/1000199105 shutdown_connections 2024-04-18T03:41:35.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- 172.21.15.157:0/1000199105 wait complete. 2024-04-18T03:41:35.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 Processor -- start 2024-04-18T03:41:35.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- start start 2024-04-18T03:41:35.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f141006e810 0x7f1410135320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14100717e0 0x7f1410138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14101414e0 0x7f141014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141014cb00 con 0x7f141006e810 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141014be80 con 0x7f14101414e0 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.410+0000 7f1415c0b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141014c160 con 0x7f14100717e0 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f141006e810 0x7f1410135320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f141006e810 0x7f1410135320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57970/0 (socket says 172.21.15.157:57970) 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 -- 172.21.15.157:0/1034009575 learned_addr learned my addr 172.21.15.157:0/1034009575 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f141540a700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14101414e0 0x7f141014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f140ffff700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14100717e0 0x7f1410138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 -- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14100717e0 msgr2=0x7f1410138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14100717e0 0x7f1410138a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 -- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14101414e0 msgr2=0x7f141014cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14101414e0 0x7f141014cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 -- 172.21.15.157:0/1034009575 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f80094b0 con 0x7f141006e810 2024-04-18T03:41:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1414c09700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f141006e810 0x7f1410135320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f14000019b0 tx=0x7f140000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f140d7fa700 1 -- 172.21.15.157:0/1034009575 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000acd0 con 0x7f141006e810 2024-04-18T03:41:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f140d7fa700 1 -- 172.21.15.157:0/1034009575 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140000ae30 con 0x7f141006e810 2024-04-18T03:41:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141014c440 con 0x7f141006e810 2024-04-18T03:41:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f140d7fa700 1 -- 172.21.15.157:0/1034009575 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400007310 con 0x7f141006e810 2024-04-18T03:41:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1410135860 con 0x7f141006e810 2024-04-18T03:41:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.414+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141014cd70 con 0x7f141006e810 2024-04-18T03:41:35.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.418+0000 7f140d7fa700 1 -- 172.21.15.157:0/1034009575 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1400007470 con 0x7f141006e810 2024-04-18T03:41:35.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.418+0000 7f140d7fa700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f13f0066730 0x7f13f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.418+0000 7f140d7fa700 1 -- 172.21.15.157:0/1034009575 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f14000844a0 con 0x7f141006e810 2024-04-18T03:41:35.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.418+0000 7f140ffff700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f13f0066730 0x7f13f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.418+0000 7f140ffff700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f13f0066730 0x7f13f0068bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f13f80090b0 tx=0x7f13f8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.422+0000 7f140d7fa700 1 -- 172.21.15.157:0/1034009575 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f14000513b0 con 0x7f141006e810 2024-04-18T03:41:35.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.594+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1410142650 con 0x7f13f0066730 2024-04-18T03:41:35.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.594+0000 7f140d7fa700 1 -- 172.21.15.157:0/1034009575 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f13f80044c0 con 0x7f13f0066730 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f13f0066730 msgr2=0x7f13f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f13f0066730 0x7f13f0068bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f13f80090b0 tx=0x7f13f8008030 comp rx=0 tx=0).stop 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f141006e810 msgr2=0x7f1410135320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f141006e810 0x7f1410135320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f14000019b0 tx=0x7f140000a340 comp rx=0 tx=0).stop 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 shutdown_connections 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f13f0066730 0x7f13f0068bf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14101414e0 0x7f141014cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14100717e0 0x7f1410138a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 --2- 172.21.15.157:0/1034009575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f141006e810 0x7f1410135320 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 >> 172.21.15.157:0/1034009575 conn(0x7f14100b12d0 msgr2=0x7f1410143fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 shutdown_connections 2024-04-18T03:41:35.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.598+0000 7f1415c0b700 1 -- 172.21.15.157:0/1034009575 wait complete. 2024-04-18T03:41:35.604 INFO:teuthology.orchestra.run.smithi157.stderr:instructed osd(s) 7 to deep-scrub 2024-04-18T03:41:35.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:41:35.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.718+0000 7f04f759e700 1 Processor -- start 2024-04-18T03:41:35.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.718+0000 7f04f759e700 1 -- start start 2024-04-18T03:41:35.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.718+0000 7f04f759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f0057080 0x7f04f0057460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.718+0000 7f04f759e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f00582a0 con 0x7f04f0058a20 2024-04-18T03:41:35.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f00070d0 con 0x7f04f00e34d0 2024-04-18T03:41:35.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00579a0 con 0x7f04f0057080 2024-04-18T03:41:35.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f6d9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f04f0058a20 0x7f04f00069c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:59700/0 (socket says 172.21.15.157:59700) 2024-04-18T03:41:35.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f6d9d700 1 -- 172.21.15.157:0/931482201 learned_addr learned my addr 172.21.15.157:0/931482201 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:41:35.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f659c700 1 --2- 172.21.15.157:0/931482201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f0057080 0x7f04f0057460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f559a700 1 -- 172.21.15.157:0/931482201 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293217918 0 0) 0x7f04f00582a0 con 0x7f04f0058a20 2024-04-18T03:41:35.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f559a700 1 -- 172.21.15.157:0/931482201 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04e40035d0 con 0x7f04f0058a20 2024-04-18T03:41:35.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f559a700 1 -- 172.21.15.157:0/931482201 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814479607 0 0) 0x7f04f00070d0 con 0x7f04f00e34d0 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f559a700 1 -- 172.21.15.157:0/931482201 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f00582a0 con 0x7f04f00e34d0 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f559a700 1 -- 172.21.15.157:0/931482201 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 317333291 0 0) 0x7f04e40035d0 con 0x7f04f0058a20 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f659c700 1 -- 172.21.15.157:0/931482201 >> v1:172.21.15.175:6789/0 conn(0x7f04f00e34d0 legacy=0x7f04f00062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f659c700 1 -- 172.21.15.157:0/931482201 >> v1:172.21.15.157:6789/0 conn(0x7f04f0058a20 legacy=0x7f04f00069c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f659c700 1 -- 172.21.15.157:0/931482201 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0058730 con 0x7f04f0057080 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f659c700 1 --2- 172.21.15.157:0/931482201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f0057080 0x7f04f0057460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f04f804ff20 tx=0x7f04f804eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d875803ab2b983a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f559a700 1 -- 172.21.15.157:0/931482201 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8001670 con 0x7f04f0057080 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f559a700 1 -- 172.21.15.157:0/931482201 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f804ef60 con 0x7f04f0057080 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f559a700 1 -- 172.21.15.157:0/931482201 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80673a0 con 0x7f04f0057080 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 -- 172.21.15.157:0/931482201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f0057080 msgr2=0x7f04f0057460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 --2- 172.21.15.157:0/931482201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f0057080 0x7f04f0057460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f04f804ff20 tx=0x7f04f804eb70 comp rx=0 tx=0).stop 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 -- 172.21.15.157:0/931482201 shutdown_connections 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 --2- 172.21.15.157:0/931482201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f0057080 0x7f04f0057460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 -- 172.21.15.157:0/931482201 >> 172.21.15.157:0/931482201 conn(0x7f04f0055a10 msgr2=0x7f04f0055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:35.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 -- 172.21.15.157:0/931482201 shutdown_connections 2024-04-18T03:41:35.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.722+0000 7f04f759e700 1 -- 172.21.15.157:0/931482201 wait complete. 2024-04-18T03:41:35.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 Processor -- start 2024-04-18T03:41:35.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 -- start start 2024-04-18T03:41:35.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0057080 0x7f04f004f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f0058a20 0x7f04f00e3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00e34d0 0x7f04f00e3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f003b8a0 con 0x7f04f0057080 2024-04-18T03:41:35.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00526c0 con 0x7f04f0058a20 2024-04-18T03:41:35.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f003adc0 con 0x7f04f00e34d0 2024-04-18T03:41:35.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0057080 0x7f04f004f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0057080 0x7f04f004f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:57978/0 (socket says 172.21.15.157:57978) 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 -- 172.21.15.157:0/2253763658 learned_addr learned my addr 172.21.15.157:0/2253763658 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f5d9b700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f0058a20 0x7f04f00e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f6d9d700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00e34d0 0x7f04f00e3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 -- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00e34d0 msgr2=0x7f04f00e3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00e34d0 0x7f04f00e3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 -- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f0058a20 msgr2=0x7f04f00e3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f0058a20 0x7f04f00e3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 -- 172.21.15.157:0/2253763658 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8073ba0 con 0x7f04f0057080 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f659c700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0057080 0x7f04f004f3d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f04f8000b60 tx=0x7f04f8073870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04eeffd700 1 -- 172.21.15.157:0/2253763658 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8066ea0 con 0x7f04f0057080 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04eeffd700 1 -- 172.21.15.157:0/2253763658 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8066260 con 0x7f04f0057080 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f003b0a0 con 0x7f04f0057080 2024-04-18T03:41:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04eeffd700 1 -- 172.21.15.157:0/2253763658 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80665d0 con 0x7f04f0057080 2024-04-18T03:41:35.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.726+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f003aa90 con 0x7f04f0057080 2024-04-18T03:41:35.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.730+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f003ac20 con 0x7f04f0057080 2024-04-18T03:41:35.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.730+0000 7f04eeffd700 1 -- 172.21.15.157:0/2253763658 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04f8072200 con 0x7f04f0057080 2024-04-18T03:41:35.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.730+0000 7f04eeffd700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d8066730 0x7f04d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:35.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.730+0000 7f04eeffd700 1 -- 172.21.15.157:0/2253763658 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f04f80ff990 con 0x7f04f0057080 2024-04-18T03:41:35.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.730+0000 7f04f5d9b700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d8066730 0x7f04d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:35.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.730+0000 7f04f5d9b700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d8066730 0x7f04d8068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f04f00df4f0 tx=0x7f04e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.734+0000 7f04eeffd700 1 -- 172.21.15.157:0/2253763658 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f04f003ac20 con 0x7f04f0057080 2024-04-18T03:41:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.898+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04f0057f30 con 0x7f04d8066730 2024-04-18T03:41:35.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.918+0000 7f04eeffd700 1 -- 172.21.15.157:0/2253763658 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367759 (secure 0 0 0) 0x7f04e00013e0 con 0x7f04d8066730 2024-04-18T03:41:35.929 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d8066730 msgr2=0x7f04d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d8066730 0x7f04d8068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f04f00df4f0 tx=0x7f04e0009040 comp rx=0 tx=0).stop 2024-04-18T03:41:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0057080 msgr2=0x7f04f004f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0057080 0x7f04f004f3d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f04f8000b60 tx=0x7f04f8073870 comp rx=0 tx=0).stop 2024-04-18T03:41:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 shutdown_connections 2024-04-18T03:41:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f04d8066730 0x7f04d8068bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f0058a20 0x7f04f00e3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f00e34d0 0x7f04f00e3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 --2- 172.21.15.157:0/2253763658 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0057080 0x7f04f004f3d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 >> 172.21.15.157:0/2253763658 conn(0x7f04f0055a10 msgr2=0x7f04f0037ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 shutdown_connections 2024-04-18T03:41:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:35.926+0000 7f04f759e700 1 -- 172.21.15.157:0/2253763658 wait complete. 2024-04-18T03:41:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:41:35.945 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-04-18T03:41:35.861083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31730824,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":488,"num_write":3272,"num_write_kb":34003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8652,"ondisk_log_size":8652,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":333616,"kb_used_data":64240,"kb_used_omap":12,"kb_used_meta":269299,"kb_avail":754641104,"statfs":{"total":773094113280,"available":772752490496,"internally_reserved":0,"allocated":65781760,"data_stored":64389399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":275762744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005218"},"pg_stats":[{"pgid":"2.1f","version":"27'41","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.603517+0000","last_change":"2024-04-18T03:37:33.922528+0000","last_active":"2024-04-18T03:40:39.603517+0000","last_peered":"2024-04-18T03:40:39.603517+0000","last_clean":"2024-04-18T03:40:39.603517+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:40:39.603517+0000","last_undegraded":"2024-04-18T03:40:39.603517+0000","last_fullsized":"2024-04-18T03:40:39.603517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551062+0000","last_change":"2024-04-18T03:37:34.316836+0000","last_active":"2024-04-18T03:40:52.551062+0000","last_peered":"2024-04-18T03:40:52.551062+0000","last_clean":"2024-04-18T03:40:52.551062+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:40:52.551062+0000","last_undegraded":"2024-04-18T03:40:52.551062+0000","last_fullsized":"2024-04-18T03:40:52.551062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'49","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845576+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:40:47.845576+0000","last_peered":"2024-04-18T03:40:47.845576+0000","last_clean":"2024-04-18T03:40:47.845576+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:40:47.845576+0000","last_undegraded":"2024-04-18T03:40:47.845576+0000","last_fullsized":"2024-04-18T03:40:47.845576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:51:07.334398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'30","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.112956+0000","last_change":"2024-04-18T03:37:33.925462+0000","last_active":"2024-04-18T03:40:42.112956+0000","last_peered":"2024-04-18T03:40:42.112956+0000","last_clean":"2024-04-18T03:40:42.112956+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:40:42.112956+0000","last_undegraded":"2024-04-18T03:40:42.112956+0000","last_fullsized":"2024-04-18T03:40:42.112956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:23.795590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'57","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553197+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:40:52.553197+0000","last_peered":"2024-04-18T03:40:52.553197+0000","last_clean":"2024-04-18T03:40:52.553197+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:40:52.553197+0000","last_undegraded":"2024-04-18T03:40:52.553197+0000","last_fullsized":"2024-04-18T03:40:52.553197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851456+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:40:47.851456+0000","last_peered":"2024-04-18T03:40:47.851456+0000","last_clean":"2024-04-18T03:40:47.851456+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:40:47.851456+0000","last_undegraded":"2024-04-18T03:40:47.851456+0000","last_fullsized":"2024-04-18T03:40:47.851456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:21.165771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'64","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:12.605809+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:41:12.605809+0000","last_peered":"2024-04-18T03:41:12.605809+0000","last_clean":"2024-04-18T03:41:12.605809+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:41:12.605809+0000","last_undegraded":"2024-04-18T03:41:12.605809+0000","last_fullsized":"2024-04-18T03:41:12.605809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604669,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562731+0000","last_change":"2024-04-18T03:37:34.306151+0000","last_active":"2024-04-18T03:40:52.562731+0000","last_peered":"2024-04-18T03:40:52.562731+0000","last_clean":"2024-04-18T03:40:52.562731+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:40:52.562731+0000","last_undegraded":"2024-04-18T03:40:52.562731+0000","last_fullsized":"2024-04-18T03:40:52.562731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'44","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847304+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:40:47.847304+0000","last_peered":"2024-04-18T03:40:47.847304+0000","last_clean":"2024-04-18T03:40:47.847304+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:40:47.847304+0000","last_undegraded":"2024-04-18T03:40:47.847304+0000","last_fullsized":"2024-04-18T03:40:47.847304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:39:28.117583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.587521+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:40:39.587521+0000","last_peered":"2024-04-18T03:40:39.587521+0000","last_clean":"2024-04-18T03:40:39.587521+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:40:39.587521+0000","last_undegraded":"2024-04-18T03:40:39.587521+0000","last_fullsized":"2024-04-18T03:40:39.587521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:12.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559721+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:40:52.559721+0000","last_peered":"2024-04-18T03:40:52.559721+0000","last_clean":"2024-04-18T03:40:52.559721+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:40:52.559721+0000","last_undegraded":"2024-04-18T03:40:52.559721+0000","last_fullsized":"2024-04-18T03:40:52.559721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'40","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847344+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:40:47.847344+0000","last_peered":"2024-04-18T03:40:47.847344+0000","last_clean":"2024-04-18T03:40:47.847344+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:40:47.847344+0000","last_undegraded":"2024-04-18T03:40:47.847344+0000","last_fullsized":"2024-04-18T03:40:47.847344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:29:44.713922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'42","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.542046+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:40:52.542046+0000","last_peered":"2024-04-18T03:40:52.542046+0000","last_clean":"2024-04-18T03:40:52.542046+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:40:52.542046+0000","last_undegraded":"2024-04-18T03:40:52.542046+0000","last_fullsized":"2024-04-18T03:40:52.542046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:10.342925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'527","reported_seq":545,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598960+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:40:39.598960+0000","last_peered":"2024-04-18T03:40:39.598960+0000","last_clean":"2024-04-18T03:40:39.598960+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:40:39.598960+0000","last_undegraded":"2024-04-18T03:40:39.598960+0000","last_fullsized":"2024-04-18T03:40:39.598960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:49:08.677666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'41","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838531+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:40:47.838531+0000","last_peered":"2024-04-18T03:40:47.838531+0000","last_clean":"2024-04-18T03:40:47.838531+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:40:47.838531+0000","last_undegraded":"2024-04-18T03:40:47.838531+0000","last_fullsized":"2024-04-18T03:40:47.838531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:09:17.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543775+0000","last_change":"2024-04-18T03:38:23.517111+0000","last_active":"2024-04-18T03:40:52.543775+0000","last_peered":"2024-04-18T03:40:52.543775+0000","last_clean":"2024-04-18T03:40:52.543775+0000","last_became_active":"2024-04-18T03:38:23.516790+0000","last_became_peered":"2024-04-18T03:38:23.516790+0000","last_unstale":"2024-04-18T03:40:52.543775+0000","last_undegraded":"2024-04-18T03:40:52.543775+0000","last_fullsized":"2024-04-18T03:40:52.543775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"27'31","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.600169+0000","last_change":"2024-04-18T03:37:33.928257+0000","last_active":"2024-04-18T03:40:39.600169+0000","last_peered":"2024-04-18T03:40:39.600169+0000","last_clean":"2024-04-18T03:40:39.600169+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:40:39.600169+0000","last_undegraded":"2024-04-18T03:40:39.600169+0000","last_fullsized":"2024-04-18T03:40:39.600169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'48","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838662+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:40:47.838662+0000","last_peered":"2024-04-18T03:40:47.838662+0000","last_clean":"2024-04-18T03:40:47.838662+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:40:47.838662+0000","last_undegraded":"2024-04-18T03:40:47.838662+0000","last_fullsized":"2024-04-18T03:40:47.838662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:19.158310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552324+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:40:52.552324+0000","last_peered":"2024-04-18T03:40:52.552324+0000","last_clean":"2024-04-18T03:40:52.552324+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:40:52.552324+0000","last_undegraded":"2024-04-18T03:40:52.552324+0000","last_fullsized":"2024-04-18T03:40:52.552324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:15:10.489560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'28","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.723913+0000","last_change":"2024-04-18T03:37:33.921368+0000","last_active":"2024-04-18T03:40:49.723913+0000","last_peered":"2024-04-18T03:40:49.723913+0000","last_clean":"2024-04-18T03:40:49.723913+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:40:49.723913+0000","last_undegraded":"2024-04-18T03:40:49.723913+0000","last_fullsized":"2024-04-18T03:40:49.723913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'40","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857485+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:40:47.857485+0000","last_peered":"2024-04-18T03:40:47.857485+0000","last_clean":"2024-04-18T03:40:47.857485+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:40:47.857485+0000","last_undegraded":"2024-04-18T03:40:47.857485+0000","last_fullsized":"2024-04-18T03:40:47.857485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.524278+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:40:52.524278+0000","last_peered":"2024-04-18T03:40:52.524278+0000","last_clean":"2024-04-18T03:40:52.524278+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:40:52.524278+0000","last_undegraded":"2024-04-18T03:40:52.524278+0000","last_fullsized":"2024-04-18T03:40:52.524278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:51:55.630435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.595207+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:40:39.595207+0000","last_peered":"2024-04-18T03:40:39.595207+0000","last_clean":"2024-04-18T03:40:39.595207+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:40:39.595207+0000","last_undegraded":"2024-04-18T03:40:39.595207+0000","last_fullsized":"2024-04-18T03:40:39.595207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:07:09.652439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'42","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845971+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:40:47.845971+0000","last_peered":"2024-04-18T03:40:47.845971+0000","last_clean":"2024-04-18T03:40:47.845971+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:40:47.845971+0000","last_undegraded":"2024-04-18T03:40:47.845971+0000","last_fullsized":"2024-04-18T03:40:47.845971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:57:24.297450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'58","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549615+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:40:52.549615+0000","last_peered":"2024-04-18T03:40:52.549615+0000","last_clean":"2024-04-18T03:40:52.549615+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:40:52.549615+0000","last_undegraded":"2024-04-18T03:40:52.549615+0000","last_fullsized":"2024-04-18T03:40:52.549615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'26","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.731034+0000","last_change":"2024-04-18T03:37:33.929905+0000","last_active":"2024-04-18T03:40:49.731034+0000","last_peered":"2024-04-18T03:40:49.731034+0000","last_clean":"2024-04-18T03:40:49.731034+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:40:49.731034+0000","last_undegraded":"2024-04-18T03:40:49.731034+0000","last_fullsized":"2024-04-18T03:40:49.731034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:09:27.726080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'46","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.849762+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:40:47.849762+0000","last_peered":"2024-04-18T03:40:47.849762+0000","last_clean":"2024-04-18T03:40:47.849762+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:40:47.849762+0000","last_undegraded":"2024-04-18T03:40:47.849762+0000","last_fullsized":"2024-04-18T03:40:47.849762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:43:31.953404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559720+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:40:52.559720+0000","last_peered":"2024-04-18T03:40:52.559720+0000","last_clean":"2024-04-18T03:40:52.559720+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:40:52.559720+0000","last_undegraded":"2024-04-18T03:40:52.559720+0000","last_fullsized":"2024-04-18T03:40:52.559720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:57:16.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'38","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:53.065330+0000","last_change":"2024-04-18T03:37:33.932828+0000","last_active":"2024-04-18T03:40:53.065330+0000","last_peered":"2024-04-18T03:40:53.065330+0000","last_clean":"2024-04-18T03:40:53.065330+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:40:53.065330+0000","last_undegraded":"2024-04-18T03:40:53.065330+0000","last_fullsized":"2024-04-18T03:40:53.065330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'51","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.815270+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:40:47.815270+0000","last_peered":"2024-04-18T03:40:47.815270+0000","last_clean":"2024-04-18T03:40:47.815270+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:40:47.815270+0000","last_undegraded":"2024-04-18T03:40:47.815270+0000","last_fullsized":"2024-04-18T03:40:47.815270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:45.707050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'45","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549765+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:40:52.549765+0000","last_peered":"2024-04-18T03:40:52.549765+0000","last_clean":"2024-04-18T03:40:52.549765+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:40:52.549765+0000","last_undegraded":"2024-04-18T03:40:52.549765+0000","last_fullsized":"2024-04-18T03:40:52.549765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'28","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.591466+0000","last_change":"2024-04-18T03:37:33.924320+0000","last_active":"2024-04-18T03:40:39.591466+0000","last_peered":"2024-04-18T03:40:39.591466+0000","last_clean":"2024-04-18T03:40:39.591466+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:40:39.591466+0000","last_undegraded":"2024-04-18T03:40:39.591466+0000","last_fullsized":"2024-04-18T03:40:39.591466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'43","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.854826+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:40:47.854826+0000","last_peered":"2024-04-18T03:40:47.854826+0000","last_clean":"2024-04-18T03:40:47.854826+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:40:47.854826+0000","last_undegraded":"2024-04-18T03:40:47.854826+0000","last_fullsized":"2024-04-18T03:40:47.854826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547280+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:40:52.547280+0000","last_peered":"2024-04-18T03:40:52.547280+0000","last_clean":"2024-04-18T03:40:52.547280+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:40:52.547280+0000","last_undegraded":"2024-04-18T03:40:52.547280+0000","last_fullsized":"2024-04-18T03:40:52.547280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'22","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.597615+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:40:39.597615+0000","last_peered":"2024-04-18T03:40:39.597615+0000","last_clean":"2024-04-18T03:40:39.597615+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:40:39.597615+0000","last_undegraded":"2024-04-18T03:40:39.597615+0000","last_fullsized":"2024-04-18T03:40:39.597615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'45","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.808005+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:40:47.808005+0000","last_peered":"2024-04-18T03:40:47.808005+0000","last_clean":"2024-04-18T03:40:47.808005+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:40:47.808005+0000","last_undegraded":"2024-04-18T03:40:47.808005+0000","last_fullsized":"2024-04-18T03:40:47.808005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549805+0000","last_change":"2024-04-18T03:37:34.308669+0000","last_active":"2024-04-18T03:40:52.549805+0000","last_peered":"2024-04-18T03:40:52.549805+0000","last_clean":"2024-04-18T03:40:52.549805+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:40:52.549805+0000","last_undegraded":"2024-04-18T03:40:52.549805+0000","last_fullsized":"2024-04-18T03:40:52.549805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:07.525115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598437+0000","last_change":"2024-04-18T03:37:33.921017+0000","last_active":"2024-04-18T03:40:39.598437+0000","last_peered":"2024-04-18T03:40:39.598437+0000","last_clean":"2024-04-18T03:40:39.598437+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:40:39.598437+0000","last_undegraded":"2024-04-18T03:40:39.598437+0000","last_fullsized":"2024-04-18T03:40:39.598437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'43","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857418+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:40:47.857418+0000","last_peered":"2024-04-18T03:40:47.857418+0000","last_clean":"2024-04-18T03:40:47.857418+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:40:47.857418+0000","last_undegraded":"2024-04-18T03:40:47.857418+0000","last_fullsized":"2024-04-18T03:40:47.857418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'45","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543889+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:40:52.543889+0000","last_peered":"2024-04-18T03:40:52.543889+0000","last_clean":"2024-04-18T03:40:52.543889+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:40:52.543889+0000","last_undegraded":"2024-04-18T03:40:52.543889+0000","last_fullsized":"2024-04-18T03:40:52.543889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'73","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.684345+0000","last_change":"2024-04-18T03:37:33.916761+0000","last_active":"2024-04-18T03:40:52.684345+0000","last_peered":"2024-04-18T03:40:52.684345+0000","last_clean":"2024-04-18T03:40:52.684345+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:40:52.684345+0000","last_undegraded":"2024-04-18T03:40:52.684345+0000","last_fullsized":"2024-04-18T03:40:52.684345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":44,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'49","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.808150+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:40:47.808150+0000","last_peered":"2024-04-18T03:40:47.808150+0000","last_clean":"2024-04-18T03:40:47.808150+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:40:47.808150+0000","last_undegraded":"2024-04-18T03:40:47.808150+0000","last_fullsized":"2024-04-18T03:40:47.808150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'43","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543325+0000","last_change":"2024-04-18T03:37:34.301044+0000","last_active":"2024-04-18T03:40:52.543325+0000","last_peered":"2024-04-18T03:40:52.543325+0000","last_clean":"2024-04-18T03:40:52.543325+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:40:52.543325+0000","last_undegraded":"2024-04-18T03:40:52.543325+0000","last_fullsized":"2024-04-18T03:40:52.543325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'21","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599677+0000","last_change":"2024-04-18T03:37:33.922934+0000","last_active":"2024-04-18T03:40:39.599677+0000","last_peered":"2024-04-18T03:40:39.599677+0000","last_clean":"2024-04-18T03:40:39.599677+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:40:39.599677+0000","last_undegraded":"2024-04-18T03:40:39.599677+0000","last_fullsized":"2024-04-18T03:40:39.599677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:33:21.818428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'40","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845419+0000","last_change":"2024-04-18T03:38:23.756539+0000","last_active":"2024-04-18T03:40:47.845419+0000","last_peered":"2024-04-18T03:40:47.845419+0000","last_clean":"2024-04-18T03:40:47.845419+0000","last_became_active":"2024-04-18T03:38:23.755354+0000","last_became_peered":"2024-04-18T03:38:23.755354+0000","last_unstale":"2024-04-18T03:40:47.845419+0000","last_undegraded":"2024-04-18T03:40:47.845419+0000","last_fullsized":"2024-04-18T03:40:47.845419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'57","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561718+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:40:52.561718+0000","last_peered":"2024-04-18T03:40:52.561718+0000","last_clean":"2024-04-18T03:40:52.561718+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:40:52.561718+0000","last_undegraded":"2024-04-18T03:40:52.561718+0000","last_fullsized":"2024-04-18T03:40:52.561718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:55:55.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599918+0000","last_change":"2024-04-18T03:37:33.919255+0000","last_active":"2024-04-18T03:40:39.599918+0000","last_peered":"2024-04-18T03:40:39.599918+0000","last_clean":"2024-04-18T03:40:39.599918+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:40:39.599918+0000","last_undegraded":"2024-04-18T03:40:39.599918+0000","last_fullsized":"2024-04-18T03:40:39.599918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:21:12.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:39:32.807378+0000","last_change":"2024-04-18T03:37:28.881821+0000","last_active":"2024-04-18T03:39:32.807378+0000","last_peered":"2024-04-18T03:39:32.807378+0000","last_clean":"2024-04-18T03:39:32.807378+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:39:32.807378+0000","last_undegraded":"2024-04-18T03:39:32.807378+0000","last_fullsized":"2024-04-18T03:39:32.807378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:27.828246+0000","last_clean_scrub_stamp":"2024-04-18T03:37:27.828246+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:56:15.432319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'35","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.829690+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:40:47.829690+0000","last_peered":"2024-04-18T03:40:47.829690+0000","last_clean":"2024-04-18T03:40:47.829690+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:40:47.829690+0000","last_undegraded":"2024-04-18T03:40:47.829690+0000","last_fullsized":"2024-04-18T03:40:47.829690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:39:46.375162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562621+0000","last_change":"2024-04-18T03:37:34.308036+0000","last_active":"2024-04-18T03:40:52.562621+0000","last_peered":"2024-04-18T03:40:52.562621+0000","last_clean":"2024-04-18T03:40:52.562621+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:40:52.562621+0000","last_undegraded":"2024-04-18T03:40:52.562621+0000","last_fullsized":"2024-04-18T03:40:52.562621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'29","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.601414+0000","last_change":"2024-04-18T03:37:33.922748+0000","last_active":"2024-04-18T03:40:39.601414+0000","last_peered":"2024-04-18T03:40:39.601414+0000","last_clean":"2024-04-18T03:40:39.601414+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:40:39.601414+0000","last_undegraded":"2024-04-18T03:40:39.601414+0000","last_fullsized":"2024-04-18T03:40:39.601414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'34","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.823501+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:40:47.823501+0000","last_peered":"2024-04-18T03:40:47.823501+0000","last_clean":"2024-04-18T03:40:47.823501+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:40:47.823501+0000","last_undegraded":"2024-04-18T03:40:47.823501+0000","last_fullsized":"2024-04-18T03:40:47.823501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:19:02.179174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560420+0000","last_change":"2024-04-18T03:37:34.300176+0000","last_active":"2024-04-18T03:40:52.560420+0000","last_peered":"2024-04-18T03:40:52.560420+0000","last_clean":"2024-04-18T03:40:52.560420+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:40:52.560420+0000","last_undegraded":"2024-04-18T03:40:52.560420+0000","last_fullsized":"2024-04-18T03:40:52.560420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'24","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.600610+0000","last_change":"2024-04-18T03:37:33.916221+0000","last_active":"2024-04-18T03:40:39.600610+0000","last_peered":"2024-04-18T03:40:39.600610+0000","last_clean":"2024-04-18T03:40:39.600610+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:40:39.600610+0000","last_undegraded":"2024-04-18T03:40:39.600610+0000","last_fullsized":"2024-04-18T03:40:39.600610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'55","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856937+0000","last_change":"2024-04-18T03:38:23.707932+0000","last_active":"2024-04-18T03:40:47.856937+0000","last_peered":"2024-04-18T03:40:47.856937+0000","last_clean":"2024-04-18T03:40:47.856937+0000","last_became_active":"2024-04-18T03:38:23.706819+0000","last_became_peered":"2024-04-18T03:38:23.706819+0000","last_unstale":"2024-04-18T03:40:47.856937+0000","last_undegraded":"2024-04-18T03:40:47.856937+0000","last_fullsized":"2024-04-18T03:40:47.856937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561853+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:40:52.561853+0000","last_peered":"2024-04-18T03:40:52.561853+0000","last_clean":"2024-04-18T03:40:52.561853+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:40:52.561853+0000","last_undegraded":"2024-04-18T03:40:52.561853+0000","last_fullsized":"2024-04-18T03:40:52.561853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.596947+0000","last_change":"2024-04-18T03:37:33.923743+0000","last_active":"2024-04-18T03:40:39.596947+0000","last_peered":"2024-04-18T03:40:39.596947+0000","last_clean":"2024-04-18T03:40:39.596947+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:40:39.596947+0000","last_undegraded":"2024-04-18T03:40:39.596947+0000","last_fullsized":"2024-04-18T03:40:39.596947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'50","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.853932+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:40:47.853932+0000","last_peered":"2024-04-18T03:40:47.853932+0000","last_clean":"2024-04-18T03:40:47.853932+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:40:47.853932+0000","last_undegraded":"2024-04-18T03:40:47.853932+0000","last_fullsized":"2024-04-18T03:40:47.853932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:26:14.663224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'39","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.544372+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:40:52.544372+0000","last_peered":"2024-04-18T03:40:52.544372+0000","last_clean":"2024-04-18T03:40:52.544372+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:40:52.544372+0000","last_undegraded":"2024-04-18T03:40:52.544372+0000","last_fullsized":"2024-04-18T03:40:52.544372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:48:11.621234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'23","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599132+0000","last_change":"2024-04-18T03:37:33.923624+0000","last_active":"2024-04-18T03:40:39.599132+0000","last_peered":"2024-04-18T03:40:39.599132+0000","last_clean":"2024-04-18T03:40:39.599132+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:40:39.599132+0000","last_undegraded":"2024-04-18T03:40:39.599132+0000","last_fullsized":"2024-04-18T03:40:39.599132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:30:29.619675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'47","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.830977+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:40:47.830977+0000","last_peered":"2024-04-18T03:40:47.830977+0000","last_clean":"2024-04-18T03:40:47.830977+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:40:47.830977+0000","last_undegraded":"2024-04-18T03:40:47.830977+0000","last_fullsized":"2024-04-18T03:40:47.830977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:42:56.306731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.539345+0000","last_change":"2024-04-18T03:37:34.304075+0000","last_active":"2024-04-18T03:40:52.539345+0000","last_peered":"2024-04-18T03:40:52.539345+0000","last_clean":"2024-04-18T03:40:52.539345+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:40:52.539345+0000","last_undegraded":"2024-04-18T03:40:52.539345+0000","last_fullsized":"2024-04-18T03:40:52.539345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'33","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.692279+0000","last_change":"2024-04-18T03:37:33.917032+0000","last_active":"2024-04-18T03:40:50.692279+0000","last_peered":"2024-04-18T03:40:50.692279+0000","last_clean":"2024-04-18T03:40:50.692279+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:40:50.692279+0000","last_undegraded":"2024-04-18T03:40:50.692279+0000","last_fullsized":"2024-04-18T03:40:50.692279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:25:23.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'54","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.852078+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:40:47.852078+0000","last_peered":"2024-04-18T03:40:47.852078+0000","last_clean":"2024-04-18T03:40:47.852078+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:40:47.852078+0000","last_undegraded":"2024-04-18T03:40:47.852078+0000","last_fullsized":"2024-04-18T03:40:47.852078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545077+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:40:52.545077+0000","last_peered":"2024-04-18T03:40:52.545077+0000","last_clean":"2024-04-18T03:40:52.545077+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:40:52.545077+0000","last_undegraded":"2024-04-18T03:40:52.545077+0000","last_fullsized":"2024-04-18T03:40:52.545077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:52:42.850349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'30","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.638004+0000","last_change":"2024-04-18T03:37:33.930343+0000","last_active":"2024-04-18T03:40:42.638004+0000","last_peered":"2024-04-18T03:40:42.638004+0000","last_clean":"2024-04-18T03:40:42.638004+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:40:42.638004+0000","last_undegraded":"2024-04-18T03:40:42.638004+0000","last_fullsized":"2024-04-18T03:40:42.638004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:16:09.651701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'43","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.839352+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:40:47.839352+0000","last_peered":"2024-04-18T03:40:47.839352+0000","last_clean":"2024-04-18T03:40:47.839352+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:40:47.839352+0000","last_undegraded":"2024-04-18T03:40:47.839352+0000","last_fullsized":"2024-04-18T03:40:47.839352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:57.028939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'63","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562675+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:40:52.562675+0000","last_peered":"2024-04-18T03:40:52.562675+0000","last_clean":"2024-04-18T03:40:52.562675+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:40:52.562675+0000","last_undegraded":"2024-04-18T03:40:52.562675+0000","last_fullsized":"2024-04-18T03:40:52.562675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:21.392591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'35","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:42.657282+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:40:42.657282+0000","last_peered":"2024-04-18T03:40:42.657282+0000","last_clean":"2024-04-18T03:40:42.657282+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:40:42.657282+0000","last_undegraded":"2024-04-18T03:40:42.657282+0000","last_fullsized":"2024-04-18T03:40:42.657282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:58:56.175024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'34","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.839304+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:40:47.839304+0000","last_peered":"2024-04-18T03:40:47.839304+0000","last_clean":"2024-04-18T03:40:47.839304+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:40:47.839304+0000","last_undegraded":"2024-04-18T03:40:47.839304+0000","last_fullsized":"2024-04-18T03:40:47.839304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:00:18.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'43","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563442+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:40:52.563442+0000","last_peered":"2024-04-18T03:40:52.563442+0000","last_clean":"2024-04-18T03:40:52.563442+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:40:52.563442+0000","last_undegraded":"2024-04-18T03:40:52.563442+0000","last_fullsized":"2024-04-18T03:40:52.563442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'17","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.141866+0000","last_change":"2024-04-18T03:37:33.927394+0000","last_active":"2024-04-18T03:40:47.141866+0000","last_peered":"2024-04-18T03:40:47.141866+0000","last_clean":"2024-04-18T03:40:47.141866+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:40:47.141866+0000","last_undegraded":"2024-04-18T03:40:47.141866+0000","last_fullsized":"2024-04-18T03:40:47.141866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'38","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.823050+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:40:47.823050+0000","last_peered":"2024-04-18T03:40:47.823050+0000","last_clean":"2024-04-18T03:40:47.823050+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:40:47.823050+0000","last_undegraded":"2024-04-18T03:40:47.823050+0000","last_fullsized":"2024-04-18T03:40:47.823050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:59:08.435358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562533+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:40:52.562533+0000","last_peered":"2024-04-18T03:40:52.562533+0000","last_clean":"2024-04-18T03:40:52.562533+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:40:52.562533+0000","last_undegraded":"2024-04-18T03:40:52.562533+0000","last_fullsized":"2024-04-18T03:40:52.562533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:16:02.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'909","reported_seq":927,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:02.522993+0000","last_change":"2024-04-18T03:37:33.929970+0000","last_active":"2024-04-18T03:41:02.522993+0000","last_peered":"2024-04-18T03:41:02.522993+0000","last_clean":"2024-04-18T03:41:02.522993+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:41:02.522993+0000","last_undegraded":"2024-04-18T03:41:02.522993+0000","last_fullsized":"2024-04-18T03:41:02.522993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:43:54.472626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'43","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.854048+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:40:47.854048+0000","last_peered":"2024-04-18T03:40:47.854048+0000","last_clean":"2024-04-18T03:40:47.854048+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:40:47.854048+0000","last_undegraded":"2024-04-18T03:40:47.854048+0000","last_fullsized":"2024-04-18T03:40:47.854048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.539661+0000","last_change":"2024-04-18T03:37:34.299294+0000","last_active":"2024-04-18T03:40:52.539661+0000","last_peered":"2024-04-18T03:40:52.539661+0000","last_clean":"2024-04-18T03:40:52.539661+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:40:52.539661+0000","last_undegraded":"2024-04-18T03:40:52.539661+0000","last_fullsized":"2024-04-18T03:40:52.539661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:44:10.767359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'48","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.691582+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:40:52.691582+0000","last_peered":"2024-04-18T03:40:52.691582+0000","last_clean":"2024-04-18T03:40:52.691582+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:40:52.691582+0000","last_undegraded":"2024-04-18T03:40:52.691582+0000","last_fullsized":"2024-04-18T03:40:52.691582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'45","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.840857+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:40:47.840857+0000","last_peered":"2024-04-18T03:40:47.840857+0000","last_clean":"2024-04-18T03:40:47.840857+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:40:47.840857+0000","last_undegraded":"2024-04-18T03:40:47.840857+0000","last_fullsized":"2024-04-18T03:40:47.840857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:40:51.668813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'50","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553405+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:40:52.553405+0000","last_peered":"2024-04-18T03:40:52.553405+0000","last_clean":"2024-04-18T03:40:52.553405+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:40:52.553405+0000","last_undegraded":"2024-04-18T03:40:52.553405+0000","last_fullsized":"2024-04-18T03:40:52.553405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'24","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599913+0000","last_change":"2024-04-18T03:37:33.931236+0000","last_active":"2024-04-18T03:40:39.599913+0000","last_peered":"2024-04-18T03:40:39.599913+0000","last_clean":"2024-04-18T03:40:39.599913+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:40:39.599913+0000","last_undegraded":"2024-04-18T03:40:39.599913+0000","last_fullsized":"2024-04-18T03:40:39.599913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'39","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843384+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:40:47.843384+0000","last_peered":"2024-04-18T03:40:47.843384+0000","last_clean":"2024-04-18T03:40:47.843384+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:40:47.843384+0000","last_undegraded":"2024-04-18T03:40:47.843384+0000","last_fullsized":"2024-04-18T03:40:47.843384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:35:23.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'73","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561939+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:40:52.561939+0000","last_peered":"2024-04-18T03:40:52.561939+0000","last_clean":"2024-04-18T03:40:52.561939+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:40:52.561939+0000","last_undegraded":"2024-04-18T03:40:52.561939+0000","last_fullsized":"2024-04-18T03:40:52.561939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'23","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598903+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:40:39.598903+0000","last_peered":"2024-04-18T03:40:39.598903+0000","last_clean":"2024-04-18T03:40:39.598903+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:40:39.598903+0000","last_undegraded":"2024-04-18T03:40:39.598903+0000","last_fullsized":"2024-04-18T03:40:39.598903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:47.535682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'42","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.819889+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:40:47.819889+0000","last_peered":"2024-04-18T03:40:47.819889+0000","last_clean":"2024-04-18T03:40:47.819889+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:40:47.819889+0000","last_undegraded":"2024-04-18T03:40:47.819889+0000","last_fullsized":"2024-04-18T03:40:47.819889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:29:14.484508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'43","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.824718+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:40:47.824718+0000","last_peered":"2024-04-18T03:40:47.824718+0000","last_clean":"2024-04-18T03:40:47.824718+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:40:47.824718+0000","last_undegraded":"2024-04-18T03:40:47.824718+0000","last_fullsized":"2024-04-18T03:40:47.824718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'54","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552696+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:40:52.552696+0000","last_peered":"2024-04-18T03:40:52.552696+0000","last_clean":"2024-04-18T03:40:52.552696+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:40:52.552696+0000","last_undegraded":"2024-04-18T03:40:52.552696+0000","last_fullsized":"2024-04-18T03:40:52.552696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'20","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:38.556875+0000","last_change":"2024-04-18T03:37:33.925286+0000","last_active":"2024-04-18T03:40:38.556875+0000","last_peered":"2024-04-18T03:40:38.556875+0000","last_clean":"2024-04-18T03:40:38.556875+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:40:38.556875+0000","last_undegraded":"2024-04-18T03:40:38.556875+0000","last_fullsized":"2024-04-18T03:40:38.556875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:47:41.372183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'50","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.850145+0000","last_change":"2024-04-18T03:38:23.708738+0000","last_active":"2024-04-18T03:40:47.850145+0000","last_peered":"2024-04-18T03:40:47.850145+0000","last_clean":"2024-04-18T03:40:47.850145+0000","last_became_active":"2024-04-18T03:38:23.707524+0000","last_became_peered":"2024-04-18T03:38:23.707524+0000","last_unstale":"2024-04-18T03:40:47.850145+0000","last_undegraded":"2024-04-18T03:40:47.850145+0000","last_fullsized":"2024-04-18T03:40:47.850145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:49:54.313746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'65","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551506+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:40:52.551506+0000","last_peered":"2024-04-18T03:40:52.551506+0000","last_clean":"2024-04-18T03:40:52.551506+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:40:52.551506+0000","last_undegraded":"2024-04-18T03:40:52.551506+0000","last_fullsized":"2024-04-18T03:40:52.551506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:14:23.458329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'19","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.591356+0000","last_change":"2024-04-18T03:37:33.932436+0000","last_active":"2024-04-18T03:40:39.591356+0000","last_peered":"2024-04-18T03:40:39.591356+0000","last_clean":"2024-04-18T03:40:39.591356+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:40:39.591356+0000","last_undegraded":"2024-04-18T03:40:39.591356+0000","last_fullsized":"2024-04-18T03:40:39.591356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:52:11.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'42","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.598520+0000","last_change":"2024-04-18T03:37:33.929695+0000","last_active":"2024-04-18T03:40:39.598520+0000","last_peered":"2024-04-18T03:40:39.598520+0000","last_clean":"2024-04-18T03:40:39.598520+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:40:39.598520+0000","last_undegraded":"2024-04-18T03:40:39.598520+0000","last_fullsized":"2024-04-18T03:40:39.598520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:34:29.848633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'51","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554396+0000","last_change":"2024-04-18T03:37:34.306548+0000","last_active":"2024-04-18T03:40:52.554396+0000","last_peered":"2024-04-18T03:40:52.554396+0000","last_clean":"2024-04-18T03:40:52.554396+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:40:52.554396+0000","last_undegraded":"2024-04-18T03:40:52.554396+0000","last_fullsized":"2024-04-18T03:40:52.554396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.843692+0000","last_change":"2024-04-18T03:37:38.336681+0000","last_active":"2024-04-18T03:40:47.843692+0000","last_peered":"2024-04-18T03:40:47.843692+0000","last_clean":"2024-04-18T03:40:47.843692+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:40:47.843692+0000","last_undegraded":"2024-04-18T03:40:47.843692+0000","last_fullsized":"2024-04-18T03:40:47.843692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:16.022475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1515","reported_seq":1533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.603653+0000","last_change":"2024-04-18T03:37:33.923165+0000","last_active":"2024-04-18T03:40:39.603653+0000","last_peered":"2024-04-18T03:40:39.603653+0000","last_clean":"2024-04-18T03:40:39.603653+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:40:39.603653+0000","last_undegraded":"2024-04-18T03:40:39.603653+0000","last_fullsized":"2024-04-18T03:40:39.603653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":1515,"log_dups_size":0,"ondisk_log_size":1515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:29.170581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1489,"num_write_kb":4584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'44","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.542586+0000","last_change":"2024-04-18T03:37:34.289192+0000","last_active":"2024-04-18T03:40:52.542586+0000","last_peered":"2024-04-18T03:40:52.542586+0000","last_clean":"2024-04-18T03:40:52.542586+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:40:52.542586+0000","last_undegraded":"2024-04-18T03:40:52.542586+0000","last_fullsized":"2024-04-18T03:40:52.542586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:35.397966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'55","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856434+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:40:47.856434+0000","last_peered":"2024-04-18T03:40:47.856434+0000","last_clean":"2024-04-18T03:40:47.856434+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:40:47.856434+0000","last_undegraded":"2024-04-18T03:40:47.856434+0000","last_fullsized":"2024-04-18T03:40:47.856434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:57.245645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'69","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.548740+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:40:52.548740+0000","last_peered":"2024-04-18T03:40:52.548740+0000","last_clean":"2024-04-18T03:40:52.548740+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:40:52.548740+0000","last_undegraded":"2024-04-18T03:40:52.548740+0000","last_fullsized":"2024-04-18T03:40:52.548740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:37:52.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'59","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553815+0000","last_change":"2024-04-18T03:37:34.295362+0000","last_active":"2024-04-18T03:40:52.553815+0000","last_peered":"2024-04-18T03:40:52.553815+0000","last_clean":"2024-04-18T03:40:52.553815+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:40:52.553815+0000","last_undegraded":"2024-04-18T03:40:52.553815+0000","last_fullsized":"2024-04-18T03:40:52.553815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:32:13.360834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554725+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:40:52.554725+0000","last_peered":"2024-04-18T03:40:52.554725+0000","last_clean":"2024-04-18T03:40:52.554725+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:40:52.554725+0000","last_undegraded":"2024-04-18T03:40:52.554725+0000","last_fullsized":"2024-04-18T03:40:52.554725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:12.311403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'52","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553892+0000","last_change":"2024-04-18T03:37:34.305580+0000","last_active":"2024-04-18T03:40:52.553892+0000","last_peered":"2024-04-18T03:40:52.553892+0000","last_clean":"2024-04-18T03:40:52.553892+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:40:52.553892+0000","last_undegraded":"2024-04-18T03:40:52.553892+0000","last_fullsized":"2024-04-18T03:40:52.553892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.550134+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:40:52.550134+0000","last_peered":"2024-04-18T03:40:52.550134+0000","last_clean":"2024-04-18T03:40:52.550134+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:40:52.550134+0000","last_undegraded":"2024-04-18T03:40:52.550134+0000","last_fullsized":"2024-04-18T03:40:52.550134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:01:12.619625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'37","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546362+0000","last_change":"2024-04-18T03:37:34.298453+0000","last_active":"2024-04-18T03:40:52.546362+0000","last_peered":"2024-04-18T03:40:52.546362+0000","last_clean":"2024-04-18T03:40:52.546362+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:40:52.546362+0000","last_undegraded":"2024-04-18T03:40:52.546362+0000","last_fullsized":"2024-04-18T03:40:52.546362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'66","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.558555+0000","last_change":"2024-04-18T03:38:23.515116+0000","last_active":"2024-04-18T03:40:52.558555+0000","last_peered":"2024-04-18T03:40:52.558555+0000","last_clean":"2024-04-18T03:40:52.558555+0000","last_became_active":"2024-04-18T03:38:23.514633+0000","last_became_peered":"2024-04-18T03:38:23.514633+0000","last_unstale":"2024-04-18T03:40:52.558555+0000","last_undegraded":"2024-04-18T03:40:52.558555+0000","last_fullsized":"2024-04-18T03:40:52.558555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:04.434087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'42","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547910+0000","last_change":"2024-04-18T03:37:34.310319+0000","last_active":"2024-04-18T03:40:52.547910+0000","last_peered":"2024-04-18T03:40:52.547910+0000","last_clean":"2024-04-18T03:40:52.547910+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:40:52.547910+0000","last_undegraded":"2024-04-18T03:40:52.547910+0000","last_fullsized":"2024-04-18T03:40:52.547910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:03:44.145067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'49","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560802+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:40:52.560802+0000","last_peered":"2024-04-18T03:40:52.560802+0000","last_clean":"2024-04-18T03:40:52.560802+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:40:52.560802+0000","last_undegraded":"2024-04-18T03:40:52.560802+0000","last_fullsized":"2024-04-18T03:40:52.560802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551501+0000","last_change":"2024-04-18T03:37:34.310229+0000","last_active":"2024-04-18T03:40:52.551501+0000","last_peered":"2024-04-18T03:40:52.551501+0000","last_clean":"2024-04-18T03:40:52.551501+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:40:52.551501+0000","last_undegraded":"2024-04-18T03:40:52.551501+0000","last_fullsized":"2024-04-18T03:40:52.551501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'58","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563696+0000","last_change":"2024-04-18T03:38:23.754521+0000","last_active":"2024-04-18T03:40:52.563696+0000","last_peered":"2024-04-18T03:40:52.563696+0000","last_clean":"2024-04-18T03:40:52.563696+0000","last_became_active":"2024-04-18T03:38:23.753851+0000","last_became_peered":"2024-04-18T03:38:23.753851+0000","last_unstale":"2024-04-18T03:40:52.563696+0000","last_undegraded":"2024-04-18T03:40:52.563696+0000","last_fullsized":"2024-04-18T03:40:52.563696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:13:50.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"27'63","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.564131+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:40:52.564131+0000","last_peered":"2024-04-18T03:40:52.564131+0000","last_clean":"2024-04-18T03:40:52.564131+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:40:52.564131+0000","last_undegraded":"2024-04-18T03:40:52.564131+0000","last_fullsized":"2024-04-18T03:40:52.564131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'62","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545598+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:40:52.545598+0000","last_peered":"2024-04-18T03:40:52.545598+0000","last_clean":"2024-04-18T03:40:52.545598+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:40:52.545598+0000","last_undegraded":"2024-04-18T03:40:52.545598+0000","last_fullsized":"2024-04-18T03:40:52.545598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:07:23.620181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561058+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:40:52.561058+0000","last_peered":"2024-04-18T03:40:52.561058+0000","last_clean":"2024-04-18T03:40:52.561058+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:40:52.561058+0000","last_undegraded":"2024-04-18T03:40:52.561058+0000","last_fullsized":"2024-04-18T03:40:52.561058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'58","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551885+0000","last_change":"2024-04-18T03:37:34.313079+0000","last_active":"2024-04-18T03:40:52.551885+0000","last_peered":"2024-04-18T03:40:52.551885+0000","last_clean":"2024-04-18T03:40:52.551885+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:40:52.551885+0000","last_undegraded":"2024-04-18T03:40:52.551885+0000","last_fullsized":"2024-04-18T03:40:52.551885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:50.485855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562415+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:40:52.562415+0000","last_peered":"2024-04-18T03:40:52.562415+0000","last_clean":"2024-04-18T03:40:52.562415+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:40:52.562415+0000","last_undegraded":"2024-04-18T03:40:52.562415+0000","last_fullsized":"2024-04-18T03:40:52.562415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551256+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:40:52.551256+0000","last_peered":"2024-04-18T03:40:52.551256+0000","last_clean":"2024-04-18T03:40:52.551256+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:40:52.551256+0000","last_undegraded":"2024-04-18T03:40:52.551256+0000","last_fullsized":"2024-04-18T03:40:52.551256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:24:55.047648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'53","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547823+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:40:52.547823+0000","last_peered":"2024-04-18T03:40:52.547823+0000","last_clean":"2024-04-18T03:40:52.547823+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:40:52.547823+0000","last_undegraded":"2024-04-18T03:40:52.547823+0000","last_fullsized":"2024-04-18T03:40:52.547823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'59","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549187+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:40:52.549187+0000","last_peered":"2024-04-18T03:40:52.549187+0000","last_clean":"2024-04-18T03:40:52.549187+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:40:52.549187+0000","last_undegraded":"2024-04-18T03:40:52.549187+0000","last_fullsized":"2024-04-18T03:40:52.549187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551542+0000","last_change":"2024-04-18T03:37:34.314282+0000","last_active":"2024-04-18T03:40:52.551542+0000","last_peered":"2024-04-18T03:40:52.551542+0000","last_clean":"2024-04-18T03:40:52.551542+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:40:52.551542+0000","last_undegraded":"2024-04-18T03:40:52.551542+0000","last_fullsized":"2024-04-18T03:40:52.551542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:49:25.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'44","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.527773+0000","last_change":"2024-04-18T03:37:34.299168+0000","last_active":"2024-04-18T03:40:52.527773+0000","last_peered":"2024-04-18T03:40:52.527773+0000","last_clean":"2024-04-18T03:40:52.527773+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:40:52.527773+0000","last_undegraded":"2024-04-18T03:40:52.527773+0000","last_fullsized":"2024-04-18T03:40:52.527773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:40:43.822625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551884+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:40:52.551884+0000","last_peered":"2024-04-18T03:40:52.551884+0000","last_clean":"2024-04-18T03:40:52.551884+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:40:52.551884+0000","last_undegraded":"2024-04-18T03:40:52.551884+0000","last_fullsized":"2024-04-18T03:40:52.551884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:13:48.446400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'53","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560125+0000","last_change":"2024-04-18T03:38:23.515120+0000","last_active":"2024-04-18T03:40:52.560125+0000","last_peered":"2024-04-18T03:40:52.560125+0000","last_clean":"2024-04-18T03:40:52.560125+0000","last_became_active":"2024-04-18T03:38:23.514732+0000","last_became_peered":"2024-04-18T03:38:23.514732+0000","last_unstale":"2024-04-18T03:40:52.560125+0000","last_undegraded":"2024-04-18T03:40:52.560125+0000","last_fullsized":"2024-04-18T03:40:52.560125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:44:10.490370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561761+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:40:52.561761+0000","last_peered":"2024-04-18T03:40:52.561761+0000","last_clean":"2024-04-18T03:40:52.561761+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:40:52.561761+0000","last_undegraded":"2024-04-18T03:40:52.561761+0000","last_fullsized":"2024-04-18T03:40:52.561761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:23:06.590320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561804+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:40:52.561804+0000","last_peered":"2024-04-18T03:40:52.561804+0000","last_clean":"2024-04-18T03:40:52.561804+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:40:52.561804+0000","last_undegraded":"2024-04-18T03:40:52.561804+0000","last_fullsized":"2024-04-18T03:40:52.561804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:12:55.785521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'54","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552286+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:40:52.552286+0000","last_peered":"2024-04-18T03:40:52.552286+0000","last_clean":"2024-04-18T03:40:52.552286+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:40:52.552286+0000","last_undegraded":"2024-04-18T03:40:52.552286+0000","last_fullsized":"2024-04-18T03:40:52.552286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547093+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:40:52.547093+0000","last_peered":"2024-04-18T03:40:52.547093+0000","last_clean":"2024-04-18T03:40:52.547093+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:40:52.547093+0000","last_undegraded":"2024-04-18T03:40:52.547093+0000","last_fullsized":"2024-04-18T03:40:52.547093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:14:43.304384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'55","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562460+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:40:52.562460+0000","last_peered":"2024-04-18T03:40:52.562460+0000","last_clean":"2024-04-18T03:40:52.562460+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:40:52.562460+0000","last_undegraded":"2024-04-18T03:40:52.562460+0000","last_fullsized":"2024-04-18T03:40:52.562460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:28:12.488950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'40","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560874+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:40:52.560874+0000","last_peered":"2024-04-18T03:40:52.560874+0000","last_clean":"2024-04-18T03:40:52.560874+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:40:52.560874+0000","last_undegraded":"2024-04-18T03:40:52.560874+0000","last_fullsized":"2024-04-18T03:40:52.560874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:12:10.981727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'55","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546010+0000","last_change":"2024-04-18T03:37:34.300927+0000","last_active":"2024-04-18T03:40:52.546010+0000","last_peered":"2024-04-18T03:40:52.546010+0000","last_clean":"2024-04-18T03:40:52.546010+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:40:52.546010+0000","last_undegraded":"2024-04-18T03:40:52.546010+0000","last_fullsized":"2024-04-18T03:40:52.546010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'43","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.546758+0000","last_change":"2024-04-18T03:37:34.289446+0000","last_active":"2024-04-18T03:40:52.546758+0000","last_peered":"2024-04-18T03:40:52.546758+0000","last_clean":"2024-04-18T03:40:52.546758+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:40:52.546758+0000","last_undegraded":"2024-04-18T03:40:52.546758+0000","last_fullsized":"2024-04-18T03:40:52.546758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'48","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560712+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:40:52.560712+0000","last_peered":"2024-04-18T03:40:52.560712+0000","last_clean":"2024-04-18T03:40:52.560712+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:40:52.560712+0000","last_undegraded":"2024-04-18T03:40:52.560712+0000","last_fullsized":"2024-04-18T03:40:52.560712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:49.338554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31140456,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":3113,"num_write_kb":31587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62341120,"data_stored":62280912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3821,"ondisk_log_size":3821,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49160,"kb_used_data":13952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94322680,"statfs":{"total":96636764160,"available":96586424320,"internally_reserved":0,"allocated":14286848,"data_stored":14110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83799999999999997,"15min":0.86699999999999999},"min":{"1min":0.48899999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1299999999999999,"5min":1.286,"15min":1.286},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.87,"15min":0.89100000000000001},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.2110000000000001,"5min":1.331,"15min":1.331},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85299999999999998,"15min":0.88200000000000001},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1000000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.879},"min":{"1min":0.59599999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.133,"5min":1.724,"15min":1.724},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1100000000000001,"5min":1.274,"15min":1.274},"last":0.749},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96999999999999997,"15min":0.98999999999999999},"min":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.298,"5min":1.329,"15min":1.329},"last":1.2150000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.86499999999999999,"15min":0.89000000000000001},"min":{"1min":0.59999999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0669999999999999,"5min":1.228,"15min":1.228},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83599999999999997,"15min":0.83399999999999996},"min":{"1min":0.69699999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.097,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.98299999999999998}]},{"osd":4,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.90000000000000002,"15min":0.88},"min":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.081,"15min":1.101},"min":{"1min":0.86899999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7350000000000001,"5min":2.198,"15min":2.198},"last":1.099}]},{"osd":5,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90500000000000003,"15min":0.89700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":1.0109999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0700000000000001,"15min":1.0760000000000001},"min":{"1min":0.81799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.014},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0569999999999999,"15min":1.0620000000000001},"min":{"1min":0.78200000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4450000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0700000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39588,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94332252,"statfs":{"total":96636764160,"available":96596226048,"internally_reserved":0,"allocated":8679424,"data_stored":8504374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77200000000000002,"15min":0.77600000000000002},"min":{"1min":0.59699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.105,"15min":1.105},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.84699999999999998},"min":{"1min":0.61499999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.88300000000000001,"15min":0.89500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.95099999999999996,"15min":0.96699999999999997},"min":{"1min":0.65000000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2529999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.83699999999999997,"15min":0.81100000000000005},"min":{"1min":0.67800000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.2769999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.90200000000000002,"15min":0.91500000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.157,"5min":1.224,"15min":1.224},"last":0.97199999999999998}]},{"osd":3,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91100000000000003,"15min":0.91200000000000003},"min":{"1min":0.72199999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.79600000000000004},{"interface":"front","average":{"1min":1,"5min":0.94199999999999995,"15min":0.92400000000000004},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93100000000000005,"15min":0.92700000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95699999999999996,"15min":0.96299999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.234,"5min":1.236,"15min":1.236},"last":0.871}]},{"osd":6,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0149999999999999,"15min":0.98299999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.1240000000000001,"15min":1.127},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.054,"15min":1.054},"min":{"1min":0.747,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3740000000000001,"5min":1.395,"15min":1.395},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.155,"15min":1.125},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.94199999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57928,"kb_used_data":18624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94313912,"statfs":{"total":96636764160,"available":96577445888,"internally_reserved":0,"allocated":19070976,"data_stored":18894785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77900000000000003,"15min":0.80400000000000005},"min":{"1min":0.52900000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0309999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1579999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1499999999999999}]},{"osd":1,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.53500000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1479999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.5,"5min":0.495,"15min":0.495},"max":{"1min":1.034,"5min":1.123,"15min":1.123},"last":0.96499999999999997}]},{"osd":2,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89300000000000002,"15min":0.93899999999999995},"min":{"1min":0.63400000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0860000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.92200000000000004,"15min":0.94799999999999995},"min":{"1min":0.621,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.92000000000000004,"15min":0.94999999999999996},"min":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1799999999999999,"5min":1.232,"15min":1.232},"last":1.028},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.216,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.079}]},{"osd":4,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.181,"5min":1.679,"15min":1.679},"last":0.628},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.97299999999999998,"15min":0.98099999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2470000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3380000000000001,"5min":1.617,"15min":1.617},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.79100000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2729999999999999,"5min":1.496,"15min":1.496},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.107,"15min":1.1240000000000001},"min":{"1min":0.80100000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.534,"5min":1.593,"15min":1.593},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.01,"15min":1.0049999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2549999999999999,"5min":1.462,"15min":1.462},"last":0.80100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":116344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83399999999999996,"15min":0.89500000000000002},"min":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0760000000000001,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81899999999999995,"15min":0.84699999999999998},"min":{"1min":0.55800000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.101,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83799999999999997,"15min":0.88700000000000001},"min":{"1min":0.60299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.129,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.81299999999999994,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86299999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90200000000000002,"15min":0.93400000000000005},"min":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1359999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.98799999999999999,"15min":1.038},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1919999999999999,"5min":1.536,"15min":1.536},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":0.98599999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1890000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.236,"5min":1.472,"15min":1.472},"last":0.98599999999999999}]},{"osd":4,"last update":"Thu Apr 18 03:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.006,"15min":1.038},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.2370000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.88800000000000001,"5min":1.0329999999999999,"15min":1.079},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.506,"5min":1.631,"15min":1.631},"last":1.161}]},{"osd":6,"last update":"Thu Apr 18 03:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.135},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1220000000000001,"15min":1.1499999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4059999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.121}]},{"osd":7,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.998,"15min":1.04},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.256,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.089,"5min":1.1850000000000001,"15min":1.2470000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.627,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.1839999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":12932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":13242368,"data_stored":13068331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.47299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.228,"5min":2.202,"15min":2.202},"last":0.496},{"interface":"front","average":{"1min":0.748,"5min":0.69699999999999995,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.2290000000000001,"5min":1.629,"15min":1.629},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.498,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.622,"5min":0.38,"15min":0.38},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.748,"15min":0.749},"min":{"1min":0.59399999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.026,"5min":0.86399999999999999,"15min":0.86799999999999999},"min":{"1min":0.73399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.5900000000000001,"5min":1.821,"15min":1.821},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.98099999999999998,"15min":0.97999999999999998},"min":{"1min":0.66900000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.94099999999999995,"15min":0.93799999999999994},"min":{"1min":0.76100000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3839999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.75800000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0449999999999999,"15min":1.024},"min":{"1min":0.84699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0669999999999999,"15min":1.0680000000000001},"min":{"1min":0.79600000000000004,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.105},{"interface":"front","average":{"1min":1.292,"5min":1.0920000000000001,"15min":1.0720000000000001},"min":{"1min":0.97699999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Apr 18 03:40:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.022,"15min":1.012},"min":{"1min":0.86799999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.1399999999999999,"15min":1.145},"min":{"1min":0.98699999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8149999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.1759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35844,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335996,"statfs":{"total":96636764160,"available":96600059904,"internally_reserved":0,"allocated":651264,"data_stored":484747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63300000000000001,"15min":0.65000000000000002},"min":{"1min":0.33200000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.94599999999999995,"5min":0.995,"15min":0.995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.39900000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.145,"5min":1.532,"15min":1.532},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.316,"15min":0.316},"max":{"1min":1.0880000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.44400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.44600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.55400000000000005,"5min":0.318,"15min":0.318},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.88}]},{"osd":4,"last update":"Thu Apr 18 03:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.409,"15min":1.409},"last":1},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96899999999999997,"15min":0.98499999999999999},"min":{"1min":0.51300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1,"15min":1.016},"min":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.143},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99099999999999999,"15min":1.0169999999999999},"min":{"1min":0.63400000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.91400000000000003}]},{"osd":6,"last update":"Thu Apr 18 03:40:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.048,"15min":1.0589999999999999},"min":{"1min":0.76600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0529999999999999,"15min":1.081},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.143,"5min":1.0620000000000001,"15min":1.0740000000000001},"min":{"1min":0.78600000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.05}]}]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35492,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336348,"statfs":{"total":96636764160,"available":96600420352,"internally_reserved":0,"allocated":290816,"data_stored":116414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.504,"5min":0.25,"15min":0.25},"max":{"1min":0.78300000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.48999999999999999,"5min":0.215,"15min":0.215},"max":{"1min":1.1020000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.50600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.64000000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3169999999999999,"5min":1.321,"15min":1.321},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80500000000000005,"15min":0.83499999999999996},"min":{"1min":0.58199999999999996,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.028,"5min":1.583,"15min":1.583},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.69899999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1180000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2190000000000001,"5min":1.337,"15min":1.337},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.70399999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.244,"5min":1.274,"15min":1.274},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98999999999999999,"15min":1.006},"min":{"1min":0.73499999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2649999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.99099999999999999,"15min":1.0029999999999999},"min":{"1min":0.84399999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.304,"5min":1.353,"15min":1.353},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.095,"15min":1.143},"min":{"1min":0.81599999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4179999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.099,"5min":1.0900000000000001,"15min":1.123},"min":{"1min":0.83099999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.407,"5min":2.242,"15min":2.242},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Apr 18 03:40:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1020000000000001,"15min":1.137},"min":{"1min":0.997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3640000000000001,"5min":2.044,"15min":2.044},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1180000000000001,"15min":1.145},"min":{"1min":0.96299999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4590000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.86699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44264,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94327576,"statfs":{"total":96636764160,"available":96591437824,"internally_reserved":0,"allocated":9273344,"data_stored":9094201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.51300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.49099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.68700000000000006,"15min":0.69599999999999995},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72499999999999998,"15min":0.71899999999999997},"min":{"1min":0.66600000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99099999999999999,"5min":1.103,"15min":1.103},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.70699999999999996,"15min":0.68100000000000005},"min":{"1min":0.52800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.58399999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.68799999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.038}]},{"osd":5,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.98799999999999999,"15min":0.96799999999999997},"min":{"1min":0.85399999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.129,"5min":1.0600000000000001,"15min":1.0549999999999999},"min":{"1min":0.85799999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4890000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Apr 18 03:40:35 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0389999999999999,"15min":1.0329999999999999},"min":{"1min":0.84599999999999997,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4910000000000001,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.077,"15min":1.0640000000000001},"min":{"1min":0.82399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.0109999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:40:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.048,"15min":1.0600000000000001},"min":{"1min":0.79700000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2989999999999999,"5min":1.484,"15min":1.484},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.127,"15min":1.123},"min":{"1min":0.78200000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.075}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14004224,"data_stored":13993949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18194432,"data_stored":18188163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:41:35.954 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.955 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.955 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.955 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.955 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.955 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.955 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.955 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.955 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.956 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.957 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.958 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T03:37:27.828246+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=27, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.959 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.960 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.961 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.962 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.963 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.964 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.964 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.964 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.964 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.964 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.964 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.964 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.964 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.965 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.966 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.967 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.968 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.968 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.968 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:35.968 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T03:41:40.653 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:41:40.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:41:55.969 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:41:56.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a43039700 1 Processor -- start 2024-04-18T03:41:56.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a43039700 1 -- start start 2024-04-18T03:41:56.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a43039700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a3c0cb5d0 0x7f2a3c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a43039700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c071080 0x7f2a3c071510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a43039700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c0b2410 con 0x7f2a3c161a30 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a43039700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c071a50 con 0x7f2a3c0cb5d0 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a43039700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c06a7d0 con 0x7f2a3c071080 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a40dd5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a3c0cb5d0 0x7f2a3c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a40dd5700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2a3c0cb5d0 0x7f2a3c0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54428/0 (socket says 172.21.15.157:54428) 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a40dd5700 1 -- 172.21.15.157:0/3640981407 learned_addr learned my addr 172.21.15.157:0/3640981407 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a415d6700 1 --2- 172.21.15.157:0/3640981407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c071080 0x7f2a3c071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a40dd5700 1 -- 172.21.15.157:0/3640981407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c071080 msgr2=0x7f2a3c071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a40dd5700 1 --2- 172.21.15.157:0/3640981407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c071080 0x7f2a3c071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a40dd5700 1 -- 172.21.15.157:0/3640981407 >> v1:172.21.15.175:6789/0 conn(0x7f2a3c161a30 legacy=0x7f2a3c0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a40dd5700 1 -- 172.21.15.157:0/3640981407 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0cb9b0 con 0x7f2a3c0cb5d0 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a40dd5700 1 --2- 172.21.15.157:0/3640981407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c0cb5d0 0x7f2a3c0b3830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009910 tx=0x7f2a2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89453de61ce780d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:56.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a3b7fe700 1 -- 172.21.15.157:0/3640981407 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c011830 con 0x7f2a3c0cb5d0 2024-04-18T03:41:56.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a3b7fe700 1 -- 172.21.15.157:0/3640981407 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c011990 con 0x7f2a3c0cb5d0 2024-04-18T03:41:56.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.086+0000 7f2a3b7fe700 1 -- 172.21.15.157:0/3640981407 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c011d40 con 0x7f2a3c0cb5d0 2024-04-18T03:41:56.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 -- 172.21.15.157:0/3640981407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c0cb5d0 msgr2=0x7f2a3c0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:56.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 --2- 172.21.15.157:0/3640981407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c0cb5d0 0x7f2a3c0b3830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009910 tx=0x7f2a2c009c20 comp rx=0 tx=0).stop 2024-04-18T03:41:56.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 -- 172.21.15.157:0/3640981407 shutdown_connections 2024-04-18T03:41:56.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 --2- 172.21.15.157:0/3640981407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c071080 0x7f2a3c071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 --2- 172.21.15.157:0/3640981407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c0cb5d0 0x7f2a3c0b3830 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 -- 172.21.15.157:0/3640981407 >> 172.21.15.157:0/3640981407 conn(0x7f2a3c0b1170 msgr2=0x7f2a3c06e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:56.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 -- 172.21.15.157:0/3640981407 shutdown_connections 2024-04-18T03:41:56.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 -- 172.21.15.157:0/3640981407 wait complete. 2024-04-18T03:41:56.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 Processor -- start 2024-04-18T03:41:56.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.090+0000 7f2a43039700 1 -- start start 2024-04-18T03:41:56.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c071080 0x7f2a3c14b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:56.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3c0cb5d0 0x7f2a3c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:56.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c161a30 0x7f2a3c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c1503b0 con 0x7f2a3c071080 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c158bf0 con 0x7f2a3c0cb5d0 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c158ed0 con 0x7f2a3c161a30 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c071080 0x7f2a3c14b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c071080 0x7f2a3c14b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:54434/0 (socket says 172.21.15.157:54434) 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 -- 172.21.15.157:0/2541935281 learned_addr learned my addr 172.21.15.157:0/2541935281 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a415d6700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c161a30 0x7f2a3c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a3bfff700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3c0cb5d0 0x7f2a3c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 -- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c161a30 msgr2=0x7f2a3c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c161a30 0x7f2a3c150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 -- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3c0cb5d0 msgr2=0x7f2a3c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3c0cb5d0 0x7f2a3c1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 -- 172.21.15.157:0/2541935281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009570 con 0x7f2a3c071080 2024-04-18T03:41:56.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a40dd5700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c071080 0x7f2a3c14b710 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c000c00 tx=0x7f2a2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:56.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a397fa700 1 -- 172.21.15.157:0/2541935281 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c004510 con 0x7f2a3c071080 2024-04-18T03:41:56.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a397fa700 1 -- 172.21.15.157:0/2541935281 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0036c0 con 0x7f2a3c071080 2024-04-18T03:41:56.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a397fa700 1 -- 172.21.15.157:0/2541935281 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c003a70 con 0x7f2a3c071080 2024-04-18T03:41:56.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c1591b0 con 0x7f2a3c071080 2024-04-18T03:41:56.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c14bc50 con 0x7f2a3c071080 2024-04-18T03:41:56.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.094+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c1596d0 con 0x7f2a3c071080 2024-04-18T03:41:56.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.098+0000 7f2a397fa700 1 -- 172.21.15.157:0/2541935281 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a2c003bd0 con 0x7f2a3c071080 2024-04-18T03:41:56.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.098+0000 7f2a397fa700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2a1c066730 0x7f2a1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:41:56.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.098+0000 7f2a397fa700 1 -- 172.21.15.157:0/2541935281 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a2c021030 con 0x7f2a3c071080 2024-04-18T03:41:56.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.098+0000 7f2a3bfff700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2a1c066730 0x7f2a1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:41:56.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.098+0000 7f2a3bfff700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2a1c066730 0x7f2a1c068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0cafe0 tx=0x7f2a24009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:41:56.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.106+0000 7f2a397fa700 1 -- 172.21.15.157:0/2541935281 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f2a2c052ac0 con 0x7f2a3c071080 2024-04-18T03:41:56.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.274+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a3c1625b0 con 0x7f2a1c066730 2024-04-18T03:41:56.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.294+0000 7f2a397fa700 1 -- 172.21.15.157:0/2541935281 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367120 (secure 0 0 0) 0x7f2a2400fbf0 con 0x7f2a1c066730 2024-04-18T03:41:56.306 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2a1c066730 msgr2=0x7f2a1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2a1c066730 0x7f2a1c068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0cafe0 tx=0x7f2a24009040 comp rx=0 tx=0).stop 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c071080 msgr2=0x7f2a3c14b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c071080 0x7f2a3c14b710 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c000c00 tx=0x7f2a2c004770 comp rx=0 tx=0).stop 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 shutdown_connections 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f2a1c066730 0x7f2a1c068bf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a3c0cb5d0 0x7f2a3c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a3c161a30 0x7f2a3c150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 --2- 172.21.15.157:0/2541935281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a3c071080 0x7f2a3c14b710 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 >> 172.21.15.157:0/2541935281 conn(0x7f2a3c0b1170 msgr2=0x7f2a3c0af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 shutdown_connections 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:41:56.302+0000 7f2a43039700 1 -- 172.21.15.157:0/2541935281 wait complete. 2024-04-18T03:41:56.309 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:41:56.323 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-04-18T03:41:55.869743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31730824,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":488,"num_write":3272,"num_write_kb":34003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8675,"ondisk_log_size":8675,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337712,"kb_used_data":64240,"kb_used_omap":12,"kb_used_meta":273395,"kb_avail":754637008,"statfs":{"total":773094113280,"available":772748296192,"internally_reserved":0,"allocated":65781760,"data_stored":64389399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":279957048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005424"},"pg_stats":[{"pgid":"2.1f","version":"27'44","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:47.313806+0000","last_change":"2024-04-18T03:41:47.313806+0000","last_active":"2024-04-18T03:41:47.313806+0000","last_peered":"2024-04-18T03:41:47.313806+0000","last_clean":"2024-04-18T03:41:47.313806+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:41:47.313806+0000","last_undegraded":"2024-04-18T03:41:47.313806+0000","last_fullsized":"2024-04-18T03:41:47.313806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:47.313394+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:47.313394+0000","last_clean_scrub_stamp":"2024-04-18T03:41:47.313394+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:44:53.111022+0000","scrub_duration":0.016391722000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'46","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.866590+0000","last_change":"2024-04-18T03:41:41.866853+0000","last_active":"2024-04-18T03:41:41.866590+0000","last_peered":"2024-04-18T03:41:41.866590+0000","last_clean":"2024-04-18T03:41:41.866590+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:41:41.866590+0000","last_undegraded":"2024-04-18T03:41:41.866590+0000","last_fullsized":"2024-04-18T03:41:41.866590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:41:41.866538+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:41:41.866538+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.866538+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:24:50.426740+0000","scrub_duration":0.0040658880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'49","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851981+0000","last_change":"2024-04-18T03:37:38.559421+0000","last_active":"2024-04-18T03:40:47.851981+0000","last_peered":"2024-04-18T03:40:47.851981+0000","last_clean":"2024-04-18T03:40:47.851981+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:40:47.851981+0000","last_undegraded":"2024-04-18T03:40:47.851981+0000","last_fullsized":"2024-04-18T03:40:47.851981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'31","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:42.896356+0000","last_change":"2024-04-18T03:41:42.896476+0000","last_active":"2024-04-18T03:41:42.896356+0000","last_peered":"2024-04-18T03:41:42.896356+0000","last_clean":"2024-04-18T03:41:42.896356+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:41:42.896356+0000","last_undegraded":"2024-04-18T03:41:42.896356+0000","last_fullsized":"2024-04-18T03:41:42.896356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-18T03:41:42.896332+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-18T03:41:42.896332+0000","last_clean_scrub_stamp":"2024-04-18T03:41:42.896332+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:43.175299+0000","scrub_duration":0.013984702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'57","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.147221+0000","last_change":"2024-04-18T03:37:34.302069+0000","last_active":"2024-04-18T03:41:32.147221+0000","last_peered":"2024-04-18T03:41:32.147221+0000","last_clean":"2024-04-18T03:41:32.147221+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:41:32.147221+0000","last_undegraded":"2024-04-18T03:41:32.147221+0000","last_fullsized":"2024-04-18T03:41:32.147221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'43","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.692213+0000","last_change":"2024-04-18T03:37:38.328452+0000","last_active":"2024-04-18T03:40:50.692213+0000","last_peered":"2024-04-18T03:40:50.692213+0000","last_clean":"2024-04-18T03:40:50.692213+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:40:50.692213+0000","last_undegraded":"2024-04-18T03:40:50.692213+0000","last_fullsized":"2024-04-18T03:40:50.692213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'64","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:22.681566+0000","last_change":"2024-04-18T03:37:33.931179+0000","last_active":"2024-04-18T03:41:22.681566+0000","last_peered":"2024-04-18T03:41:22.681566+0000","last_clean":"2024-04-18T03:41:22.681566+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:41:22.681566+0000","last_undegraded":"2024-04-18T03:41:22.681566+0000","last_fullsized":"2024-04-18T03:41:22.681566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604669,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.786740+0000","last_change":"2024-04-18T03:41:35.786953+0000","last_active":"2024-04-18T03:41:35.786740+0000","last_peered":"2024-04-18T03:41:35.786740+0000","last_clean":"2024-04-18T03:41:35.786740+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:41:35.786740+0000","last_undegraded":"2024-04-18T03:41:35.786740+0000","last_fullsized":"2024-04-18T03:41:35.786740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:35.786690+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:35.786690+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.786690+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:04.481446+0000","scrub_duration":0.0030209529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'44","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856035+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:40:47.856035+0000","last_peered":"2024-04-18T03:40:47.856035+0000","last_clean":"2024-04-18T03:40:47.856035+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:40:47.856035+0000","last_undegraded":"2024-04-18T03:40:47.856035+0000","last_fullsized":"2024-04-18T03:40:47.856035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'16","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.600052+0000","last_change":"2024-04-18T03:37:33.925895+0000","last_active":"2024-04-18T03:40:39.600052+0000","last_peered":"2024-04-18T03:40:39.600052+0000","last_clean":"2024-04-18T03:40:39.600052+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:40:39.600052+0000","last_undegraded":"2024-04-18T03:40:39.600052+0000","last_fullsized":"2024-04-18T03:40:39.600052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'58","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559819+0000","last_change":"2024-04-18T03:37:34.297088+0000","last_active":"2024-04-18T03:40:52.559819+0000","last_peered":"2024-04-18T03:40:52.559819+0000","last_clean":"2024-04-18T03:40:52.559819+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:40:52.559819+0000","last_undegraded":"2024-04-18T03:40:52.559819+0000","last_fullsized":"2024-04-18T03:40:52.559819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'40","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.850270+0000","last_change":"2024-04-18T03:37:38.322090+0000","last_active":"2024-04-18T03:40:47.850270+0000","last_peered":"2024-04-18T03:40:47.850270+0000","last_clean":"2024-04-18T03:40:47.850270+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:40:47.850270+0000","last_undegraded":"2024-04-18T03:40:47.850270+0000","last_fullsized":"2024-04-18T03:40:47.850270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'42","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545339+0000","last_change":"2024-04-18T03:37:34.311240+0000","last_active":"2024-04-18T03:40:52.545339+0000","last_peered":"2024-04-18T03:40:52.545339+0000","last_clean":"2024-04-18T03:40:52.545339+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:40:52.545339+0000","last_undegraded":"2024-04-18T03:40:52.545339+0000","last_fullsized":"2024-04-18T03:40:52.545339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'527","reported_seq":546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.599071+0000","last_change":"2024-04-18T03:37:33.925906+0000","last_active":"2024-04-18T03:40:39.599071+0000","last_peered":"2024-04-18T03:40:39.599071+0000","last_clean":"2024-04-18T03:40:39.599071+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:40:39.599071+0000","last_undegraded":"2024-04-18T03:40:39.599071+0000","last_fullsized":"2024-04-18T03:40:39.599071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'41","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.838857+0000","last_change":"2024-04-18T03:37:38.328580+0000","last_active":"2024-04-18T03:40:47.838857+0000","last_peered":"2024-04-18T03:40:47.838857+0000","last_clean":"2024-04-18T03:40:47.838857+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:40:47.838857+0000","last_undegraded":"2024-04-18T03:40:47.838857+0000","last_fullsized":"2024-04-18T03:40:47.838857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543775+0000","last_change":"2024-04-18T03:38:23.517111+0000","last_active":"2024-04-18T03:40:52.543775+0000","last_peered":"2024-04-18T03:40:52.543775+0000","last_clean":"2024-04-18T03:40:52.543775+0000","last_became_active":"2024-04-18T03:38:23.516790+0000","last_became_peered":"2024-04-18T03:38:23.516790+0000","last_unstale":"2024-04-18T03:40:52.543775+0000","last_undegraded":"2024-04-18T03:40:52.543775+0000","last_fullsized":"2024-04-18T03:40:52.543775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"27'31","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.051014+0000","last_change":"2024-04-18T03:41:38.051224+0000","last_active":"2024-04-18T03:41:38.051014+0000","last_peered":"2024-04-18T03:41:38.051014+0000","last_clean":"2024-04-18T03:41:38.051014+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:41:38.051014+0000","last_undegraded":"2024-04-18T03:41:38.051014+0000","last_fullsized":"2024-04-18T03:41:38.051014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-18T03:41:38.050964+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-18T03:41:38.050964+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.050964+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:49.985927+0000","scrub_duration":0.0030233410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'48","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.851374+0000","last_change":"2024-04-18T03:37:38.328376+0000","last_active":"2024-04-18T03:40:47.851374+0000","last_peered":"2024-04-18T03:40:47.851374+0000","last_clean":"2024-04-18T03:40:47.851374+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:40:47.851374+0000","last_undegraded":"2024-04-18T03:40:47.851374+0000","last_fullsized":"2024-04-18T03:40:47.851374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'48","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552837+0000","last_change":"2024-04-18T03:37:34.303768+0000","last_active":"2024-04-18T03:40:52.552837+0000","last_peered":"2024-04-18T03:40:52.552837+0000","last_clean":"2024-04-18T03:40:52.552837+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:40:52.552837+0000","last_undegraded":"2024-04-18T03:40:52.552837+0000","last_fullsized":"2024-04-18T03:40:52.552837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'28","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.016656+0000","last_change":"2024-04-18T03:41:52.016858+0000","last_active":"2024-04-18T03:41:52.016656+0000","last_peered":"2024-04-18T03:41:52.016656+0000","last_clean":"2024-04-18T03:41:52.016656+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:41:52.016656+0000","last_undegraded":"2024-04-18T03:41:52.016656+0000","last_fullsized":"2024-04-18T03:41:52.016656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-04-18T03:41:52.016598+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-04-18T03:41:52.016598+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.016598+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:44:57.814226+0000","scrub_duration":0.0035341439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'40","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.857485+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:40:47.857485+0000","last_peered":"2024-04-18T03:40:47.857485+0000","last_clean":"2024-04-18T03:40:47.857485+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:40:47.857485+0000","last_undegraded":"2024-04-18T03:40:47.857485+0000","last_fullsized":"2024-04-18T03:40:47.857485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'48","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.529095+0000","last_change":"2024-04-18T03:37:34.293813+0000","last_active":"2024-04-18T03:40:52.529095+0000","last_peered":"2024-04-18T03:40:52.529095+0000","last_clean":"2024-04-18T03:40:52.529095+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:40:52.529095+0000","last_undegraded":"2024-04-18T03:40:52.529095+0000","last_fullsized":"2024-04-18T03:40:52.529095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:39.595744+0000","last_change":"2024-04-18T03:37:33.923105+0000","last_active":"2024-04-18T03:40:39.595744+0000","last_peered":"2024-04-18T03:40:39.595744+0000","last_clean":"2024-04-18T03:40:39.595744+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:40:39.595744+0000","last_undegraded":"2024-04-18T03:40:39.595744+0000","last_fullsized":"2024-04-18T03:40:39.595744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'42","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.847173+0000","last_change":"2024-04-18T03:37:38.334198+0000","last_active":"2024-04-18T03:40:47.847173+0000","last_peered":"2024-04-18T03:40:47.847173+0000","last_clean":"2024-04-18T03:40:47.847173+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:40:47.847173+0000","last_undegraded":"2024-04-18T03:40:47.847173+0000","last_fullsized":"2024-04-18T03:40:47.847173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'58","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549615+0000","last_change":"2024-04-18T03:37:34.289642+0000","last_active":"2024-04-18T03:40:52.549615+0000","last_peered":"2024-04-18T03:40:52.549615+0000","last_clean":"2024-04-18T03:40:52.549615+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:40:52.549615+0000","last_undegraded":"2024-04-18T03:40:52.549615+0000","last_fullsized":"2024-04-18T03:40:52.549615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'27","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.297161+0000","last_change":"2024-04-18T03:41:43.297161+0000","last_active":"2024-04-18T03:41:43.297161+0000","last_peered":"2024-04-18T03:41:43.297161+0000","last_clean":"2024-04-18T03:41:43.297161+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:41:43.297161+0000","last_undegraded":"2024-04-18T03:41:43.297161+0000","last_fullsized":"2024-04-18T03:41:43.297161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-04-18T03:41:43.296902+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-04-18T03:41:43.296902+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.296902+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:23.675175+0000","scrub_duration":0.0056293070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'46","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.127842+0000","last_change":"2024-04-18T03:37:38.551897+0000","last_active":"2024-04-18T03:41:34.127842+0000","last_peered":"2024-04-18T03:41:34.127842+0000","last_clean":"2024-04-18T03:41:34.127842+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:41:34.127842+0000","last_undegraded":"2024-04-18T03:41:34.127842+0000","last_fullsized":"2024-04-18T03:41:34.127842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'51","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.559783+0000","last_change":"2024-04-18T03:37:34.304293+0000","last_active":"2024-04-18T03:40:52.559783+0000","last_peered":"2024-04-18T03:40:52.559783+0000","last_clean":"2024-04-18T03:40:52.559783+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:40:52.559783+0000","last_undegraded":"2024-04-18T03:40:52.559783+0000","last_fullsized":"2024-04-18T03:40:52.559783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'39","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:40.098483+0000","last_change":"2024-04-18T03:41:40.098711+0000","last_active":"2024-04-18T03:41:40.098483+0000","last_peered":"2024-04-18T03:41:40.098483+0000","last_clean":"2024-04-18T03:41:40.098483+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:41:40.098483+0000","last_undegraded":"2024-04-18T03:41:40.098483+0000","last_fullsized":"2024-04-18T03:41:40.098483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-18T03:41:40.098426+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-18T03:41:40.098426+0000","last_clean_scrub_stamp":"2024-04-18T03:41:40.098426+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:41.537514+0000","scrub_duration":0.0076541339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.631339+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:41:33.631339+0000","last_peered":"2024-04-18T03:41:33.631339+0000","last_clean":"2024-04-18T03:41:33.631339+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:41:33.631339+0000","last_undegraded":"2024-04-18T03:41:33.631339+0000","last_fullsized":"2024-04-18T03:41:33.631339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'45","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.637359+0000","last_change":"2024-04-18T03:37:34.296432+0000","last_active":"2024-04-18T03:41:32.637359+0000","last_peered":"2024-04-18T03:41:32.637359+0000","last_clean":"2024-04-18T03:41:32.637359+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:41:32.637359+0000","last_undegraded":"2024-04-18T03:41:32.637359+0000","last_fullsized":"2024-04-18T03:41:32.637359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.737598+0000","last_change":"2024-04-18T03:41:50.737794+0000","last_active":"2024-04-18T03:41:50.737598+0000","last_peered":"2024-04-18T03:41:50.737598+0000","last_clean":"2024-04-18T03:41:50.737598+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:41:50.737598+0000","last_undegraded":"2024-04-18T03:41:50.737598+0000","last_fullsized":"2024-04-18T03:41:50.737598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-04-18T03:41:50.737548+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-04-18T03:41:50.737548+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.737548+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:38.977573+0000","scrub_duration":0.003374279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.147141+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:41:32.147141+0000","last_peered":"2024-04-18T03:41:32.147141+0000","last_clean":"2024-04-18T03:41:32.147141+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:41:32.147141+0000","last_undegraded":"2024-04-18T03:41:32.147141+0000","last_fullsized":"2024-04-18T03:41:32.147141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'46","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.620130+0000","last_change":"2024-04-18T03:37:34.303846+0000","last_active":"2024-04-18T03:41:34.620130+0000","last_peered":"2024-04-18T03:41:34.620130+0000","last_clean":"2024-04-18T03:41:34.620130+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:41:34.620130+0000","last_undegraded":"2024-04-18T03:41:34.620130+0000","last_fullsized":"2024-04-18T03:41:34.620130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'22","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.637179+0000","last_change":"2024-04-18T03:37:33.926269+0000","last_active":"2024-04-18T03:41:32.637179+0000","last_peered":"2024-04-18T03:41:32.637179+0000","last_clean":"2024-04-18T03:41:32.637179+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:41:32.637179+0000","last_undegraded":"2024-04-18T03:41:32.637179+0000","last_fullsized":"2024-04-18T03:41:32.637179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'45","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.637601+0000","last_change":"2024-04-18T03:37:38.341254+0000","last_active":"2024-04-18T03:41:32.637601+0000","last_peered":"2024-04-18T03:41:32.637601+0000","last_clean":"2024-04-18T03:41:32.637601+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:41:32.637601+0000","last_undegraded":"2024-04-18T03:41:32.637601+0000","last_fullsized":"2024-04-18T03:41:32.637601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.808734+0000","last_change":"2024-04-18T03:41:39.808734+0000","last_active":"2024-04-18T03:41:39.808734+0000","last_peered":"2024-04-18T03:41:39.808734+0000","last_clean":"2024-04-18T03:41:39.808734+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:41:39.808734+0000","last_undegraded":"2024-04-18T03:41:39.808734+0000","last_fullsized":"2024-04-18T03:41:39.808734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:39.808285+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:39.808285+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.808285+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:51.743247+0000","scrub_duration":0.0034876019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'24","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:42.797791+0000","last_change":"2024-04-18T03:41:42.797791+0000","last_active":"2024-04-18T03:41:42.797791+0000","last_peered":"2024-04-18T03:41:42.797791+0000","last_clean":"2024-04-18T03:41:42.797791+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:41:42.797791+0000","last_undegraded":"2024-04-18T03:41:42.797791+0000","last_fullsized":"2024-04-18T03:41:42.797791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:42.797529+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:42.797529+0000","last_clean_scrub_stamp":"2024-04-18T03:41:42.797529+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:50.855947+0000","scrub_duration":0.0038311510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.637512+0000","last_change":"2024-04-18T03:37:38.338992+0000","last_active":"2024-04-18T03:41:32.637512+0000","last_peered":"2024-04-18T03:41:32.637512+0000","last_clean":"2024-04-18T03:41:32.637512+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:41:32.637512+0000","last_undegraded":"2024-04-18T03:41:32.637512+0000","last_fullsized":"2024-04-18T03:41:32.637512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'45","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.637259+0000","last_change":"2024-04-18T03:37:34.296413+0000","last_active":"2024-04-18T03:41:32.637259+0000","last_peered":"2024-04-18T03:41:32.637259+0000","last_clean":"2024-04-18T03:41:32.637259+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:41:32.637259+0000","last_undegraded":"2024-04-18T03:41:32.637259+0000","last_fullsized":"2024-04-18T03:41:32.637259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'74","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.514977+0000","last_change":"2024-04-18T03:41:38.514977+0000","last_active":"2024-04-18T03:41:38.514977+0000","last_peered":"2024-04-18T03:41:38.514977+0000","last_clean":"2024-04-18T03:41:38.514977+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:41:38.514977+0000","last_undegraded":"2024-04-18T03:41:38.514977+0000","last_fullsized":"2024-04-18T03:41:38.514977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-04-18T03:41:38.514723+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-04-18T03:41:38.514723+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.514723+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:21.174107+0000","scrub_duration":0.0071320410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":44,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'49","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.808150+0000","last_change":"2024-04-18T03:37:38.340670+0000","last_active":"2024-04-18T03:40:47.808150+0000","last_peered":"2024-04-18T03:40:47.808150+0000","last_clean":"2024-04-18T03:40:47.808150+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:40:47.808150+0000","last_undegraded":"2024-04-18T03:40:47.808150+0000","last_fullsized":"2024-04-18T03:40:47.808150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:51.144326+0000","last_change":"2024-04-18T03:41:51.144604+0000","last_active":"2024-04-18T03:41:51.144326+0000","last_peered":"2024-04-18T03:41:51.144326+0000","last_clean":"2024-04-18T03:41:51.144326+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:41:51.144326+0000","last_undegraded":"2024-04-18T03:41:51.144326+0000","last_fullsized":"2024-04-18T03:41:51.144326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:51.144273+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:51.144273+0000","last_clean_scrub_stamp":"2024-04-18T03:41:51.144273+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:42.399546+0000","scrub_duration":0.0034673759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'21","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:49.786059+0000","last_change":"2024-04-18T03:41:49.786244+0000","last_active":"2024-04-18T03:41:49.786059+0000","last_peered":"2024-04-18T03:41:49.786059+0000","last_clean":"2024-04-18T03:41:49.786059+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:41:49.786059+0000","last_undegraded":"2024-04-18T03:41:49.786059+0000","last_fullsized":"2024-04-18T03:41:49.786059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-18T03:41:49.786003+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-18T03:41:49.786003+0000","last_clean_scrub_stamp":"2024-04-18T03:41:49.786003+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:09.331251+0000","scrub_duration":0.0037904060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'40","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845419+0000","last_change":"2024-04-18T03:38:23.756539+0000","last_active":"2024-04-18T03:40:47.845419+0000","last_peered":"2024-04-18T03:40:47.845419+0000","last_clean":"2024-04-18T03:40:47.845419+0000","last_became_active":"2024-04-18T03:38:23.755354+0000","last_became_peered":"2024-04-18T03:38:23.755354+0000","last_unstale":"2024-04-18T03:40:47.845419+0000","last_undegraded":"2024-04-18T03:40:47.845419+0000","last_fullsized":"2024-04-18T03:40:47.845419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'57","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.631019+0000","last_change":"2024-04-18T03:37:34.306419+0000","last_active":"2024-04-18T03:41:33.631019+0000","last_peered":"2024-04-18T03:41:33.631019+0000","last_clean":"2024-04-18T03:41:33.631019+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:41:33.631019+0000","last_undegraded":"2024-04-18T03:41:33.631019+0000","last_fullsized":"2024-04-18T03:41:33.631019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'20","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:49.701739+0000","last_change":"2024-04-18T03:41:49.701952+0000","last_active":"2024-04-18T03:41:49.701739+0000","last_peered":"2024-04-18T03:41:49.701739+0000","last_clean":"2024-04-18T03:41:49.701739+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:41:49.701739+0000","last_undegraded":"2024-04-18T03:41:49.701739+0000","last_fullsized":"2024-04-18T03:41:49.701739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-18T03:41:49.701682+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-18T03:41:49.701682+0000","last_clean_scrub_stamp":"2024-04-18T03:41:49.701682+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:09.246929+0000","scrub_duration":0.003833768,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.824286+0000","last_change":"2024-04-18T03:41:43.824582+0000","last_active":"2024-04-18T03:41:43.824286+0000","last_peered":"2024-04-18T03:41:43.824286+0000","last_clean":"2024-04-18T03:41:43.824286+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:41:43.824286+0000","last_undegraded":"2024-04-18T03:41:43.824286+0000","last_fullsized":"2024-04-18T03:41:43.824286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-18T03:41:43.824180+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-18T03:41:43.824180+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.824180+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:40.311196+0000","scrub_duration":0.010381431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'35","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.105337+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:41:35.105337+0000","last_peered":"2024-04-18T03:41:35.105337+0000","last_clean":"2024-04-18T03:41:35.105337+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:41:35.105337+0000","last_undegraded":"2024-04-18T03:41:35.105337+0000","last_fullsized":"2024-04-18T03:41:35.105337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'46","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.934500+0000","last_change":"2024-04-18T03:41:37.934709+0000","last_active":"2024-04-18T03:41:37.934500+0000","last_peered":"2024-04-18T03:41:37.934500+0000","last_clean":"2024-04-18T03:41:37.934500+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:41:37.934500+0000","last_undegraded":"2024-04-18T03:41:37.934500+0000","last_fullsized":"2024-04-18T03:41:37.934500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:41:37.934439+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:41:37.934439+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.934439+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:20.593823+0000","scrub_duration":0.0033057120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'29","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.559570+0000","last_change":"2024-04-18T03:41:39.559893+0000","last_active":"2024-04-18T03:41:39.559570+0000","last_peered":"2024-04-18T03:41:39.559570+0000","last_clean":"2024-04-18T03:41:39.559570+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:41:39.559570+0000","last_undegraded":"2024-04-18T03:41:39.559570+0000","last_fullsized":"2024-04-18T03:41:39.559570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-18T03:41:39.559453+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-18T03:41:39.559453+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.559453+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:02.058965+0000","scrub_duration":0.0039162629999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'34","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.854682+0000","last_change":"2024-04-18T03:37:38.549620+0000","last_active":"2024-04-18T03:40:47.854682+0000","last_peered":"2024-04-18T03:40:47.854682+0000","last_clean":"2024-04-18T03:40:47.854682+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:40:47.854682+0000","last_undegraded":"2024-04-18T03:40:47.854682+0000","last_fullsized":"2024-04-18T03:40:47.854682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'43","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.774523+0000","last_change":"2024-04-18T03:41:36.774727+0000","last_active":"2024-04-18T03:41:36.774523+0000","last_peered":"2024-04-18T03:41:36.774523+0000","last_clean":"2024-04-18T03:41:36.774523+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:41:36.774523+0000","last_undegraded":"2024-04-18T03:41:36.774523+0000","last_fullsized":"2024-04-18T03:41:36.774523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:36.774472+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:36.774472+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.774472+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:19.433856+0000","scrub_duration":0.0033108389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'25","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.076627+0000","last_change":"2024-04-18T03:41:36.076855+0000","last_active":"2024-04-18T03:41:36.076627+0000","last_peered":"2024-04-18T03:41:36.076627+0000","last_clean":"2024-04-18T03:41:36.076627+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:41:36.076627+0000","last_undegraded":"2024-04-18T03:41:36.076627+0000","last_fullsized":"2024-04-18T03:41:36.076627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-18T03:41:36.076533+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-18T03:41:36.076533+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.076533+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:32.739299+0000","scrub_duration":0.0067638259999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'55","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856937+0000","last_change":"2024-04-18T03:38:23.707932+0000","last_active":"2024-04-18T03:40:47.856937+0000","last_peered":"2024-04-18T03:40:47.856937+0000","last_clean":"2024-04-18T03:40:47.856937+0000","last_became_active":"2024-04-18T03:38:23.706819+0000","last_became_peered":"2024-04-18T03:38:23.706819+0000","last_unstale":"2024-04-18T03:40:47.856937+0000","last_undegraded":"2024-04-18T03:40:47.856937+0000","last_fullsized":"2024-04-18T03:40:47.856937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'47","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561974+0000","last_change":"2024-04-18T03:37:34.309833+0000","last_active":"2024-04-18T03:40:52.561974+0000","last_peered":"2024-04-18T03:40:52.561974+0000","last_clean":"2024-04-18T03:40:52.561974+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:40:52.561974+0000","last_undegraded":"2024-04-18T03:40:52.561974+0000","last_fullsized":"2024-04-18T03:40:52.561974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'21","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.457474+0000","last_change":"2024-04-18T03:41:36.457680+0000","last_active":"2024-04-18T03:41:36.457474+0000","last_peered":"2024-04-18T03:41:36.457474+0000","last_clean":"2024-04-18T03:41:36.457474+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:41:36.457474+0000","last_undegraded":"2024-04-18T03:41:36.457474+0000","last_fullsized":"2024-04-18T03:41:36.457474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-18T03:41:36.457421+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-18T03:41:36.457421+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.457421+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:05.152177+0000","scrub_duration":0.0051244159999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'50","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.711815+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:40:49.711815+0000","last_peered":"2024-04-18T03:40:49.711815+0000","last_clean":"2024-04-18T03:40:49.711815+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:40:49.711815+0000","last_undegraded":"2024-04-18T03:40:49.711815+0000","last_fullsized":"2024-04-18T03:40:49.711815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'39","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.550885+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:40:52.550885+0000","last_peered":"2024-04-18T03:40:52.550885+0000","last_clean":"2024-04-18T03:40:52.550885+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:40:52.550885+0000","last_undegraded":"2024-04-18T03:40:52.550885+0000","last_fullsized":"2024-04-18T03:40:52.550885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'24","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.839366+0000","last_change":"2024-04-18T03:41:34.839576+0000","last_active":"2024-04-18T03:41:34.839366+0000","last_peered":"2024-04-18T03:41:34.839366+0000","last_clean":"2024-04-18T03:41:34.839366+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:41:34.839366+0000","last_undegraded":"2024-04-18T03:41:34.839366+0000","last_fullsized":"2024-04-18T03:41:34.839366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:34.839312+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:34.839312+0000","last_clean_scrub_stamp":"2024-04-18T03:41:34.839312+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:25.350116+0000","scrub_duration":0.0055495320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'47","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.831520+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:40:47.831520+0000","last_peered":"2024-04-18T03:40:47.831520+0000","last_clean":"2024-04-18T03:40:47.831520+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:40:47.831520+0000","last_undegraded":"2024-04-18T03:40:47.831520+0000","last_fullsized":"2024-04-18T03:40:47.831520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.929865+0000","last_change":"2024-04-18T03:41:38.930160+0000","last_active":"2024-04-18T03:41:38.929865+0000","last_peered":"2024-04-18T03:41:38.929865+0000","last_clean":"2024-04-18T03:41:38.929865+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:41:38.929865+0000","last_undegraded":"2024-04-18T03:41:38.929865+0000","last_fullsized":"2024-04-18T03:41:38.929865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-04-18T03:41:38.929757+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-04-18T03:41:38.929757+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.929757+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:01.429268+0000","scrub_duration":0.0032590219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'37","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.464769+0000","last_change":"2024-04-18T03:41:34.464926+0000","last_active":"2024-04-18T03:41:34.464769+0000","last_peered":"2024-04-18T03:41:34.464769+0000","last_clean":"2024-04-18T03:41:34.464769+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:41:34.464769+0000","last_undegraded":"2024-04-18T03:41:34.464769+0000","last_fullsized":"2024-04-18T03:41:34.464769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-18T03:41:34.464734+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-18T03:41:34.464734+0000","last_clean_scrub_stamp":"2024-04-18T03:41:34.464734+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:28.772334+0000","scrub_duration":0.00658305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'54","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.852078+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:40:47.852078+0000","last_peered":"2024-04-18T03:40:47.852078+0000","last_clean":"2024-04-18T03:40:47.852078+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:40:47.852078+0000","last_undegraded":"2024-04-18T03:40:47.852078+0000","last_fullsized":"2024-04-18T03:40:47.852078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'49","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545742+0000","last_change":"2024-04-18T03:37:34.303111+0000","last_active":"2024-04-18T03:40:52.545742+0000","last_peered":"2024-04-18T03:40:52.545742+0000","last_clean":"2024-04-18T03:40:52.545742+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:40:52.545742+0000","last_undegraded":"2024-04-18T03:40:52.545742+0000","last_fullsized":"2024-04-18T03:40:52.545742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'30","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.389172+0000","last_change":"2024-04-18T03:41:38.389380+0000","last_active":"2024-04-18T03:41:38.389172+0000","last_peered":"2024-04-18T03:41:38.389172+0000","last_clean":"2024-04-18T03:41:38.389172+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:41:38.389172+0000","last_undegraded":"2024-04-18T03:41:38.389172+0000","last_fullsized":"2024-04-18T03:41:38.389172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-18T03:41:38.389114+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-18T03:41:38.389114+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.389114+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:35.051880+0000","scrub_duration":0.002866005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'43","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856838+0000","last_change":"2024-04-18T03:37:38.555357+0000","last_active":"2024-04-18T03:40:47.856838+0000","last_peered":"2024-04-18T03:40:47.856838+0000","last_clean":"2024-04-18T03:40:47.856838+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:40:47.856838+0000","last_undegraded":"2024-04-18T03:40:47.856838+0000","last_fullsized":"2024-04-18T03:40:47.856838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'63","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562733+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:40:52.562733+0000","last_peered":"2024-04-18T03:40:52.562733+0000","last_clean":"2024-04-18T03:40:52.562733+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:40:52.562733+0000","last_undegraded":"2024-04-18T03:40:52.562733+0000","last_fullsized":"2024-04-18T03:40:52.562733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'35","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:50.691091+0000","last_change":"2024-04-18T03:37:33.926064+0000","last_active":"2024-04-18T03:40:50.691091+0000","last_peered":"2024-04-18T03:40:50.691091+0000","last_clean":"2024-04-18T03:40:50.691091+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:40:50.691091+0000","last_undegraded":"2024-04-18T03:40:50.691091+0000","last_fullsized":"2024-04-18T03:40:50.691091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'34","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.840223+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:40:47.840223+0000","last_peered":"2024-04-18T03:40:47.840223+0000","last_clean":"2024-04-18T03:40:47.840223+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:40:47.840223+0000","last_undegraded":"2024-04-18T03:40:47.840223+0000","last_fullsized":"2024-04-18T03:40:47.840223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'43","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.563442+0000","last_change":"2024-04-18T03:37:34.301227+0000","last_active":"2024-04-18T03:40:52.563442+0000","last_peered":"2024-04-18T03:40:52.563442+0000","last_clean":"2024-04-18T03:40:52.563442+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:40:52.563442+0000","last_undegraded":"2024-04-18T03:40:52.563442+0000","last_fullsized":"2024-04-18T03:40:52.563442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'19","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.119979+0000","last_change":"2024-04-18T03:41:35.120215+0000","last_active":"2024-04-18T03:41:35.119979+0000","last_peered":"2024-04-18T03:41:35.119979+0000","last_clean":"2024-04-18T03:41:35.119979+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:41:35.119979+0000","last_undegraded":"2024-04-18T03:41:35.119979+0000","last_fullsized":"2024-04-18T03:41:35.119979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-18T03:41:35.119916+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-18T03:41:35.119916+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.119916+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:36.559004+0000","scrub_duration":0.0067098039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'38","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.725720+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:40:49.725720+0000","last_peered":"2024-04-18T03:40:49.725720+0000","last_clean":"2024-04-18T03:40:49.725720+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:40:49.725720+0000","last_undegraded":"2024-04-18T03:40:49.725720+0000","last_fullsized":"2024-04-18T03:40:49.725720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'43","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562575+0000","last_change":"2024-04-18T03:37:34.297675+0000","last_active":"2024-04-18T03:40:52.562575+0000","last_peered":"2024-04-18T03:40:52.562575+0000","last_clean":"2024-04-18T03:40:52.562575+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:40:52.562575+0000","last_undegraded":"2024-04-18T03:40:52.562575+0000","last_fullsized":"2024-04-18T03:40:52.562575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'912","reported_seq":942,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.377433+0000","last_change":"2024-04-18T03:41:36.377560+0000","last_active":"2024-04-18T03:41:36.377433+0000","last_peered":"2024-04-18T03:41:36.377433+0000","last_clean":"2024-04-18T03:41:36.377433+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:41:36.377433+0000","last_undegraded":"2024-04-18T03:41:36.377433+0000","last_fullsized":"2024-04-18T03:41:36.377433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'912","last_scrub_stamp":"2024-04-18T03:41:36.377398+0000","last_deep_scrub":"27'912","last_deep_scrub_stamp":"2024-04-18T03:41:36.377398+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.377398+0000","objects_scrubbed":4,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:56.129888+0000","scrub_duration":0.019987532999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'43","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.854048+0000","last_change":"2024-04-18T03:37:38.338734+0000","last_active":"2024-04-18T03:40:47.854048+0000","last_peered":"2024-04-18T03:40:47.854048+0000","last_clean":"2024-04-18T03:40:47.854048+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:40:47.854048+0000","last_undegraded":"2024-04-18T03:40:47.854048+0000","last_fullsized":"2024-04-18T03:40:47.854048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'49","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.795679+0000","last_change":"2024-04-18T03:41:37.795901+0000","last_active":"2024-04-18T03:41:37.795679+0000","last_peered":"2024-04-18T03:41:37.795679+0000","last_clean":"2024-04-18T03:41:37.795679+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:41:37.795679+0000","last_undegraded":"2024-04-18T03:41:37.795679+0000","last_fullsized":"2024-04-18T03:41:37.795679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:41:37.795629+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:41:37.795629+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.795629+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:34.458395+0000","scrub_duration":0.0033140940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'48","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.691582+0000","last_change":"2024-04-18T03:37:33.923903+0000","last_active":"2024-04-18T03:40:52.691582+0000","last_peered":"2024-04-18T03:40:52.691582+0000","last_clean":"2024-04-18T03:40:52.691582+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:40:52.691582+0000","last_undegraded":"2024-04-18T03:40:52.691582+0000","last_fullsized":"2024-04-18T03:40:52.691582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'45","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.854809+0000","last_change":"2024-04-18T03:37:38.329003+0000","last_active":"2024-04-18T03:40:47.854809+0000","last_peered":"2024-04-18T03:40:47.854809+0000","last_clean":"2024-04-18T03:40:47.854809+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:40:47.854809+0000","last_undegraded":"2024-04-18T03:40:47.854809+0000","last_fullsized":"2024-04-18T03:40:47.854809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'50","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.553405+0000","last_change":"2024-04-18T03:37:34.301957+0000","last_active":"2024-04-18T03:40:52.553405+0000","last_peered":"2024-04-18T03:40:52.553405+0000","last_clean":"2024-04-18T03:40:52.553405+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:40:52.553405+0000","last_undegraded":"2024-04-18T03:40:52.553405+0000","last_fullsized":"2024-04-18T03:40:52.553405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'24","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.804324+0000","last_change":"2024-04-18T03:41:41.804588+0000","last_active":"2024-04-18T03:41:41.804324+0000","last_peered":"2024-04-18T03:41:41.804324+0000","last_clean":"2024-04-18T03:41:41.804324+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:41:41.804324+0000","last_undegraded":"2024-04-18T03:41:41.804324+0000","last_fullsized":"2024-04-18T03:41:41.804324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:41.804273+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:41.804273+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.804273+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:43.233719+0000","scrub_duration":0.0031319410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'39","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845513+0000","last_change":"2024-04-18T03:37:38.334189+0000","last_active":"2024-04-18T03:40:47.845513+0000","last_peered":"2024-04-18T03:40:47.845513+0000","last_clean":"2024-04-18T03:40:47.845513+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:40:47.845513+0000","last_undegraded":"2024-04-18T03:40:47.845513+0000","last_fullsized":"2024-04-18T03:40:47.845513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'73","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562018+0000","last_change":"2024-04-18T03:37:34.306067+0000","last_active":"2024-04-18T03:40:52.562018+0000","last_peered":"2024-04-18T03:40:52.562018+0000","last_clean":"2024-04-18T03:40:52.562018+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:40:52.562018+0000","last_undegraded":"2024-04-18T03:40:52.562018+0000","last_fullsized":"2024-04-18T03:40:52.562018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'23","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.673371+0000","last_change":"2024-04-18T03:37:33.930455+0000","last_active":"2024-04-18T03:40:49.673371+0000","last_peered":"2024-04-18T03:40:49.673371+0000","last_clean":"2024-04-18T03:40:49.673371+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:40:49.673371+0000","last_undegraded":"2024-04-18T03:40:49.673371+0000","last_fullsized":"2024-04-18T03:40:49.673371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:32.876757+0000","last_clean_scrub_stamp":"2024-04-18T03:37:32.876757+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'42","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.845544+0000","last_change":"2024-04-18T03:37:38.558350+0000","last_active":"2024-04-18T03:40:47.845544+0000","last_peered":"2024-04-18T03:40:47.845544+0000","last_clean":"2024-04-18T03:40:47.845544+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:40:47.845544+0000","last_undegraded":"2024-04-18T03:40:47.845544+0000","last_fullsized":"2024-04-18T03:40:47.845544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.147105+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:41:32.147105+0000","last_peered":"2024-04-18T03:41:32.147105+0000","last_clean":"2024-04-18T03:41:32.147105+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:41:32.147105+0000","last_undegraded":"2024-04-18T03:41:32.147105+0000","last_fullsized":"2024-04-18T03:41:32.147105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'54","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552696+0000","last_change":"2024-04-18T03:37:34.298464+0000","last_active":"2024-04-18T03:40:52.552696+0000","last_peered":"2024-04-18T03:40:52.552696+0000","last_clean":"2024-04-18T03:40:52.552696+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:40:52.552696+0000","last_undegraded":"2024-04-18T03:40:52.552696+0000","last_fullsized":"2024-04-18T03:40:52.552696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'20","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.773889+0000","last_change":"2024-04-18T03:41:37.774141+0000","last_active":"2024-04-18T03:41:37.773889+0000","last_peered":"2024-04-18T03:41:37.773889+0000","last_clean":"2024-04-18T03:41:37.773889+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:41:37.773889+0000","last_undegraded":"2024-04-18T03:41:37.773889+0000","last_fullsized":"2024-04-18T03:41:37.773889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-18T03:41:37.773836+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-18T03:41:37.773836+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.773836+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:00.273347+0000","scrub_duration":0.0031860970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'50","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.105383+0000","last_change":"2024-04-18T03:38:23.708738+0000","last_active":"2024-04-18T03:41:35.105383+0000","last_peered":"2024-04-18T03:41:35.105383+0000","last_clean":"2024-04-18T03:41:35.105383+0000","last_became_active":"2024-04-18T03:38:23.707524+0000","last_became_peered":"2024-04-18T03:38:23.707524+0000","last_unstale":"2024-04-18T03:41:35.105383+0000","last_undegraded":"2024-04-18T03:41:35.105383+0000","last_fullsized":"2024-04-18T03:41:35.105383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'65","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.551567+0000","last_change":"2024-04-18T03:37:34.310190+0000","last_active":"2024-04-18T03:40:52.551567+0000","last_peered":"2024-04-18T03:40:52.551567+0000","last_clean":"2024-04-18T03:40:52.551567+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:40:52.551567+0000","last_undegraded":"2024-04-18T03:40:52.551567+0000","last_fullsized":"2024-04-18T03:40:52.551567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'19","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.981650+0000","last_change":"2024-04-18T03:41:50.981853+0000","last_active":"2024-04-18T03:41:50.981650+0000","last_peered":"2024-04-18T03:41:50.981650+0000","last_clean":"2024-04-18T03:41:50.981650+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:41:50.981650+0000","last_undegraded":"2024-04-18T03:41:50.981650+0000","last_fullsized":"2024-04-18T03:41:50.981650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-18T03:41:50.981601+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-18T03:41:50.981601+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.981601+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:26.735105+0000","scrub_duration":0.0030809969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.363292+0000","last_change":"2024-04-18T03:41:41.363413+0000","last_active":"2024-04-18T03:41:41.363292+0000","last_peered":"2024-04-18T03:41:41.363292+0000","last_clean":"2024-04-18T03:41:41.363292+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:41:41.363292+0000","last_undegraded":"2024-04-18T03:41:41.363292+0000","last_fullsized":"2024-04-18T03:41:41.363292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:41.363263+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:41.363263+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.363263+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:57.623994+0000","scrub_duration":0.015753157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.178745+0000","last_change":"2024-04-18T03:41:52.178932+0000","last_active":"2024-04-18T03:41:52.178745+0000","last_peered":"2024-04-18T03:41:52.178745+0000","last_clean":"2024-04-18T03:41:52.178745+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:41:52.178745+0000","last_undegraded":"2024-04-18T03:41:52.178745+0000","last_fullsized":"2024-04-18T03:41:52.178745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:41:52.178693+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:41:52.178693+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.178693+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:24.633857+0000","scrub_duration":0.0034843679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.485713+0000","last_change":"2024-04-18T03:41:50.486008+0000","last_active":"2024-04-18T03:41:50.485713+0000","last_peered":"2024-04-18T03:41:50.485713+0000","last_clean":"2024-04-18T03:41:50.485713+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:41:50.485713+0000","last_undegraded":"2024-04-18T03:41:50.485713+0000","last_fullsized":"2024-04-18T03:41:50.485713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-18T03:41:50.485653+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-18T03:41:50.485653+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.485653+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:10.030901+0000","scrub_duration":0.0037180400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1516","reported_seq":1546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:48.945074+0000","last_change":"2024-04-18T03:41:48.945260+0000","last_active":"2024-04-18T03:41:48.945074+0000","last_peered":"2024-04-18T03:41:48.945074+0000","last_clean":"2024-04-18T03:41:48.945074+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:41:48.945074+0000","last_undegraded":"2024-04-18T03:41:48.945074+0000","last_fullsized":"2024-04-18T03:41:48.945074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1516","last_scrub_stamp":"2024-04-18T03:41:48.945028+0000","last_deep_scrub":"27'1516","last_deep_scrub_stamp":"2024-04-18T03:41:48.945028+0000","last_clean_scrub_stamp":"2024-04-18T03:41:48.945028+0000","objects_scrubbed":1,"log_size":1516,"log_dups_size":0,"ondisk_log_size":1516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:32.113215+0000","scrub_duration":0.02246687,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1489,"num_write_kb":4584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'44","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.811359+0000","last_change":"2024-04-18T03:41:36.811567+0000","last_active":"2024-04-18T03:41:36.811359+0000","last_peered":"2024-04-18T03:41:36.811359+0000","last_clean":"2024-04-18T03:41:36.811359+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:41:36.811359+0000","last_undegraded":"2024-04-18T03:41:36.811359+0000","last_fullsized":"2024-04-18T03:41:36.811359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:36.811310+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:36.811310+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.811310+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:21:31.448768+0000","scrub_duration":0.0032001960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'55","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856504+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:40:47.856504+0000","last_peered":"2024-04-18T03:40:47.856504+0000","last_clean":"2024-04-18T03:40:47.856504+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:40:47.856504+0000","last_undegraded":"2024-04-18T03:40:47.856504+0000","last_fullsized":"2024-04-18T03:40:47.856504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'69","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.105372+0000","last_change":"2024-04-18T03:37:34.303303+0000","last_active":"2024-04-18T03:41:35.105372+0000","last_peered":"2024-04-18T03:41:35.105372+0000","last_clean":"2024-04-18T03:41:35.105372+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:41:35.105372+0000","last_undegraded":"2024-04-18T03:41:35.105372+0000","last_fullsized":"2024-04-18T03:41:35.105372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'59","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:44.527159+0000","last_change":"2024-04-18T03:41:44.527159+0000","last_active":"2024-04-18T03:41:44.527159+0000","last_peered":"2024-04-18T03:41:44.527159+0000","last_clean":"2024-04-18T03:41:44.527159+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:41:44.527159+0000","last_undegraded":"2024-04-18T03:41:44.527159+0000","last_fullsized":"2024-04-18T03:41:44.527159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2024-04-18T03:41:44.526795+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2024-04-18T03:41:44.526795+0000","last_clean_scrub_stamp":"2024-04-18T03:41:44.526795+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:52.585213+0000","scrub_duration":0.0037446340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'58","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.620423+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:41:34.620423+0000","last_peered":"2024-04-18T03:41:34.620423+0000","last_clean":"2024-04-18T03:41:34.620423+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:41:34.620423+0000","last_undegraded":"2024-04-18T03:41:34.620423+0000","last_fullsized":"2024-04-18T03:41:34.620423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'52","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.116526+0000","last_change":"2024-04-18T03:41:33.116526+0000","last_active":"2024-04-18T03:41:33.116526+0000","last_peered":"2024-04-18T03:41:33.116526+0000","last_clean":"2024-04-18T03:41:33.116526+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:41:33.116526+0000","last_undegraded":"2024-04-18T03:41:33.116526+0000","last_fullsized":"2024-04-18T03:41:33.116526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-04-18T03:41:33.116136+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-04-18T03:41:33.116136+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.116136+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:45.051099+0000","scrub_duration":0.003731814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'50","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.550188+0000","last_change":"2024-04-18T03:37:34.310629+0000","last_active":"2024-04-18T03:40:52.550188+0000","last_peered":"2024-04-18T03:40:52.550188+0000","last_clean":"2024-04-18T03:40:52.550188+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:40:52.550188+0000","last_undegraded":"2024-04-18T03:40:52.550188+0000","last_fullsized":"2024-04-18T03:40:52.550188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'37","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.023198+0000","last_change":"2024-04-18T03:41:35.023421+0000","last_active":"2024-04-18T03:41:35.023198+0000","last_peered":"2024-04-18T03:41:35.023198+0000","last_clean":"2024-04-18T03:41:35.023198+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:41:35.023198+0000","last_undegraded":"2024-04-18T03:41:35.023198+0000","last_fullsized":"2024-04-18T03:41:35.023198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-18T03:41:35.023149+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-18T03:41:35.023149+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.023149+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:21:29.660608+0000","scrub_duration":0.002591814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'66","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560185+0000","last_change":"2024-04-18T03:38:23.515116+0000","last_active":"2024-04-18T03:40:52.560185+0000","last_peered":"2024-04-18T03:40:52.560185+0000","last_clean":"2024-04-18T03:40:52.560185+0000","last_became_active":"2024-04-18T03:38:23.514633+0000","last_became_peered":"2024-04-18T03:38:23.514633+0000","last_unstale":"2024-04-18T03:40:52.560185+0000","last_undegraded":"2024-04-18T03:40:52.560185+0000","last_fullsized":"2024-04-18T03:40:52.560185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'42","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.893755+0000","last_change":"2024-04-18T03:41:33.893909+0000","last_active":"2024-04-18T03:41:33.893755+0000","last_peered":"2024-04-18T03:41:33.893755+0000","last_clean":"2024-04-18T03:41:33.893755+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:41:33.893755+0000","last_undegraded":"2024-04-18T03:41:33.893755+0000","last_fullsized":"2024-04-18T03:41:33.893755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:41:33.893717+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:41:33.893717+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.893717+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:57.681786+0000","scrub_duration":0.0032070879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'49","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560900+0000","last_change":"2024-04-18T03:37:34.297162+0000","last_active":"2024-04-18T03:40:52.560900+0000","last_peered":"2024-04-18T03:40:52.560900+0000","last_clean":"2024-04-18T03:40:52.560900+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:40:52.560900+0000","last_undegraded":"2024-04-18T03:40:52.560900+0000","last_fullsized":"2024-04-18T03:40:52.560900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.874820+0000","last_change":"2024-04-18T03:41:39.875077+0000","last_active":"2024-04-18T03:41:39.874820+0000","last_peered":"2024-04-18T03:41:39.874820+0000","last_clean":"2024-04-18T03:41:39.874820+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:41:39.874820+0000","last_undegraded":"2024-04-18T03:41:39.874820+0000","last_fullsized":"2024-04-18T03:41:39.874820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:39.874768+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:39.874768+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.874768+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:28.114792+0000","scrub_duration":0.0035169509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'58","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:51.449204+0000","last_change":"2024-04-18T03:41:51.449409+0000","last_active":"2024-04-18T03:41:51.449204+0000","last_peered":"2024-04-18T03:41:51.449204+0000","last_clean":"2024-04-18T03:41:51.449204+0000","last_became_active":"2024-04-18T03:38:23.753851+0000","last_became_peered":"2024-04-18T03:38:23.753851+0000","last_unstale":"2024-04-18T03:41:51.449204+0000","last_undegraded":"2024-04-18T03:41:51.449204+0000","last_fullsized":"2024-04-18T03:41:51.449204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:41:51.449154+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:41:51.449154+0000","last_clean_scrub_stamp":"2024-04-18T03:41:51.449154+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:39.689178+0000","scrub_duration":0.003459279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"27'63","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.564131+0000","last_change":"2024-04-18T03:37:34.300843+0000","last_active":"2024-04-18T03:40:52.564131+0000","last_peered":"2024-04-18T03:40:52.564131+0000","last_clean":"2024-04-18T03:40:52.564131+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:40:52.564131+0000","last_undegraded":"2024-04-18T03:40:52.564131+0000","last_fullsized":"2024-04-18T03:40:52.564131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'62","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.545708+0000","last_change":"2024-04-18T03:37:34.302980+0000","last_active":"2024-04-18T03:40:52.545708+0000","last_peered":"2024-04-18T03:40:52.545708+0000","last_clean":"2024-04-18T03:40:52.545708+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:40:52.545708+0000","last_undegraded":"2024-04-18T03:40:52.545708+0000","last_fullsized":"2024-04-18T03:40:52.545708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'51","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562690+0000","last_change":"2024-04-18T03:37:34.301026+0000","last_active":"2024-04-18T03:40:52.562690+0000","last_peered":"2024-04-18T03:40:52.562690+0000","last_clean":"2024-04-18T03:40:52.562690+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:40:52.562690+0000","last_undegraded":"2024-04-18T03:40:52.562690+0000","last_fullsized":"2024-04-18T03:40:52.562690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'58","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.546006+0000","last_change":"2024-04-18T03:41:43.546229+0000","last_active":"2024-04-18T03:41:43.546006+0000","last_peered":"2024-04-18T03:41:43.546006+0000","last_clean":"2024-04-18T03:41:43.546006+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:41:43.546006+0000","last_undegraded":"2024-04-18T03:41:43.546006+0000","last_fullsized":"2024-04-18T03:41:43.546006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:41:43.545942+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:41:43.545942+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.545942+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:44.975388+0000","scrub_duration":0.003138166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'55","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562659+0000","last_change":"2024-04-18T03:37:34.305067+0000","last_active":"2024-04-18T03:40:52.562659+0000","last_peered":"2024-04-18T03:40:52.562659+0000","last_clean":"2024-04-18T03:40:52.562659+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:40:52.562659+0000","last_undegraded":"2024-04-18T03:40:52.562659+0000","last_fullsized":"2024-04-18T03:40:52.562659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'55","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.554022+0000","last_change":"2024-04-18T03:37:34.307984+0000","last_active":"2024-04-18T03:40:52.554022+0000","last_peered":"2024-04-18T03:40:52.554022+0000","last_clean":"2024-04-18T03:40:52.554022+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:40:52.554022+0000","last_undegraded":"2024-04-18T03:40:52.554022+0000","last_fullsized":"2024-04-18T03:40:52.554022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'53","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547823+0000","last_change":"2024-04-18T03:37:34.291902+0000","last_active":"2024-04-18T03:40:52.547823+0000","last_peered":"2024-04-18T03:40:52.547823+0000","last_clean":"2024-04-18T03:40:52.547823+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:40:52.547823+0000","last_undegraded":"2024-04-18T03:40:52.547823+0000","last_fullsized":"2024-04-18T03:40:52.547823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'59","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.549187+0000","last_change":"2024-04-18T03:37:34.288971+0000","last_active":"2024-04-18T03:40:52.549187+0000","last_peered":"2024-04-18T03:40:52.549187+0000","last_clean":"2024-04-18T03:40:52.549187+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:40:52.549187+0000","last_undegraded":"2024-04-18T03:40:52.549187+0000","last_fullsized":"2024-04-18T03:40:52.549187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'48","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.899738+0000","last_change":"2024-04-18T03:41:38.899933+0000","last_active":"2024-04-18T03:41:38.899738+0000","last_peered":"2024-04-18T03:41:38.899738+0000","last_clean":"2024-04-18T03:41:38.899738+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:41:38.899738+0000","last_undegraded":"2024-04-18T03:41:38.899738+0000","last_fullsized":"2024-04-18T03:41:38.899738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:41:38.899689+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:41:38.899689+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.899689+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:20:58.444937+0000","scrub_duration":0.0032972489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'44","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.742331+0000","last_change":"2024-04-18T03:41:41.742622+0000","last_active":"2024-04-18T03:41:41.742331+0000","last_peered":"2024-04-18T03:41:41.742331+0000","last_clean":"2024-04-18T03:41:41.742331+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:41:41.742331+0000","last_undegraded":"2024-04-18T03:41:41.742331+0000","last_fullsized":"2024-04-18T03:41:41.742331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:41.742222+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:41.742222+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.742222+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:43.181309+0000","scrub_duration":0.0036324560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'50","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.556585+0000","last_change":"2024-04-18T03:37:34.310497+0000","last_active":"2024-04-18T03:40:52.556585+0000","last_peered":"2024-04-18T03:40:52.556585+0000","last_clean":"2024-04-18T03:40:52.556585+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:40:52.556585+0000","last_undegraded":"2024-04-18T03:40:52.556585+0000","last_fullsized":"2024-04-18T03:40:52.556585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'53","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.560363+0000","last_change":"2024-04-18T03:38:23.515120+0000","last_active":"2024-04-18T03:40:52.560363+0000","last_peered":"2024-04-18T03:40:52.560363+0000","last_clean":"2024-04-18T03:40:52.560363+0000","last_became_active":"2024-04-18T03:38:23.514732+0000","last_became_peered":"2024-04-18T03:38:23.514732+0000","last_unstale":"2024-04-18T03:40:52.560363+0000","last_undegraded":"2024-04-18T03:40:52.560363+0000","last_fullsized":"2024-04-18T03:40:52.560363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'54","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561913+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:40:52.561913+0000","last_peered":"2024-04-18T03:40:52.561913+0000","last_clean":"2024-04-18T03:40:52.561913+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:40:52.561913+0000","last_undegraded":"2024-04-18T03:40:52.561913+0000","last_fullsized":"2024-04-18T03:40:52.561913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'51","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561909+0000","last_change":"2024-04-18T03:37:34.306912+0000","last_active":"2024-04-18T03:40:52.561909+0000","last_peered":"2024-04-18T03:40:52.561909+0000","last_clean":"2024-04-18T03:40:52.561909+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:40:52.561909+0000","last_undegraded":"2024-04-18T03:40:52.561909+0000","last_fullsized":"2024-04-18T03:40:52.561909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'54","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.552389+0000","last_change":"2024-04-18T03:37:34.308510+0000","last_active":"2024-04-18T03:40:52.552389+0000","last_peered":"2024-04-18T03:40:52.552389+0000","last_clean":"2024-04-18T03:40:52.552389+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:40:52.552389+0000","last_undegraded":"2024-04-18T03:40:52.552389+0000","last_fullsized":"2024-04-18T03:40:52.552389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'51","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547154+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:40:52.547154+0000","last_peered":"2024-04-18T03:40:52.547154+0000","last_clean":"2024-04-18T03:40:52.547154+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:40:52.547154+0000","last_undegraded":"2024-04-18T03:40:52.547154+0000","last_fullsized":"2024-04-18T03:40:52.547154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'55","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562606+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:40:52.562606+0000","last_peered":"2024-04-18T03:40:52.562606+0000","last_clean":"2024-04-18T03:40:52.562606+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:40:52.562606+0000","last_undegraded":"2024-04-18T03:40:52.562606+0000","last_fullsized":"2024-04-18T03:40:52.562606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'40","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.620547+0000","last_change":"2024-04-18T03:37:34.300341+0000","last_active":"2024-04-18T03:41:34.620547+0000","last_peered":"2024-04-18T03:41:34.620547+0000","last_clean":"2024-04-18T03:41:34.620547+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:41:34.620547+0000","last_undegraded":"2024-04-18T03:41:34.620547+0000","last_fullsized":"2024-04-18T03:41:34.620547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:48.269903+0000","last_change":"2024-04-18T03:41:48.270196+0000","last_active":"2024-04-18T03:41:48.269903+0000","last_peered":"2024-04-18T03:41:48.269903+0000","last_clean":"2024-04-18T03:41:48.269903+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:41:48.269903+0000","last_undegraded":"2024-04-18T03:41:48.269903+0000","last_fullsized":"2024-04-18T03:41:48.269903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:48.269851+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:48.269851+0000","last_clean_scrub_stamp":"2024-04-18T03:41:48.269851+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:50.730224+0000","scrub_duration":0.0035341819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.001693+0000","last_change":"2024-04-18T03:41:33.001693+0000","last_active":"2024-04-18T03:41:33.001693+0000","last_peered":"2024-04-18T03:41:33.001693+0000","last_clean":"2024-04-18T03:41:33.001693+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:41:33.001693+0000","last_undegraded":"2024-04-18T03:41:33.001693+0000","last_fullsized":"2024-04-18T03:41:33.001693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:33.001450+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:33.001450+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.001450+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:23.512254+0000","scrub_duration":0.0028028340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'48","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.600665+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:41:35.600665+0000","last_peered":"2024-04-18T03:41:35.600665+0000","last_clean":"2024-04-18T03:41:35.600665+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:41:35.600665+0000","last_undegraded":"2024-04-18T03:41:35.600665+0000","last_fullsized":"2024-04-18T03:41:35.600665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31140456,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":3113,"num_write_kb":31587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62341120,"data_stored":62280912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3842,"ondisk_log_size":3842,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509496,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49160,"kb_used_data":13952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94322680,"statfs":{"total":96636764160,"available":96586424320,"internally_reserved":0,"allocated":14286848,"data_stored":14110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.127,"5min":1.286,"15min":1.286},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86599999999999999,"15min":0.89000000000000001},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.161,"5min":1.331,"15min":1.331},"last":0.95499999999999996}]},{"osd":1,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83899999999999997,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1699999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82999999999999996,"15min":0.874},"min":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.208,"5min":1.724,"15min":1.724},"last":1.1180000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0820000000000001,"5min":1.274,"15min":1.274},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.95699999999999996,"15min":0.98599999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2150000000000001,"5min":1.329,"15min":1.329},"last":1.0640000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.88600000000000001},"min":{"1min":0.52300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1419999999999999,"5min":1.228,"15min":1.228},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.83699999999999997},"min":{"1min":0.57199999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.095,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2609999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.093},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4239999999999999,"5min":2.198,"15min":2.198},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.63900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3839999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.999,"15min":1.0069999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2589999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0469999999999999,"15min":1.0680000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.351,"5min":1.651,"15min":1.651},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.0629999999999999},"min":{"1min":0.67700000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4359999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0860000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43684,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":8679424,"data_stored":8504374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80900000000000005,"15min":0.83999999999999997},"min":{"1min":0.52900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.872,"15min":0.89200000000000002},"min":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.111,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.94299999999999995,"15min":0.96399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1879999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.85499999999999998,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2829999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.206},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.68799999999999994,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.0069999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.90300000000000002,"15min":0.90900000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.179,"5min":1.298,"15min":1.298},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.94399999999999995,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1180000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.407}]},{"osd":5,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94199999999999995,"15min":0.93100000000000005},"min":{"1min":0.72999999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.304,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.071},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.363,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.675},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1240000000000001,"15min":1.127},"min":{"1min":0.878,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3819999999999999,"5min":1.621,"15min":1.621},"last":1.1299999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0449999999999999,"15min":1.0509999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.21,"5min":1.395,"15min":1.395},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.1579999999999999,"15min":1.1259999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.45,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.8260000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542200,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57928,"kb_used_data":18624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94313912,"statfs":{"total":96636764160,"available":96577445888,"internally_reserved":0,"allocated":19070976,"data_stored":18894785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.78600000000000003,"15min":0.80600000000000005},"min":{"1min":0.56399999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.095,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.84799999999999998,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1499999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90500000000000003,"15min":0.94499999999999995},"min":{"1min":0.62,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3540000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.123,"15min":1.123},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.86699999999999999,"15min":0.93000000000000005},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2490000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.90300000000000002,"15min":0.94199999999999995},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1899999999999999,"5min":1.272,"15min":1.272},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90000000000000002,"15min":0.94399999999999995},"min":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.232},"last":0.88},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97399999999999998,"15min":1.014},"min":{"1min":0.66300000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.212,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.91500000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2709999999999999,"5min":1.679,"15min":1.679},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.97499999999999998,"15min":0.98199999999999998},"min":{"1min":0.72899999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.268,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.89500000000000002,"15min":0.92200000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1120000000000001,"5min":1.617,"15min":1.617},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0389999999999999,"15min":1.0660000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3169999999999999,"5min":1.496,"15min":1.496},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.119},"min":{"1min":0.66200000000000003,"5min":0.625,"15min":0.625},"max":{"1min":1.3109999999999999,"5min":1.593,"15min":1.593},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.02,"5min":1.014,"15min":1.006},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2430000000000001,"5min":1.462,"15min":1.462},"last":1.2330000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":116344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83399999999999996,"15min":0.89500000000000002},"min":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0760000000000001,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":1.02},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81899999999999995,"15min":0.84699999999999998},"min":{"1min":0.55800000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.101,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83799999999999997,"15min":0.88700000000000001},"min":{"1min":0.60299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.129,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.81299999999999994,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86299999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90200000000000002,"15min":0.93400000000000005},"min":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1359999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.98799999999999999,"15min":1.038},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1919999999999999,"5min":1.536,"15min":1.536},"last":1.1499999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":0.98599999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1890000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.755},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.236,"5min":1.472,"15min":1.472},"last":1.1040000000000001}]},{"osd":4,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98299999999999998,"15min":1.03},"min":{"1min":0.58599999999999997,"5min":0.375,"15min":0.375},"max":{"1min":1.252,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0209999999999999,"15min":1.075},"min":{"1min":0.83199999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2749999999999999,"5min":1.631,"15min":1.631},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.90300000000000002,"15min":0.93700000000000006},"min":{"1min":0.64500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1739999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.0980000000000001,"15min":1.1419999999999999},"min":{"1min":0.65800000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.488,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.998,"15min":1.04},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.256,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.1850000000000001,"15min":1.2470000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.627,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96899999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":12932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":13242368,"data_stored":13068331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66200000000000003,"15min":0.67200000000000004},"min":{"1min":0.49399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1459999999999999,"5min":2.202,"15min":2.202},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70599999999999996,"15min":0.72099999999999997},"min":{"1min":0.42399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.86299999999999999,"5min":1.272,"15min":1.272},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.753,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.0389999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.069,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.55200000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1890000000000001,"5min":1.821,"15min":1.821},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.63700000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.619,"15min":1.619},"last":1.127},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.96699999999999997,"15min":0.94699999999999995},"min":{"1min":0.77100000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.014,"15min":1.024},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3660000000000001,"5min":1.966,"15min":1.966},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.998,"5min":1.042,"15min":1.0229999999999999},"min":{"1min":0.70999999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2330000000000001,"5min":1.845,"15min":1.845},"last":1.052}]},{"osd":6,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.042,"15min":1.0600000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2769999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.097,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.627,"5min":1.764,"15min":1.764},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.042,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.016},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4099999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.0860000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35844,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335996,"statfs":{"total":96636764160,"available":96600059904,"internally_reserved":0,"allocated":651264,"data_stored":484747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.626,"15min":0.64800000000000002},"min":{"1min":0.38300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.69899999999999995},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1679999999999999,"5min":1.532,"15min":1.532},"last":0.502}]},{"osd":1,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.228,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98299999999999998,"5min":1.214,"15min":1.214},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.28599999999999998,"5min":0.253,"15min":0.253},"max":{"1min":1.046,"5min":1.246,"15min":1.246},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.438,"5min":0.318,"15min":0.318},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.89600000000000002,"15min":0.92500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.98299999999999998},"min":{"1min":0.59799999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98899999999999999,"15min":1.0129999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4710000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.008},"min":{"1min":0.58999999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.077,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.998,"15min":1.024},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.321,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0209999999999999,"15min":1.0700000000000001},"min":{"1min":0.61299999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.242,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4710000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.90400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35492,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336348,"statfs":{"total":96636764160,"available":96600420352,"internally_reserved":0,"allocated":290816,"data_stored":116414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58199999999999996,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.745,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76200000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.51900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92500000000000004,"5min":1.321,"15min":1.321},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.83299999999999996},"min":{"1min":0.66400000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0169999999999999,"5min":1.583,"15min":1.583},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.79800000000000004,"15min":0.79100000000000004},"min":{"1min":0.56899999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1259999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.077}]},{"osd":4,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.90900000000000003,"15min":0.93500000000000005},"min":{"1min":0.72499999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.206,"5min":1.337,"15min":1.337},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.872,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.72399999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1870000000000001,"5min":1.274,"15min":1.274},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"min":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2250000000000001,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.016},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":0.998},"min":{"1min":0.71699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.296,"5min":1.353,"15min":1.353},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0640000000000001,"15min":1.1319999999999999},"min":{"1min":0.80500000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.423,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.999,"5min":1.0620000000000001,"15min":1.1140000000000001},"min":{"1min":0.80400000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.256,"5min":2.242,"15min":2.242},"last":1.125}]},{"osd":7,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.079,"15min":1.129},"min":{"1min":0.78500000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3799999999999999,"5min":2.044,"15min":2.044},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1000000000000001,"15min":1.139},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.296,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.167}]}]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44264,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94327576,"statfs":{"total":96636764160,"available":96591437824,"internally_reserved":0,"allocated":9273344,"data_stored":9094201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86599999999999999,"5min":1.022,"15min":1.022},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.55300000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.69799999999999995},"min":{"1min":0.59199999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90500000000000003,"5min":1.016,"15min":1.016},"last":0.621},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0029999999999999,"5min":1.103,"15min":1.103},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.68200000000000005},"min":{"1min":0.42499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.026,"5min":1.28,"15min":1.28},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74299999999999999,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":1.234,"15min":1.234},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Apr 18 03:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.69999999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.151},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.76700000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.081,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.999,"15min":0.97099999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0509999999999999},"min":{"1min":0.746,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.302}]},{"osd":6,"last update":"Thu Apr 18 03:41:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.036,"15min":1.032},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.093,"5min":1.0840000000000001,"15min":1.0660000000000001},"min":{"1min":0.878,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2769999999999999,"5min":1.589,"15min":1.589},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.89900000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2170000000000001,"5min":1.484,"15min":1.484},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.91400000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.387,"5min":1.544,"15min":1.544},"last":1.2569999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14004224,"data_stored":13993949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18194432,"data_stored":18188163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:41:56.331 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.331 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.331 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.331 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.331 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.332 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.333 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.334 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.334 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.334 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.334 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.334 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.334 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.334 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.334 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.335 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.336 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.337 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.337 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.337 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.337 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.337 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-18T03:37:32.876757+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=32, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.337 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.337 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.337 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.338 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.338 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.338 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.338 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.338 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.338 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.338 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.338 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.339 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.339 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.339 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.339 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.339 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.339 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.339 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.339 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:41:56.340 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T03:42:10.712 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:42:10.715 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:42:16.342 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:42:16.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78e634700 1 Processor -- start 2024-04-18T03:42:16.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78e634700 1 -- start start 2024-04-18T03:42:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78e634700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78815e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78e634700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa78806b7a0 0x7fa788146390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78e634700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78815e670 con 0x7fa7881468d0 2024-04-18T03:42:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78e634700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880d2c60 con 0x7fa78806b7a0 2024-04-18T03:42:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78e634700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880d1be0 con 0x7fa78806b3c0 2024-04-18T03:42:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78ce31700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa78806b7a0 0x7fa788146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78d632700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:16.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78ce31700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa78806b7a0 0x7fa788146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:57754/0 (socket says 172.21.15.157:57754) 2024-04-18T03:42:16.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78ce31700 1 -- 172.21.15.157:0/3438549243 learned_addr learned my addr 172.21.15.157:0/3438549243 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78ce31700 1 -- 172.21.15.157:0/3438549243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 msgr2=0x7fa78815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78ce31700 1 --2- 172.21.15.157:0/3438549243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78815e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78ce31700 1 -- 172.21.15.157:0/3438549243 >> v1:172.21.15.175:6789/0 conn(0x7fa7881468d0 legacy=0x7fa788160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78ce31700 1 -- 172.21.15.157:0/3438549243 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880d1ec0 con 0x7fa78806b7a0 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.462+0000 7fa78d632700 1 --2- 172.21.15.157:0/3438549243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78ce31700 1 --2- 172.21.15.157:0/3438549243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 0x7fa788146390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa784009910 tx=0x7fa784009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b079cfdd5d5b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa77ffff700 1 -- 172.21.15.157:0/3438549243 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784011830 con 0x7fa78806b7a0 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa77ffff700 1 -- 172.21.15.157:0/3438549243 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784011990 con 0x7fa78806b7a0 2024-04-18T03:42:16.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa77ffff700 1 -- 172.21.15.157:0/3438549243 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784011d40 con 0x7fa78806b7a0 2024-04-18T03:42:16.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 -- 172.21.15.157:0/3438549243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 msgr2=0x7fa788146390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:16.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 --2- 172.21.15.157:0/3438549243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 0x7fa788146390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa784009910 tx=0x7fa784009c20 comp rx=0 tx=0).stop 2024-04-18T03:42:16.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 -- 172.21.15.157:0/3438549243 shutdown_connections 2024-04-18T03:42:16.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 --2- 172.21.15.157:0/3438549243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 0x7fa788146390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 --2- 172.21.15.157:0/3438549243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 -- 172.21.15.157:0/3438549243 >> 172.21.15.157:0/3438549243 conn(0x7fa7880d2f20 msgr2=0x7fa7880d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:16.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 -- 172.21.15.157:0/3438549243 shutdown_connections 2024-04-18T03:42:16.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 -- 172.21.15.157:0/3438549243 wait complete. 2024-04-18T03:42:16.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.466+0000 7fa78e634700 1 Processor -- start 2024-04-18T03:42:16.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 -- start start 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78813f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 0x7fa7881f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7881468d0 0x7fa788140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78813fb50 con 0x7fa7881468d0 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881f3190 con 0x7fa78806b7a0 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881f3470 con 0x7fa78806b3c0 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7881468d0 0x7fa788140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7881468d0 0x7fa788140330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:49514/0 (socket says 172.21.15.157:49514) 2024-04-18T03:42:16.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 -- 172.21.15.157:0/2901820248 learned_addr learned my addr 172.21.15.157:0/2901820248 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78ce31700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 0x7fa7881f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78d632700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 -- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 msgr2=0x7fa78813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 -- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 msgr2=0x7fa7881f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 0x7fa7881f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 -- 172.21.15.157:0/2901820248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780094b0 con 0x7fa7881468d0 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78de33700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7881468d0 0x7fa788140330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa78000cb50 tx=0x7fa78000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa77dffb700 1 -- 172.21.15.157:0/2901820248 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780003c20 con 0x7fa7881468d0 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa77dffb700 1 -- 172.21.15.157:0/2901820248 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780003d80 con 0x7fa7881468d0 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa784009570 con 0x7fa7881468d0 2024-04-18T03:42:16.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa77dffb700 1 -- 172.21.15.157:0/2901820248 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78000aa20 con 0x7fa7881468d0 2024-04-18T03:42:16.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.470+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78813fe10 con 0x7fa7881468d0 2024-04-18T03:42:16.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.474+0000 7fa77dffb700 1 -- 172.21.15.157:0/2901820248 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa78000ab80 con 0x7fa7881468d0 2024-04-18T03:42:16.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.474+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78804e650 con 0x7fa7881468d0 2024-04-18T03:42:16.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.474+0000 7fa77dffb700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa76c066760 0x7fa76c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:16.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.474+0000 7fa77dffb700 1 -- 172.21.15.157:0/2901820248 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa780084470 con 0x7fa7881468d0 2024-04-18T03:42:16.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.474+0000 7fa78d632700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa76c066760 0x7fa76c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:16.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.474+0000 7fa78d632700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa76c066760 0x7fa76c068c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa778009d80 tx=0x7fa778009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:16.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.482+0000 7fa77dffb700 1 -- 172.21.15.157:0/2901820248 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fa7800514b0 con 0x7fa7881468d0 2024-04-18T03:42:16.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.653+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7880d2760 con 0x7fa76c066760 2024-04-18T03:42:16.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.669+0000 7fa77dffb700 1 -- 172.21.15.157:0/2901820248 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370473 (secure 0 0 0) 0x7fa7780099d0 con 0x7fa76c066760 2024-04-18T03:42:16.676 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:42:16.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa76c066760 msgr2=0x7fa76c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:16.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa76c066760 0x7fa76c068c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa778009d80 tx=0x7fa778009240 comp rx=0 tx=0).stop 2024-04-18T03:42:16.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7881468d0 msgr2=0x7fa788140330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:16.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7881468d0 0x7fa788140330 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa78000cb50 tx=0x7fa78000ce60 comp rx=0 tx=0).stop 2024-04-18T03:42:16.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 shutdown_connections 2024-04-18T03:42:16.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fa76c066760 0x7fa76c068c20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa78806b7a0 0x7fa7881f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7881468d0 0x7fa788140330 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 --2- 172.21.15.157:0/2901820248 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa78806b3c0 0x7fa78813f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:16.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 >> 172.21.15.157:0/2901820248 conn(0x7fa7880d2f20 msgr2=0x7fa78806e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:16.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 shutdown_connections 2024-04-18T03:42:16.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:16.677+0000 7fa78e634700 1 -- 172.21.15.157:0/2901820248 wait complete. 2024-04-18T03:42:16.681 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:42:16.695 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-04-18T03:42:15.877864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31730824,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":488,"num_write":3272,"num_write_kb":34003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8683,"ondisk_log_size":8683,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337712,"kb_used_data":64240,"kb_used_omap":12,"kb_used_meta":273395,"kb_avail":754637008,"statfs":{"total":773094113280,"available":772748296192,"internally_reserved":0,"allocated":65781760,"data_stored":64389399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":279957048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005247"},"pg_stats":[{"pgid":"2.1f","version":"27'44","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:47.313806+0000","last_change":"2024-04-18T03:41:47.313806+0000","last_active":"2024-04-18T03:41:47.313806+0000","last_peered":"2024-04-18T03:41:47.313806+0000","last_clean":"2024-04-18T03:41:47.313806+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:41:47.313806+0000","last_undegraded":"2024-04-18T03:41:47.313806+0000","last_fullsized":"2024-04-18T03:41:47.313806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:47.313394+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:47.313394+0000","last_clean_scrub_stamp":"2024-04-18T03:41:47.313394+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:44:53.111022+0000","scrub_duration":0.016391722000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'46","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.866590+0000","last_change":"2024-04-18T03:41:41.866853+0000","last_active":"2024-04-18T03:41:41.866590+0000","last_peered":"2024-04-18T03:41:41.866590+0000","last_clean":"2024-04-18T03:41:41.866590+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:41:41.866590+0000","last_undegraded":"2024-04-18T03:41:41.866590+0000","last_fullsized":"2024-04-18T03:41:41.866590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:41:41.866538+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:41:41.866538+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.866538+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:24:50.426740+0000","scrub_duration":0.0040658880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'49","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:10.758850+0000","last_change":"2024-04-18T03:42:10.759160+0000","last_active":"2024-04-18T03:42:10.758850+0000","last_peered":"2024-04-18T03:42:10.758850+0000","last_clean":"2024-04-18T03:42:10.758850+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:42:10.758850+0000","last_undegraded":"2024-04-18T03:42:10.758850+0000","last_fullsized":"2024-04-18T03:42:10.758850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:42:10.758788+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:42:10.758788+0000","last_clean_scrub_stamp":"2024-04-18T03:42:10.758788+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:31:09.759659+0000","scrub_duration":0.0038214120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'31","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:42.896356+0000","last_change":"2024-04-18T03:41:42.896476+0000","last_active":"2024-04-18T03:41:42.896356+0000","last_peered":"2024-04-18T03:41:42.896356+0000","last_clean":"2024-04-18T03:41:42.896356+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:41:42.896356+0000","last_undegraded":"2024-04-18T03:41:42.896356+0000","last_fullsized":"2024-04-18T03:41:42.896356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-18T03:41:42.896332+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-18T03:41:42.896332+0000","last_clean_scrub_stamp":"2024-04-18T03:41:42.896332+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:43.175299+0000","scrub_duration":0.013984702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:00.127133+0000","last_change":"2024-04-18T03:42:00.127409+0000","last_active":"2024-04-18T03:42:00.127133+0000","last_peered":"2024-04-18T03:42:00.127133+0000","last_clean":"2024-04-18T03:42:00.127133+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:42:00.127133+0000","last_undegraded":"2024-04-18T03:42:00.127133+0000","last_fullsized":"2024-04-18T03:42:00.127133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2024-04-18T03:42:00.127084+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2024-04-18T03:42:00.127084+0000","last_clean_scrub_stamp":"2024-04-18T03:42:00.127084+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:12:41.667041+0000","scrub_duration":0.002864746,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'43","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:11.735694+0000","last_change":"2024-04-18T03:42:11.736122+0000","last_active":"2024-04-18T03:42:11.735694+0000","last_peered":"2024-04-18T03:42:11.735694+0000","last_clean":"2024-04-18T03:42:11.735694+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:42:11.735694+0000","last_undegraded":"2024-04-18T03:42:11.735694+0000","last_fullsized":"2024-04-18T03:42:11.735694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:11.735577+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:11.735577+0000","last_clean_scrub_stamp":"2024-04-18T03:42:11.735577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:43:00.840459+0000","scrub_duration":0.0038637279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'67","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.648641+0000","last_change":"2024-04-18T03:42:02.648793+0000","last_active":"2024-04-18T03:42:02.648641+0000","last_peered":"2024-04-18T03:42:02.648641+0000","last_clean":"2024-04-18T03:42:02.648641+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:42:02.648641+0000","last_undegraded":"2024-04-18T03:42:02.648641+0000","last_fullsized":"2024-04-18T03:42:02.648641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2024-04-18T03:42:02.648608+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2024-04-18T03:42:02.648608+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.648608+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:38.402112+0000","scrub_duration":0.021057800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604669,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.786740+0000","last_change":"2024-04-18T03:41:35.786953+0000","last_active":"2024-04-18T03:41:35.786740+0000","last_peered":"2024-04-18T03:41:35.786740+0000","last_clean":"2024-04-18T03:41:35.786740+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:41:35.786740+0000","last_undegraded":"2024-04-18T03:41:35.786740+0000","last_fullsized":"2024-04-18T03:41:35.786740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:35.786690+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:35.786690+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.786690+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:04.481446+0000","scrub_duration":0.0030209529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'44","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856035+0000","last_change":"2024-04-18T03:37:38.330029+0000","last_active":"2024-04-18T03:40:47.856035+0000","last_peered":"2024-04-18T03:40:47.856035+0000","last_clean":"2024-04-18T03:40:47.856035+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:40:47.856035+0000","last_undegraded":"2024-04-18T03:40:47.856035+0000","last_fullsized":"2024-04-18T03:40:47.856035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'17","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:00.656713+0000","last_change":"2024-04-18T03:42:00.656917+0000","last_active":"2024-04-18T03:42:00.656713+0000","last_peered":"2024-04-18T03:42:00.656713+0000","last_clean":"2024-04-18T03:42:00.656713+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:42:00.656713+0000","last_undegraded":"2024-04-18T03:42:00.656713+0000","last_fullsized":"2024-04-18T03:42:00.656713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-18T03:42:00.656663+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-18T03:42:00.656663+0000","last_clean_scrub_stamp":"2024-04-18T03:42:00.656663+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:43.824850+0000","scrub_duration":0.005832009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'58","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:06.818907+0000","last_change":"2024-04-18T03:42:06.819151+0000","last_active":"2024-04-18T03:42:06.818907+0000","last_peered":"2024-04-18T03:42:06.818907+0000","last_clean":"2024-04-18T03:42:06.818907+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:42:06.818907+0000","last_undegraded":"2024-04-18T03:42:06.818907+0000","last_fullsized":"2024-04-18T03:42:06.818907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:42:06.818850+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:42:06.818850+0000","last_clean_scrub_stamp":"2024-04-18T03:42:06.818850+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:52.721939+0000","scrub_duration":0.0030012229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'40","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:01.729611+0000","last_change":"2024-04-18T03:42:01.729947+0000","last_active":"2024-04-18T03:42:01.729611+0000","last_peered":"2024-04-18T03:42:01.729611+0000","last_clean":"2024-04-18T03:42:01.729611+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:42:01.729611+0000","last_undegraded":"2024-04-18T03:42:01.729611+0000","last_fullsized":"2024-04-18T03:42:01.729611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-18T03:42:01.729554+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-18T03:42:01.729554+0000","last_clean_scrub_stamp":"2024-04-18T03:42:01.729554+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:14.563011+0000","scrub_duration":0.0038496120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'42","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:56.150196+0000","last_change":"2024-04-18T03:41:56.150196+0000","last_active":"2024-04-18T03:41:56.150196+0000","last_peered":"2024-04-18T03:41:56.150196+0000","last_clean":"2024-04-18T03:41:56.150196+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:41:56.150196+0000","last_undegraded":"2024-04-18T03:41:56.150196+0000","last_fullsized":"2024-04-18T03:41:56.150196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:41:56.149882+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:41:56.149882+0000","last_clean_scrub_stamp":"2024-04-18T03:41:56.149882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:58.610255+0000","scrub_duration":0.0030500380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'529","reported_seq":560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:53.786319+0000","last_change":"2024-04-18T03:41:53.786319+0000","last_active":"2024-04-18T03:41:53.786319+0000","last_peered":"2024-04-18T03:41:53.786319+0000","last_clean":"2024-04-18T03:41:53.786319+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:41:53.786319+0000","last_undegraded":"2024-04-18T03:41:53.786319+0000","last_fullsized":"2024-04-18T03:41:53.786319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'529","last_scrub_stamp":"2024-04-18T03:41:53.786199+0000","last_deep_scrub":"27'529","last_deep_scrub_stamp":"2024-04-18T03:41:53.786199+0000","last_clean_scrub_stamp":"2024-04-18T03:41:53.786199+0000","objects_scrubbed":2,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:25:02.346400+0000","scrub_duration":0.019822007999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'41","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.759188+0000","last_change":"2024-04-18T03:42:09.759531+0000","last_active":"2024-04-18T03:42:09.759188+0000","last_peered":"2024-04-18T03:42:09.759188+0000","last_clean":"2024-04-18T03:42:09.759188+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:42:09.759188+0000","last_undegraded":"2024-04-18T03:42:09.759188+0000","last_fullsized":"2024-04-18T03:42:09.759188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-18T03:42:09.759067+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-18T03:42:09.759067+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.759067+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:48:22.550220+0000","scrub_duration":0.0045383639999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.543775+0000","last_change":"2024-04-18T03:38:23.517111+0000","last_active":"2024-04-18T03:40:52.543775+0000","last_peered":"2024-04-18T03:40:52.543775+0000","last_clean":"2024-04-18T03:40:52.543775+0000","last_became_active":"2024-04-18T03:38:23.516790+0000","last_became_peered":"2024-04-18T03:38:23.516790+0000","last_unstale":"2024-04-18T03:40:52.543775+0000","last_undegraded":"2024-04-18T03:40:52.543775+0000","last_fullsized":"2024-04-18T03:40:52.543775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"27'31","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.051224+0000","last_change":"2024-04-18T03:41:38.051224+0000","last_active":"2024-04-18T03:41:38.051224+0000","last_peered":"2024-04-18T03:41:38.051224+0000","last_clean":"2024-04-18T03:41:38.051224+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:41:38.051224+0000","last_undegraded":"2024-04-18T03:41:38.051224+0000","last_fullsized":"2024-04-18T03:41:38.051224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-18T03:41:38.050964+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-18T03:41:38.050964+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.050964+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:49.985927+0000","scrub_duration":0.0030233410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'48","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:12.716469+0000","last_change":"2024-04-18T03:42:12.716740+0000","last_active":"2024-04-18T03:42:12.716469+0000","last_peered":"2024-04-18T03:42:12.716469+0000","last_clean":"2024-04-18T03:42:12.716469+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:42:12.716469+0000","last_undegraded":"2024-04-18T03:42:12.716469+0000","last_fullsized":"2024-04-18T03:42:12.716469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:42:12.716404+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:42:12.716404+0000","last_clean_scrub_stamp":"2024-04-18T03:42:12.716404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:53:31.093346+0000","scrub_duration":0.003625531,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'48","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.948988+0000","last_change":"2024-04-18T03:41:52.948988+0000","last_active":"2024-04-18T03:41:52.948988+0000","last_peered":"2024-04-18T03:41:52.948988+0000","last_clean":"2024-04-18T03:41:52.948988+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:41:52.948988+0000","last_undegraded":"2024-04-18T03:41:52.948988+0000","last_fullsized":"2024-04-18T03:41:52.948988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:41:52.948738+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:41:52.948738+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.948738+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:03:04.866815+0000","scrub_duration":0.0037064210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.016858+0000","last_change":"2024-04-18T03:41:52.016858+0000","last_active":"2024-04-18T03:41:52.016858+0000","last_peered":"2024-04-18T03:41:52.016858+0000","last_clean":"2024-04-18T03:41:52.016858+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:41:52.016858+0000","last_undegraded":"2024-04-18T03:41:52.016858+0000","last_fullsized":"2024-04-18T03:41:52.016858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-04-18T03:41:52.016598+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-04-18T03:41:52.016598+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.016598+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:44:57.814226+0000","scrub_duration":0.0035341439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'40","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.637536+0000","last_change":"2024-04-18T03:37:38.554037+0000","last_active":"2024-04-18T03:41:32.637536+0000","last_peered":"2024-04-18T03:41:32.637536+0000","last_clean":"2024-04-18T03:41:32.637536+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:41:32.637536+0000","last_undegraded":"2024-04-18T03:41:32.637536+0000","last_fullsized":"2024-04-18T03:41:32.637536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'48","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:55.666995+0000","last_change":"2024-04-18T03:41:55.666995+0000","last_active":"2024-04-18T03:41:55.666995+0000","last_peered":"2024-04-18T03:41:55.666995+0000","last_clean":"2024-04-18T03:41:55.666995+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:41:55.666995+0000","last_undegraded":"2024-04-18T03:41:55.666995+0000","last_fullsized":"2024-04-18T03:41:55.666995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:41:55.666666+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:41:55.666666+0000","last_clean_scrub_stamp":"2024-04-18T03:41:55.666666+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:12:47.655411+0000","scrub_duration":0.0035713089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:54.722841+0000","last_change":"2024-04-18T03:41:54.722841+0000","last_active":"2024-04-18T03:41:54.722841+0000","last_peered":"2024-04-18T03:41:54.722841+0000","last_clean":"2024-04-18T03:41:54.722841+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:41:54.722841+0000","last_undegraded":"2024-04-18T03:41:54.722841+0000","last_fullsized":"2024-04-18T03:41:54.722841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-18T03:41:54.722567+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-18T03:41:54.722567+0000","last_clean_scrub_stamp":"2024-04-18T03:41:54.722567+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:55.001534+0000","scrub_duration":0.003409151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'42","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:59.677537+0000","last_change":"2024-04-18T03:41:59.677537+0000","last_active":"2024-04-18T03:41:59.677537+0000","last_peered":"2024-04-18T03:41:59.677537+0000","last_clean":"2024-04-18T03:41:59.677537+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:41:59.677537+0000","last_undegraded":"2024-04-18T03:41:59.677537+0000","last_fullsized":"2024-04-18T03:41:59.677537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:41:59.677185+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:41:59.677185+0000","last_clean_scrub_stamp":"2024-04-18T03:41:59.677185+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:05:23.714724+0000","scrub_duration":0.0038581750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:03.208130+0000","last_change":"2024-04-18T03:42:03.208327+0000","last_active":"2024-04-18T03:42:03.208130+0000","last_peered":"2024-04-18T03:42:03.208130+0000","last_clean":"2024-04-18T03:42:03.208130+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:42:03.208130+0000","last_undegraded":"2024-04-18T03:42:03.208130+0000","last_fullsized":"2024-04-18T03:42:03.208130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:42:03.208076+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:42:03.208076+0000","last_clean_scrub_stamp":"2024-04-18T03:42:03.208076+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:32.952412+0000","scrub_duration":0.0030119750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'27","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.297161+0000","last_change":"2024-04-18T03:41:43.297161+0000","last_active":"2024-04-18T03:41:43.297161+0000","last_peered":"2024-04-18T03:41:43.297161+0000","last_clean":"2024-04-18T03:41:43.297161+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:41:43.297161+0000","last_undegraded":"2024-04-18T03:41:43.297161+0000","last_fullsized":"2024-04-18T03:41:43.297161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-04-18T03:41:43.296902+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-04-18T03:41:43.296902+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.296902+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:23.675175+0000","scrub_duration":0.0056293070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'46","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:08.776063+0000","last_change":"2024-04-18T03:42:08.776369+0000","last_active":"2024-04-18T03:42:08.776063+0000","last_peered":"2024-04-18T03:42:08.776063+0000","last_clean":"2024-04-18T03:42:08.776063+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:42:08.776063+0000","last_undegraded":"2024-04-18T03:42:08.776063+0000","last_fullsized":"2024-04-18T03:42:08.776063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:42:08.775983+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:42:08.775983+0000","last_clean_scrub_stamp":"2024-04-18T03:42:08.775983+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:33.358183+0000","scrub_duration":0.0040325609999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:59.983060+0000","last_change":"2024-04-18T03:41:59.983256+0000","last_active":"2024-04-18T03:41:59.983060+0000","last_peered":"2024-04-18T03:41:59.983060+0000","last_clean":"2024-04-18T03:41:59.983060+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:41:59.983060+0000","last_undegraded":"2024-04-18T03:41:59.983060+0000","last_fullsized":"2024-04-18T03:41:59.983060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:41:59.983006+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:41:59.983006+0000","last_clean_scrub_stamp":"2024-04-18T03:41:59.983006+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:31:51.836947+0000","scrub_duration":0.003587537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'39","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:40.098711+0000","last_change":"2024-04-18T03:41:40.098711+0000","last_active":"2024-04-18T03:41:40.098711+0000","last_peered":"2024-04-18T03:41:40.098711+0000","last_clean":"2024-04-18T03:41:40.098711+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:41:40.098711+0000","last_undegraded":"2024-04-18T03:41:40.098711+0000","last_fullsized":"2024-04-18T03:41:40.098711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-18T03:41:40.098426+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-18T03:41:40.098426+0000","last_clean_scrub_stamp":"2024-04-18T03:41:40.098426+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:41.537514+0000","scrub_duration":0.0076541339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'51","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.631339+0000","last_change":"2024-04-18T03:37:38.554770+0000","last_active":"2024-04-18T03:41:33.631339+0000","last_peered":"2024-04-18T03:41:33.631339+0000","last_clean":"2024-04-18T03:41:33.631339+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:41:33.631339+0000","last_undegraded":"2024-04-18T03:41:33.631339+0000","last_fullsized":"2024-04-18T03:41:33.631339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:58.028259+0000","last_change":"2024-04-18T03:41:58.028472+0000","last_active":"2024-04-18T03:41:58.028259+0000","last_peered":"2024-04-18T03:41:58.028259+0000","last_clean":"2024-04-18T03:41:58.028259+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:41:58.028259+0000","last_undegraded":"2024-04-18T03:41:58.028259+0000","last_fullsized":"2024-04-18T03:41:58.028259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-18T03:41:58.028208+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-18T03:41:58.028208+0000","last_clean_scrub_stamp":"2024-04-18T03:41:58.028208+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:42.871419+0000","scrub_duration":0.0028685780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.737598+0000","last_change":"2024-04-18T03:41:50.737794+0000","last_active":"2024-04-18T03:41:50.737598+0000","last_peered":"2024-04-18T03:41:50.737598+0000","last_clean":"2024-04-18T03:41:50.737598+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:41:50.737598+0000","last_undegraded":"2024-04-18T03:41:50.737598+0000","last_fullsized":"2024-04-18T03:41:50.737598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-04-18T03:41:50.737548+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-04-18T03:41:50.737548+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.737548+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:38.977573+0000","scrub_duration":0.003374279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.147141+0000","last_change":"2024-04-18T03:37:38.550228+0000","last_active":"2024-04-18T03:41:32.147141+0000","last_peered":"2024-04-18T03:41:32.147141+0000","last_clean":"2024-04-18T03:41:32.147141+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:41:32.147141+0000","last_undegraded":"2024-04-18T03:41:32.147141+0000","last_fullsized":"2024-04-18T03:41:32.147141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'46","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:05.820355+0000","last_change":"2024-04-18T03:42:05.820571+0000","last_active":"2024-04-18T03:42:05.820355+0000","last_peered":"2024-04-18T03:42:05.820355+0000","last_clean":"2024-04-18T03:42:05.820355+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:42:05.820355+0000","last_undegraded":"2024-04-18T03:42:05.820355+0000","last_fullsized":"2024-04-18T03:42:05.820355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:42:05.820302+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:42:05.820302+0000","last_clean_scrub_stamp":"2024-04-18T03:42:05.820302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:53:05.978403+0000","scrub_duration":0.0038203,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'22","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.994555+0000","last_change":"2024-04-18T03:41:52.994766+0000","last_active":"2024-04-18T03:41:52.994555+0000","last_peered":"2024-04-18T03:41:52.994555+0000","last_clean":"2024-04-18T03:41:52.994555+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:41:52.994555+0000","last_undegraded":"2024-04-18T03:41:52.994555+0000","last_fullsized":"2024-04-18T03:41:52.994555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-04-18T03:41:52.994506+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-04-18T03:41:52.994506+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.994506+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:55.454879+0000","scrub_duration":0.0032425269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:10.041157+0000","last_change":"2024-04-18T03:42:10.041535+0000","last_active":"2024-04-18T03:42:10.041157+0000","last_peered":"2024-04-18T03:42:10.041157+0000","last_clean":"2024-04-18T03:42:10.041157+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:42:10.041157+0000","last_undegraded":"2024-04-18T03:42:10.041157+0000","last_fullsized":"2024-04-18T03:42:10.041157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-18T03:42:10.041021+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-18T03:42:10.041021+0000","last_clean_scrub_stamp":"2024-04-18T03:42:10.041021+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:27:36.175495+0000","scrub_duration":0.004010441,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.808734+0000","last_change":"2024-04-18T03:41:39.808734+0000","last_active":"2024-04-18T03:41:39.808734+0000","last_peered":"2024-04-18T03:41:39.808734+0000","last_clean":"2024-04-18T03:41:39.808734+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:41:39.808734+0000","last_undegraded":"2024-04-18T03:41:39.808734+0000","last_fullsized":"2024-04-18T03:41:39.808734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:39.808285+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:39.808285+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.808285+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:51.743247+0000","scrub_duration":0.0034876019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'24","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:42.797791+0000","last_change":"2024-04-18T03:41:42.797791+0000","last_active":"2024-04-18T03:41:42.797791+0000","last_peered":"2024-04-18T03:41:42.797791+0000","last_clean":"2024-04-18T03:41:42.797791+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:41:42.797791+0000","last_undegraded":"2024-04-18T03:41:42.797791+0000","last_fullsized":"2024-04-18T03:41:42.797791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:42.797529+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:42.797529+0000","last_clean_scrub_stamp":"2024-04-18T03:41:42.797529+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:50.855947+0000","scrub_duration":0.0038311510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'43","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:05.042895+0000","last_change":"2024-04-18T03:42:05.043279+0000","last_active":"2024-04-18T03:42:05.042895+0000","last_peered":"2024-04-18T03:42:05.042895+0000","last_clean":"2024-04-18T03:42:05.042895+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:42:05.042895+0000","last_undegraded":"2024-04-18T03:42:05.042895+0000","last_fullsized":"2024-04-18T03:42:05.042895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:05.042757+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:05.042757+0000","last_clean_scrub_stamp":"2024-04-18T03:42:05.042757+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:12:46.582714+0000","scrub_duration":0.0038923299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:57.037811+0000","last_change":"2024-04-18T03:41:57.038036+0000","last_active":"2024-04-18T03:41:57.037811+0000","last_peered":"2024-04-18T03:41:57.037811+0000","last_clean":"2024-04-18T03:41:57.037811+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:41:57.037811+0000","last_undegraded":"2024-04-18T03:41:57.037811+0000","last_fullsized":"2024-04-18T03:41:57.037811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-18T03:41:57.037759+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-18T03:41:57.037759+0000","last_clean_scrub_stamp":"2024-04-18T03:41:57.037759+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:29.492923+0000","scrub_duration":0.003157679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'74","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.514977+0000","last_change":"2024-04-18T03:41:38.514977+0000","last_active":"2024-04-18T03:41:38.514977+0000","last_peered":"2024-04-18T03:41:38.514977+0000","last_clean":"2024-04-18T03:41:38.514977+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:41:38.514977+0000","last_undegraded":"2024-04-18T03:41:38.514977+0000","last_fullsized":"2024-04-18T03:41:38.514977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-04-18T03:41:38.514723+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-04-18T03:41:38.514723+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.514723+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:21.174107+0000","scrub_duration":0.0071320410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":44,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:07.088651+0000","last_change":"2024-04-18T03:42:07.089027+0000","last_active":"2024-04-18T03:42:07.088651+0000","last_peered":"2024-04-18T03:42:07.088651+0000","last_clean":"2024-04-18T03:42:07.088651+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:42:07.088651+0000","last_undegraded":"2024-04-18T03:42:07.088651+0000","last_fullsized":"2024-04-18T03:42:07.088651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:42:07.088598+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:42:07.088598+0000","last_clean_scrub_stamp":"2024-04-18T03:42:07.088598+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:53:25.465540+0000","scrub_duration":0.00372238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:51.144326+0000","last_change":"2024-04-18T03:41:51.144604+0000","last_active":"2024-04-18T03:41:51.144326+0000","last_peered":"2024-04-18T03:41:51.144326+0000","last_clean":"2024-04-18T03:41:51.144326+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:41:51.144326+0000","last_undegraded":"2024-04-18T03:41:51.144326+0000","last_fullsized":"2024-04-18T03:41:51.144326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:51.144273+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:51.144273+0000","last_clean_scrub_stamp":"2024-04-18T03:41:51.144273+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:42.399546+0000","scrub_duration":0.0034673759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'21","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:49.786059+0000","last_change":"2024-04-18T03:41:49.786244+0000","last_active":"2024-04-18T03:41:49.786059+0000","last_peered":"2024-04-18T03:41:49.786059+0000","last_clean":"2024-04-18T03:41:49.786059+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:41:49.786059+0000","last_undegraded":"2024-04-18T03:41:49.786059+0000","last_fullsized":"2024-04-18T03:41:49.786059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-18T03:41:49.786003+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-18T03:41:49.786003+0000","last_clean_scrub_stamp":"2024-04-18T03:41:49.786003+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:09.331251+0000","scrub_duration":0.0037904060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.305061+0000","last_change":"2024-04-18T03:42:09.305351+0000","last_active":"2024-04-18T03:42:09.305061+0000","last_peered":"2024-04-18T03:42:09.305061+0000","last_clean":"2024-04-18T03:42:09.305061+0000","last_became_active":"2024-04-18T03:38:23.755354+0000","last_became_peered":"2024-04-18T03:38:23.755354+0000","last_unstale":"2024-04-18T03:42:09.305061+0000","last_undegraded":"2024-04-18T03:42:09.305061+0000","last_fullsized":"2024-04-18T03:42:09.305061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-18T03:42:09.305008+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-18T03:42:09.305008+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.305008+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:10:16.222905+0000","scrub_duration":0.003659668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:55.954099+0000","last_change":"2024-04-18T03:41:55.954301+0000","last_active":"2024-04-18T03:41:55.954099+0000","last_peered":"2024-04-18T03:41:55.954099+0000","last_clean":"2024-04-18T03:41:55.954099+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:41:55.954099+0000","last_undegraded":"2024-04-18T03:41:55.954099+0000","last_fullsized":"2024-04-18T03:41:55.954099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2024-04-18T03:41:55.954047+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2024-04-18T03:41:55.954047+0000","last_clean_scrub_stamp":"2024-04-18T03:41:55.954047+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:41.857136+0000","scrub_duration":0.0033617180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'20","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:49.701739+0000","last_change":"2024-04-18T03:41:49.701952+0000","last_active":"2024-04-18T03:41:49.701739+0000","last_peered":"2024-04-18T03:41:49.701739+0000","last_clean":"2024-04-18T03:41:49.701739+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:41:49.701739+0000","last_undegraded":"2024-04-18T03:41:49.701739+0000","last_fullsized":"2024-04-18T03:41:49.701739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-18T03:41:49.701682+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-18T03:41:49.701682+0000","last_clean_scrub_stamp":"2024-04-18T03:41:49.701682+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:09.246929+0000","scrub_duration":0.003833768,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.824286+0000","last_change":"2024-04-18T03:41:43.824582+0000","last_active":"2024-04-18T03:41:43.824286+0000","last_peered":"2024-04-18T03:41:43.824286+0000","last_clean":"2024-04-18T03:41:43.824286+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:41:43.824286+0000","last_undegraded":"2024-04-18T03:41:43.824286+0000","last_fullsized":"2024-04-18T03:41:43.824286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-18T03:41:43.824180+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-18T03:41:43.824180+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.824180+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:40.311196+0000","scrub_duration":0.010381431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'35","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.105337+0000","last_change":"2024-04-18T03:37:38.550571+0000","last_active":"2024-04-18T03:41:35.105337+0000","last_peered":"2024-04-18T03:41:35.105337+0000","last_clean":"2024-04-18T03:41:35.105337+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:41:35.105337+0000","last_undegraded":"2024-04-18T03:41:35.105337+0000","last_fullsized":"2024-04-18T03:41:35.105337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'46","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.934709+0000","last_change":"2024-04-18T03:41:37.934709+0000","last_active":"2024-04-18T03:41:37.934709+0000","last_peered":"2024-04-18T03:41:37.934709+0000","last_clean":"2024-04-18T03:41:37.934709+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:41:37.934709+0000","last_undegraded":"2024-04-18T03:41:37.934709+0000","last_fullsized":"2024-04-18T03:41:37.934709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:41:37.934439+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:41:37.934439+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.934439+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:20.593823+0000","scrub_duration":0.0033057120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'29","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.559893+0000","last_change":"2024-04-18T03:41:39.559893+0000","last_active":"2024-04-18T03:41:39.559893+0000","last_peered":"2024-04-18T03:41:39.559893+0000","last_clean":"2024-04-18T03:41:39.559893+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:41:39.559893+0000","last_undegraded":"2024-04-18T03:41:39.559893+0000","last_fullsized":"2024-04-18T03:41:39.559893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-18T03:41:39.559453+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-18T03:41:39.559453+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.559453+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:02.058965+0000","scrub_duration":0.0039162629999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'34","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:11.161253+0000","last_change":"2024-04-18T03:42:11.161614+0000","last_active":"2024-04-18T03:42:11.161253+0000","last_peered":"2024-04-18T03:42:11.161253+0000","last_clean":"2024-04-18T03:42:11.161253+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:42:11.161253+0000","last_undegraded":"2024-04-18T03:42:11.161253+0000","last_fullsized":"2024-04-18T03:42:11.161253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-18T03:42:11.161195+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-18T03:42:11.161195+0000","last_clean_scrub_stamp":"2024-04-18T03:42:11.161195+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:53:29.538137+0000","scrub_duration":0.0038419629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.774727+0000","last_change":"2024-04-18T03:41:36.774727+0000","last_active":"2024-04-18T03:41:36.774727+0000","last_peered":"2024-04-18T03:41:36.774727+0000","last_clean":"2024-04-18T03:41:36.774727+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:41:36.774727+0000","last_undegraded":"2024-04-18T03:41:36.774727+0000","last_fullsized":"2024-04-18T03:41:36.774727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:36.774472+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:36.774472+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.774472+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:19.433856+0000","scrub_duration":0.0033108389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'25","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.076855+0000","last_change":"2024-04-18T03:41:36.076855+0000","last_active":"2024-04-18T03:41:36.076855+0000","last_peered":"2024-04-18T03:41:36.076855+0000","last_clean":"2024-04-18T03:41:36.076855+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:41:36.076855+0000","last_undegraded":"2024-04-18T03:41:36.076855+0000","last_fullsized":"2024-04-18T03:41:36.076855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-18T03:41:36.076533+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-18T03:41:36.076533+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.076533+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:32.739299+0000","scrub_duration":0.0067638259999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:05.283108+0000","last_change":"2024-04-18T03:42:05.283108+0000","last_active":"2024-04-18T03:42:05.283108+0000","last_peered":"2024-04-18T03:42:05.283108+0000","last_clean":"2024-04-18T03:42:05.283108+0000","last_became_active":"2024-04-18T03:38:23.706819+0000","last_became_peered":"2024-04-18T03:38:23.706819+0000","last_unstale":"2024-04-18T03:42:05.283108+0000","last_undegraded":"2024-04-18T03:42:05.283108+0000","last_fullsized":"2024-04-18T03:42:05.283108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:05.282603+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:05.282603+0000","last_clean_scrub_stamp":"2024-04-18T03:42:05.282603+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:27:31.417077+0000","scrub_duration":0.004194677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'47","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:12.727890+0000","last_change":"2024-04-18T03:42:12.728140+0000","last_active":"2024-04-18T03:42:12.727890+0000","last_peered":"2024-04-18T03:42:12.727890+0000","last_clean":"2024-04-18T03:42:12.727890+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:42:12.727890+0000","last_undegraded":"2024-04-18T03:42:12.727890+0000","last_fullsized":"2024-04-18T03:42:12.727890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-04-18T03:42:12.727836+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-04-18T03:42:12.727836+0000","last_clean_scrub_stamp":"2024-04-18T03:42:12.727836+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:24:32.616557+0000","scrub_duration":0.002874471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'21","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.457680+0000","last_change":"2024-04-18T03:41:36.457680+0000","last_active":"2024-04-18T03:41:36.457680+0000","last_peered":"2024-04-18T03:41:36.457680+0000","last_clean":"2024-04-18T03:41:36.457680+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:41:36.457680+0000","last_undegraded":"2024-04-18T03:41:36.457680+0000","last_fullsized":"2024-04-18T03:41:36.457680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-18T03:41:36.457421+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-18T03:41:36.457421+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.457421+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:05.152177+0000","scrub_duration":0.0051244159999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'50","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.620633+0000","last_change":"2024-04-18T03:37:38.553027+0000","last_active":"2024-04-18T03:41:34.620633+0000","last_peered":"2024-04-18T03:41:34.620633+0000","last_clean":"2024-04-18T03:41:34.620633+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:41:34.620633+0000","last_undegraded":"2024-04-18T03:41:34.620633+0000","last_fullsized":"2024-04-18T03:41:34.620633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'39","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.600458+0000","last_change":"2024-04-18T03:37:34.299096+0000","last_active":"2024-04-18T03:41:35.600458+0000","last_peered":"2024-04-18T03:41:35.600458+0000","last_clean":"2024-04-18T03:41:35.600458+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:41:35.600458+0000","last_undegraded":"2024-04-18T03:41:35.600458+0000","last_fullsized":"2024-04-18T03:41:35.600458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'24","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.839576+0000","last_change":"2024-04-18T03:41:34.839576+0000","last_active":"2024-04-18T03:41:34.839576+0000","last_peered":"2024-04-18T03:41:34.839576+0000","last_clean":"2024-04-18T03:41:34.839576+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:41:34.839576+0000","last_undegraded":"2024-04-18T03:41:34.839576+0000","last_fullsized":"2024-04-18T03:41:34.839576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:34.839312+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:34.839312+0000","last_clean_scrub_stamp":"2024-04-18T03:41:34.839312+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:25.350116+0000","scrub_duration":0.0055495320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'47","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.127885+0000","last_change":"2024-04-18T03:37:38.329051+0000","last_active":"2024-04-18T03:41:34.127885+0000","last_peered":"2024-04-18T03:41:34.127885+0000","last_clean":"2024-04-18T03:41:34.127885+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:41:34.127885+0000","last_undegraded":"2024-04-18T03:41:34.127885+0000","last_fullsized":"2024-04-18T03:41:34.127885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.929865+0000","last_change":"2024-04-18T03:41:38.930160+0000","last_active":"2024-04-18T03:41:38.929865+0000","last_peered":"2024-04-18T03:41:38.929865+0000","last_clean":"2024-04-18T03:41:38.929865+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:41:38.929865+0000","last_undegraded":"2024-04-18T03:41:38.929865+0000","last_fullsized":"2024-04-18T03:41:38.929865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-04-18T03:41:38.929757+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-04-18T03:41:38.929757+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.929757+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:01.429268+0000","scrub_duration":0.0032590219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'37","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.464769+0000","last_change":"2024-04-18T03:41:34.464926+0000","last_active":"2024-04-18T03:41:34.464769+0000","last_peered":"2024-04-18T03:41:34.464769+0000","last_clean":"2024-04-18T03:41:34.464769+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:41:34.464769+0000","last_undegraded":"2024-04-18T03:41:34.464769+0000","last_fullsized":"2024-04-18T03:41:34.464769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-18T03:41:34.464734+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-18T03:41:34.464734+0000","last_clean_scrub_stamp":"2024-04-18T03:41:34.464734+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:28.772334+0000","scrub_duration":0.00658305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'54","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.852078+0000","last_change":"2024-04-18T03:37:38.325847+0000","last_active":"2024-04-18T03:40:47.852078+0000","last_peered":"2024-04-18T03:40:47.852078+0000","last_clean":"2024-04-18T03:40:47.852078+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:40:47.852078+0000","last_undegraded":"2024-04-18T03:40:47.852078+0000","last_fullsized":"2024-04-18T03:40:47.852078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'49","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:57.193753+0000","last_change":"2024-04-18T03:41:57.194006+0000","last_active":"2024-04-18T03:41:57.193753+0000","last_peered":"2024-04-18T03:41:57.193753+0000","last_clean":"2024-04-18T03:41:57.193753+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:41:57.193753+0000","last_undegraded":"2024-04-18T03:41:57.193753+0000","last_fullsized":"2024-04-18T03:41:57.193753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:41:57.193694+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:41:57.193694+0000","last_clean_scrub_stamp":"2024-04-18T03:41:57.193694+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:48.448968+0000","scrub_duration":0.0035468969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'30","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.389380+0000","last_change":"2024-04-18T03:41:38.389380+0000","last_active":"2024-04-18T03:41:38.389380+0000","last_peered":"2024-04-18T03:41:38.389380+0000","last_clean":"2024-04-18T03:41:38.389380+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:41:38.389380+0000","last_undegraded":"2024-04-18T03:41:38.389380+0000","last_fullsized":"2024-04-18T03:41:38.389380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-18T03:41:38.389114+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-18T03:41:38.389114+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.389114+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:35.051880+0000","scrub_duration":0.002866005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'43","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:12.775478+0000","last_change":"2024-04-18T03:42:12.775777+0000","last_active":"2024-04-18T03:42:12.775478+0000","last_peered":"2024-04-18T03:42:12.775478+0000","last_clean":"2024-04-18T03:42:12.775478+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:42:12.775478+0000","last_undegraded":"2024-04-18T03:42:12.775478+0000","last_fullsized":"2024-04-18T03:42:12.775478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:12.775418+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:12.775418+0000","last_clean_scrub_stamp":"2024-04-18T03:42:12.775418+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:07.935179+0000","scrub_duration":0.0034385190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'63","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562733+0000","last_change":"2024-04-18T03:37:34.308921+0000","last_active":"2024-04-18T03:40:52.562733+0000","last_peered":"2024-04-18T03:40:52.562733+0000","last_clean":"2024-04-18T03:40:52.562733+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:40:52.562733+0000","last_undegraded":"2024-04-18T03:40:52.562733+0000","last_fullsized":"2024-04-18T03:40:52.562733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'35","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:53.717604+0000","last_change":"2024-04-18T03:41:53.717823+0000","last_active":"2024-04-18T03:41:53.717604+0000","last_peered":"2024-04-18T03:41:53.717604+0000","last_clean":"2024-04-18T03:41:53.717604+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:41:53.717604+0000","last_undegraded":"2024-04-18T03:41:53.717604+0000","last_fullsized":"2024-04-18T03:41:53.717604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-18T03:41:53.717555+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-18T03:41:53.717555+0000","last_clean_scrub_stamp":"2024-04-18T03:41:53.717555+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:54:24.418727+0000","scrub_duration":0.003742118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'34","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.840223+0000","last_change":"2024-04-18T03:37:38.550176+0000","last_active":"2024-04-18T03:40:47.840223+0000","last_peered":"2024-04-18T03:40:47.840223+0000","last_clean":"2024-04-18T03:40:47.840223+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:40:47.840223+0000","last_undegraded":"2024-04-18T03:40:47.840223+0000","last_fullsized":"2024-04-18T03:40:47.840223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'43","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:53.174367+0000","last_change":"2024-04-18T03:41:53.174696+0000","last_active":"2024-04-18T03:41:53.174367+0000","last_peered":"2024-04-18T03:41:53.174367+0000","last_clean":"2024-04-18T03:41:53.174367+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:41:53.174367+0000","last_undegraded":"2024-04-18T03:41:53.174367+0000","last_fullsized":"2024-04-18T03:41:53.174367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:53.174233+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:53.174233+0000","last_clean_scrub_stamp":"2024-04-18T03:41:53.174233+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:38.017445+0000","scrub_duration":0.0037237210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'19","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.119979+0000","last_change":"2024-04-18T03:41:35.120215+0000","last_active":"2024-04-18T03:41:35.119979+0000","last_peered":"2024-04-18T03:41:35.119979+0000","last_clean":"2024-04-18T03:41:35.119979+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:41:35.119979+0000","last_undegraded":"2024-04-18T03:41:35.119979+0000","last_fullsized":"2024-04-18T03:41:35.119979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-18T03:41:35.119916+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-18T03:41:35.119916+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.119916+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:36.559004+0000","scrub_duration":0.0067098039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'38","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:49.725720+0000","last_change":"2024-04-18T03:37:38.547601+0000","last_active":"2024-04-18T03:40:49.725720+0000","last_peered":"2024-04-18T03:40:49.725720+0000","last_clean":"2024-04-18T03:40:49.725720+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:40:49.725720+0000","last_undegraded":"2024-04-18T03:40:49.725720+0000","last_fullsized":"2024-04-18T03:40:49.725720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'43","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.655326+0000","last_change":"2024-04-18T03:42:09.655517+0000","last_active":"2024-04-18T03:42:09.655326+0000","last_peered":"2024-04-18T03:42:09.655326+0000","last_clean":"2024-04-18T03:42:09.655326+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:42:09.655326+0000","last_undegraded":"2024-04-18T03:42:09.655326+0000","last_fullsized":"2024-04-18T03:42:09.655326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:09.655277+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:09.655277+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.655277+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:40.862383+0000","scrub_duration":0.0033977109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'912","reported_seq":943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.377560+0000","last_change":"2024-04-18T03:41:36.377560+0000","last_active":"2024-04-18T03:41:36.377560+0000","last_peered":"2024-04-18T03:41:36.377560+0000","last_clean":"2024-04-18T03:41:36.377560+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:41:36.377560+0000","last_undegraded":"2024-04-18T03:41:36.377560+0000","last_fullsized":"2024-04-18T03:41:36.377560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'912","last_scrub_stamp":"2024-04-18T03:41:36.377398+0000","last_deep_scrub":"27'912","last_deep_scrub_stamp":"2024-04-18T03:41:36.377398+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.377398+0000","objects_scrubbed":4,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:56.129888+0000","scrub_duration":0.019987532999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'43","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:08.039370+0000","last_change":"2024-04-18T03:42:08.039687+0000","last_active":"2024-04-18T03:42:08.039370+0000","last_peered":"2024-04-18T03:42:08.039370+0000","last_clean":"2024-04-18T03:42:08.039370+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:42:08.039370+0000","last_undegraded":"2024-04-18T03:42:08.039370+0000","last_fullsized":"2024-04-18T03:42:08.039370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:08.039308+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:08.039308+0000","last_clean_scrub_stamp":"2024-04-18T03:42:08.039308+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:37.783643+0000","scrub_duration":0.0037840830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'49","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.795679+0000","last_change":"2024-04-18T03:41:37.795901+0000","last_active":"2024-04-18T03:41:37.795679+0000","last_peered":"2024-04-18T03:41:37.795679+0000","last_clean":"2024-04-18T03:41:37.795679+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:41:37.795679+0000","last_undegraded":"2024-04-18T03:41:37.795679+0000","last_fullsized":"2024-04-18T03:41:37.795679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:41:37.795629+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:41:37.795629+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.795629+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:34.458395+0000","scrub_duration":0.0033140940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:56.041903+0000","last_change":"2024-04-18T03:41:56.042183+0000","last_active":"2024-04-18T03:41:56.041903+0000","last_peered":"2024-04-18T03:41:56.041903+0000","last_clean":"2024-04-18T03:41:56.041903+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:41:56.041903+0000","last_undegraded":"2024-04-18T03:41:56.041903+0000","last_fullsized":"2024-04-18T03:41:56.041903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:56.041839+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:56.041839+0000","last_clean_scrub_stamp":"2024-04-18T03:41:56.041839+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:47.297113+0000","scrub_duration":0.0076736870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'45","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:13.747949+0000","last_change":"2024-04-18T03:42:13.748286+0000","last_active":"2024-04-18T03:42:13.747949+0000","last_peered":"2024-04-18T03:42:13.747949+0000","last_clean":"2024-04-18T03:42:13.747949+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:42:13.747949+0000","last_undegraded":"2024-04-18T03:42:13.747949+0000","last_fullsized":"2024-04-18T03:42:13.747949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-18T03:42:13.747886+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-18T03:42:13.747886+0000","last_clean_scrub_stamp":"2024-04-18T03:42:13.747886+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:43.492222+0000","scrub_duration":0.0037208609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:59.079852+0000","last_change":"2024-04-18T03:41:59.080090+0000","last_active":"2024-04-18T03:41:59.079852+0000","last_peered":"2024-04-18T03:41:59.079852+0000","last_clean":"2024-04-18T03:41:59.079852+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:41:59.079852+0000","last_undegraded":"2024-04-18T03:41:59.079852+0000","last_fullsized":"2024-04-18T03:41:59.079852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:59.079799+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:59.079799+0000","last_clean_scrub_stamp":"2024-04-18T03:41:59.079799+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:34.822148+0000","scrub_duration":0.0036329330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'24","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.804324+0000","last_change":"2024-04-18T03:41:41.804588+0000","last_active":"2024-04-18T03:41:41.804324+0000","last_peered":"2024-04-18T03:41:41.804324+0000","last_clean":"2024-04-18T03:41:41.804324+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:41:41.804324+0000","last_undegraded":"2024-04-18T03:41:41.804324+0000","last_fullsized":"2024-04-18T03:41:41.804324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:41.804273+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:41.804273+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.804273+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:43.233719+0000","scrub_duration":0.0031319410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'39","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:08.844523+0000","last_change":"2024-04-18T03:42:08.844769+0000","last_active":"2024-04-18T03:42:08.844523+0000","last_peered":"2024-04-18T03:42:08.844523+0000","last_clean":"2024-04-18T03:42:08.844523+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:42:08.844523+0000","last_undegraded":"2024-04-18T03:42:08.844523+0000","last_fullsized":"2024-04-18T03:42:08.844523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-18T03:42:08.844465+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-18T03:42:08.844465+0000","last_clean_scrub_stamp":"2024-04-18T03:42:08.844465+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:03.930972+0000","scrub_duration":0.0034845290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'73","reported_seq":102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:54.759111+0000","last_change":"2024-04-18T03:41:54.759303+0000","last_active":"2024-04-18T03:41:54.759111+0000","last_peered":"2024-04-18T03:41:54.759111+0000","last_clean":"2024-04-18T03:41:54.759111+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:41:54.759111+0000","last_undegraded":"2024-04-18T03:41:54.759111+0000","last_fullsized":"2024-04-18T03:41:54.759111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'73","last_scrub_stamp":"2024-04-18T03:41:54.759062+0000","last_deep_scrub":"27'73","last_deep_scrub_stamp":"2024-04-18T03:41:54.759062+0000","last_clean_scrub_stamp":"2024-04-18T03:41:54.759062+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:55.038029+0000","scrub_duration":0.0030487069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'23","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:55.168570+0000","last_change":"2024-04-18T03:41:55.168769+0000","last_active":"2024-04-18T03:41:55.168570+0000","last_peered":"2024-04-18T03:41:55.168570+0000","last_clean":"2024-04-18T03:41:55.168570+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:41:55.168570+0000","last_undegraded":"2024-04-18T03:41:55.168570+0000","last_fullsized":"2024-04-18T03:41:55.168570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-04-18T03:41:55.168517+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-04-18T03:41:55.168517+0000","last_clean_scrub_stamp":"2024-04-18T03:41:55.168517+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:45:00.966145+0000","scrub_duration":0.0029569890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'42","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:07.834020+0000","last_change":"2024-04-18T03:42:07.834452+0000","last_active":"2024-04-18T03:42:07.834020+0000","last_peered":"2024-04-18T03:42:07.834020+0000","last_clean":"2024-04-18T03:42:07.834020+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:42:07.834020+0000","last_undegraded":"2024-04-18T03:42:07.834020+0000","last_fullsized":"2024-04-18T03:42:07.834020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:42:07.833893+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:42:07.833893+0000","last_clean_scrub_stamp":"2024-04-18T03:42:07.833893+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:06.838416+0000","scrub_duration":0.0038990800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'43","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:32.147105+0000","last_change":"2024-04-18T03:37:38.556403+0000","last_active":"2024-04-18T03:41:32.147105+0000","last_peered":"2024-04-18T03:41:32.147105+0000","last_clean":"2024-04-18T03:41:32.147105+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:41:32.147105+0000","last_undegraded":"2024-04-18T03:41:32.147105+0000","last_fullsized":"2024-04-18T03:41:32.147105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'54","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.076204+0000","last_change":"2024-04-18T03:42:02.076501+0000","last_active":"2024-04-18T03:42:02.076204+0000","last_peered":"2024-04-18T03:42:02.076204+0000","last_clean":"2024-04-18T03:42:02.076204+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:42:02.076204+0000","last_undegraded":"2024-04-18T03:42:02.076204+0000","last_fullsized":"2024-04-18T03:42:02.076204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-18T03:42:02.076086+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-18T03:42:02.076086+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.076086+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:42:28.496274+0000","scrub_duration":0.0031972139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'20","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.773889+0000","last_change":"2024-04-18T03:41:37.774141+0000","last_active":"2024-04-18T03:41:37.773889+0000","last_peered":"2024-04-18T03:41:37.773889+0000","last_clean":"2024-04-18T03:41:37.773889+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:41:37.773889+0000","last_undegraded":"2024-04-18T03:41:37.773889+0000","last_fullsized":"2024-04-18T03:41:37.773889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-18T03:41:37.773836+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-18T03:41:37.773836+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.773836+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:00.273347+0000","scrub_duration":0.0031860970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'50","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:12.184910+0000","last_change":"2024-04-18T03:42:12.185148+0000","last_active":"2024-04-18T03:42:12.184910+0000","last_peered":"2024-04-18T03:42:12.184910+0000","last_clean":"2024-04-18T03:42:12.184910+0000","last_became_active":"2024-04-18T03:38:23.707524+0000","last_became_peered":"2024-04-18T03:38:23.707524+0000","last_unstale":"2024-04-18T03:42:12.184910+0000","last_undegraded":"2024-04-18T03:42:12.184910+0000","last_fullsized":"2024-04-18T03:42:12.184910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:42:12.184847+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:42:12.184847+0000","last_clean_scrub_stamp":"2024-04-18T03:42:12.184847+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:41.929183+0000","scrub_duration":0.0038614320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'65","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.942074+0000","last_change":"2024-04-18T03:42:02.942288+0000","last_active":"2024-04-18T03:42:02.942074+0000","last_peered":"2024-04-18T03:42:02.942074+0000","last_clean":"2024-04-18T03:42:02.942074+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:42:02.942074+0000","last_undegraded":"2024-04-18T03:42:02.942074+0000","last_fullsized":"2024-04-18T03:42:02.942074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2024-04-18T03:42:02.942017+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2024-04-18T03:42:02.942017+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.942017+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:13:58.923916+0000","scrub_duration":0.0030766470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'19","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.981650+0000","last_change":"2024-04-18T03:41:50.981853+0000","last_active":"2024-04-18T03:41:50.981650+0000","last_peered":"2024-04-18T03:41:50.981650+0000","last_clean":"2024-04-18T03:41:50.981650+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:41:50.981650+0000","last_undegraded":"2024-04-18T03:41:50.981650+0000","last_fullsized":"2024-04-18T03:41:50.981650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-18T03:41:50.981601+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-18T03:41:50.981601+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.981601+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:26.735105+0000","scrub_duration":0.0030809969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.363292+0000","last_change":"2024-04-18T03:41:41.363413+0000","last_active":"2024-04-18T03:41:41.363292+0000","last_peered":"2024-04-18T03:41:41.363292+0000","last_clean":"2024-04-18T03:41:41.363292+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:41:41.363292+0000","last_undegraded":"2024-04-18T03:41:41.363292+0000","last_fullsized":"2024-04-18T03:41:41.363292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:41.363263+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:41.363263+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.363263+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:57.623994+0000","scrub_duration":0.015753157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.178745+0000","last_change":"2024-04-18T03:41:52.178932+0000","last_active":"2024-04-18T03:41:52.178745+0000","last_peered":"2024-04-18T03:41:52.178745+0000","last_clean":"2024-04-18T03:41:52.178745+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:41:52.178745+0000","last_undegraded":"2024-04-18T03:41:52.178745+0000","last_fullsized":"2024-04-18T03:41:52.178745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:41:52.178693+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:41:52.178693+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.178693+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:24.633857+0000","scrub_duration":0.0034843679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.485713+0000","last_change":"2024-04-18T03:41:50.486008+0000","last_active":"2024-04-18T03:41:50.485713+0000","last_peered":"2024-04-18T03:41:50.485713+0000","last_clean":"2024-04-18T03:41:50.485713+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:41:50.485713+0000","last_undegraded":"2024-04-18T03:41:50.485713+0000","last_fullsized":"2024-04-18T03:41:50.485713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-18T03:41:50.485653+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-18T03:41:50.485653+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.485653+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:10.030901+0000","scrub_duration":0.0037180400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1516","reported_seq":1546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:48.945074+0000","last_change":"2024-04-18T03:41:48.945260+0000","last_active":"2024-04-18T03:41:48.945074+0000","last_peered":"2024-04-18T03:41:48.945074+0000","last_clean":"2024-04-18T03:41:48.945074+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:41:48.945074+0000","last_undegraded":"2024-04-18T03:41:48.945074+0000","last_fullsized":"2024-04-18T03:41:48.945074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1516","last_scrub_stamp":"2024-04-18T03:41:48.945028+0000","last_deep_scrub":"27'1516","last_deep_scrub_stamp":"2024-04-18T03:41:48.945028+0000","last_clean_scrub_stamp":"2024-04-18T03:41:48.945028+0000","objects_scrubbed":1,"log_size":1516,"log_dups_size":0,"ondisk_log_size":1516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:32.113215+0000","scrub_duration":0.02246687,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1489,"num_write_kb":4584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'44","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.811359+0000","last_change":"2024-04-18T03:41:36.811567+0000","last_active":"2024-04-18T03:41:36.811359+0000","last_peered":"2024-04-18T03:41:36.811359+0000","last_clean":"2024-04-18T03:41:36.811359+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:41:36.811359+0000","last_undegraded":"2024-04-18T03:41:36.811359+0000","last_fullsized":"2024-04-18T03:41:36.811359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:36.811310+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:36.811310+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.811310+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:21:31.448768+0000","scrub_duration":0.0032001960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'55","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:47.856504+0000","last_change":"2024-04-18T03:37:38.336525+0000","last_active":"2024-04-18T03:40:47.856504+0000","last_peered":"2024-04-18T03:40:47.856504+0000","last_clean":"2024-04-18T03:40:47.856504+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:40:47.856504+0000","last_undegraded":"2024-04-18T03:40:47.856504+0000","last_fullsized":"2024-04-18T03:40:47.856504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:37.293906+0000","last_clean_scrub_stamp":"2024-04-18T03:37:37.293906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'69","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:06.206422+0000","last_change":"2024-04-18T03:42:06.206612+0000","last_active":"2024-04-18T03:42:06.206422+0000","last_peered":"2024-04-18T03:42:06.206422+0000","last_clean":"2024-04-18T03:42:06.206422+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:42:06.206422+0000","last_undegraded":"2024-04-18T03:42:06.206422+0000","last_fullsized":"2024-04-18T03:42:06.206422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'69","last_scrub_stamp":"2024-04-18T03:42:06.206365+0000","last_deep_scrub":"27'69","last_deep_scrub_stamp":"2024-04-18T03:42:06.206365+0000","last_clean_scrub_stamp":"2024-04-18T03:42:06.206365+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:30.788566+0000","scrub_duration":0.003256349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'59","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:44.527159+0000","last_change":"2024-04-18T03:41:44.527159+0000","last_active":"2024-04-18T03:41:44.527159+0000","last_peered":"2024-04-18T03:41:44.527159+0000","last_clean":"2024-04-18T03:41:44.527159+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:41:44.527159+0000","last_undegraded":"2024-04-18T03:41:44.527159+0000","last_fullsized":"2024-04-18T03:41:44.527159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2024-04-18T03:41:44.526795+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2024-04-18T03:41:44.526795+0000","last_clean_scrub_stamp":"2024-04-18T03:41:44.526795+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:52.585213+0000","scrub_duration":0.0037446340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'58","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.620423+0000","last_change":"2024-04-18T03:37:34.304783+0000","last_active":"2024-04-18T03:41:34.620423+0000","last_peered":"2024-04-18T03:41:34.620423+0000","last_clean":"2024-04-18T03:41:34.620423+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:41:34.620423+0000","last_undegraded":"2024-04-18T03:41:34.620423+0000","last_fullsized":"2024-04-18T03:41:34.620423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'52","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.116526+0000","last_change":"2024-04-18T03:41:33.116526+0000","last_active":"2024-04-18T03:41:33.116526+0000","last_peered":"2024-04-18T03:41:33.116526+0000","last_clean":"2024-04-18T03:41:33.116526+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:41:33.116526+0000","last_undegraded":"2024-04-18T03:41:33.116526+0000","last_fullsized":"2024-04-18T03:41:33.116526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-04-18T03:41:33.116136+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-04-18T03:41:33.116136+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.116136+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:45.051099+0000","scrub_duration":0.003731814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:03.906474+0000","last_change":"2024-04-18T03:42:03.906675+0000","last_active":"2024-04-18T03:42:03.906474+0000","last_peered":"2024-04-18T03:42:03.906474+0000","last_clean":"2024-04-18T03:42:03.906474+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:42:03.906474+0000","last_undegraded":"2024-04-18T03:42:03.906474+0000","last_fullsized":"2024-04-18T03:42:03.906474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:42:03.906421+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:42:03.906421+0000","last_clean_scrub_stamp":"2024-04-18T03:42:03.906421+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:41.268305+0000","scrub_duration":0.0035130080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'37","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.023421+0000","last_change":"2024-04-18T03:41:35.023421+0000","last_active":"2024-04-18T03:41:35.023421+0000","last_peered":"2024-04-18T03:41:35.023421+0000","last_clean":"2024-04-18T03:41:35.023421+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:41:35.023421+0000","last_undegraded":"2024-04-18T03:41:35.023421+0000","last_fullsized":"2024-04-18T03:41:35.023421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-18T03:41:35.023149+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-18T03:41:35.023149+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.023149+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:21:29.660608+0000","scrub_duration":0.002591814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'66","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:07.169587+0000","last_change":"2024-04-18T03:42:07.169902+0000","last_active":"2024-04-18T03:42:07.169587+0000","last_peered":"2024-04-18T03:42:07.169587+0000","last_clean":"2024-04-18T03:42:07.169587+0000","last_became_active":"2024-04-18T03:38:23.514633+0000","last_became_peered":"2024-04-18T03:38:23.514633+0000","last_unstale":"2024-04-18T03:42:07.169587+0000","last_undegraded":"2024-04-18T03:42:07.169587+0000","last_fullsized":"2024-04-18T03:42:07.169587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-04-18T03:42:07.169535+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-04-18T03:42:07.169535+0000","last_clean_scrub_stamp":"2024-04-18T03:42:07.169535+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:42.911884+0000","scrub_duration":0.003465311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'42","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.893909+0000","last_change":"2024-04-18T03:41:33.893909+0000","last_active":"2024-04-18T03:41:33.893909+0000","last_peered":"2024-04-18T03:41:33.893909+0000","last_clean":"2024-04-18T03:41:33.893909+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:41:33.893909+0000","last_undegraded":"2024-04-18T03:41:33.893909+0000","last_fullsized":"2024-04-18T03:41:33.893909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:41:33.893717+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:41:33.893717+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.893717+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:57.681786+0000","scrub_duration":0.0032070879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:00.862610+0000","last_change":"2024-04-18T03:42:00.862899+0000","last_active":"2024-04-18T03:42:00.862610+0000","last_peered":"2024-04-18T03:42:00.862610+0000","last_clean":"2024-04-18T03:42:00.862610+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:42:00.862610+0000","last_undegraded":"2024-04-18T03:42:00.862610+0000","last_fullsized":"2024-04-18T03:42:00.862610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:42:00.862559+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:42:00.862559+0000","last_clean_scrub_stamp":"2024-04-18T03:42:00.862559+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:44.030746+0000","scrub_duration":0.003493576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.875077+0000","last_change":"2024-04-18T03:41:39.875077+0000","last_active":"2024-04-18T03:41:39.875077+0000","last_peered":"2024-04-18T03:41:39.875077+0000","last_clean":"2024-04-18T03:41:39.875077+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:41:39.875077+0000","last_undegraded":"2024-04-18T03:41:39.875077+0000","last_fullsized":"2024-04-18T03:41:39.875077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:39.874768+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:39.874768+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.874768+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:28.114792+0000","scrub_duration":0.0035169509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'58","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:51.449204+0000","last_change":"2024-04-18T03:41:51.449409+0000","last_active":"2024-04-18T03:41:51.449204+0000","last_peered":"2024-04-18T03:41:51.449204+0000","last_clean":"2024-04-18T03:41:51.449204+0000","last_became_active":"2024-04-18T03:38:23.753851+0000","last_became_peered":"2024-04-18T03:38:23.753851+0000","last_unstale":"2024-04-18T03:41:51.449204+0000","last_undegraded":"2024-04-18T03:41:51.449204+0000","last_fullsized":"2024-04-18T03:41:51.449204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:41:51.449154+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:41:51.449154+0000","last_clean_scrub_stamp":"2024-04-18T03:41:51.449154+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:39.689178+0000","scrub_duration":0.003459279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"27'63","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.159973+0000","last_change":"2024-04-18T03:42:02.159973+0000","last_active":"2024-04-18T03:42:02.159973+0000","last_peered":"2024-04-18T03:42:02.159973+0000","last_clean":"2024-04-18T03:42:02.159973+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:42:02.159973+0000","last_undegraded":"2024-04-18T03:42:02.159973+0000","last_fullsized":"2024-04-18T03:42:02.159973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2024-04-18T03:42:02.159716+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2024-04-18T03:42:02.159716+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.159716+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:53:20.536658+0000","scrub_duration":0.0032552639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:58.229817+0000","last_change":"2024-04-18T03:41:58.229817+0000","last_active":"2024-04-18T03:41:58.229817+0000","last_peered":"2024-04-18T03:41:58.229817+0000","last_clean":"2024-04-18T03:41:58.229817+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:41:58.229817+0000","last_undegraded":"2024-04-18T03:41:58.229817+0000","last_fullsized":"2024-04-18T03:41:58.229817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2024-04-18T03:41:58.229566+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2024-04-18T03:41:58.229566+0000","last_clean_scrub_stamp":"2024-04-18T03:41:58.229566+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:30.684730+0000","scrub_duration":0.0029384929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:04.676997+0000","last_change":"2024-04-18T03:42:04.676997+0000","last_active":"2024-04-18T03:42:04.676997+0000","last_peered":"2024-04-18T03:42:04.676997+0000","last_clean":"2024-04-18T03:42:04.676997+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:42:04.676997+0000","last_undegraded":"2024-04-18T03:42:04.676997+0000","last_fullsized":"2024-04-18T03:42:04.676997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:42:04.676743+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:42:04.676743+0000","last_clean_scrub_stamp":"2024-04-18T03:42:04.676743+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:03:16.594820+0000","scrub_duration":0.003832252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'58","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.546006+0000","last_change":"2024-04-18T03:41:43.546229+0000","last_active":"2024-04-18T03:41:43.546006+0000","last_peered":"2024-04-18T03:41:43.546006+0000","last_clean":"2024-04-18T03:41:43.546006+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:41:43.546006+0000","last_undegraded":"2024-04-18T03:41:43.546006+0000","last_fullsized":"2024-04-18T03:41:43.546006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:41:43.545942+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:41:43.545942+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.545942+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:44.975388+0000","scrub_duration":0.003138166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.806846+0000","last_change":"2024-04-18T03:42:02.807044+0000","last_active":"2024-04-18T03:42:02.806846+0000","last_peered":"2024-04-18T03:42:02.806846+0000","last_clean":"2024-04-18T03:42:02.806846+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:42:02.806846+0000","last_undegraded":"2024-04-18T03:42:02.806846+0000","last_fullsized":"2024-04-18T03:42:02.806846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:02.806793+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:02.806793+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.806793+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:38.560297+0000","scrub_duration":0.0034323320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:04.846044+0000","last_change":"2024-04-18T03:42:04.846321+0000","last_active":"2024-04-18T03:42:04.846044+0000","last_peered":"2024-04-18T03:42:04.846044+0000","last_clean":"2024-04-18T03:42:04.846044+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:42:04.846044+0000","last_undegraded":"2024-04-18T03:42:04.846044+0000","last_fullsized":"2024-04-18T03:42:04.846044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:04.845993+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:04.845993+0000","last_clean_scrub_stamp":"2024-04-18T03:42:04.845993+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:03:16.764069+0000","scrub_duration":0.0038714449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'53","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:04.018694+0000","last_change":"2024-04-18T03:42:04.018934+0000","last_active":"2024-04-18T03:42:04.018694+0000","last_peered":"2024-04-18T03:42:04.018694+0000","last_clean":"2024-04-18T03:42:04.018694+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:42:04.018694+0000","last_undegraded":"2024-04-18T03:42:04.018694+0000","last_fullsized":"2024-04-18T03:42:04.018694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-18T03:42:04.018638+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-18T03:42:04.018638+0000","last_clean_scrub_stamp":"2024-04-18T03:42:04.018638+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:39.760987+0000","scrub_duration":0.003460089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'59","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:57.145700+0000","last_change":"2024-04-18T03:41:57.145900+0000","last_active":"2024-04-18T03:41:57.145700+0000","last_peered":"2024-04-18T03:41:57.145700+0000","last_clean":"2024-04-18T03:41:57.145700+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:41:57.145700+0000","last_undegraded":"2024-04-18T03:41:57.145700+0000","last_fullsized":"2024-04-18T03:41:57.145700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2024-04-18T03:41:57.145649+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2024-04-18T03:41:57.145649+0000","last_clean_scrub_stamp":"2024-04-18T03:41:57.145649+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:42:23.565837+0000","scrub_duration":0.0027827289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'48","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.899738+0000","last_change":"2024-04-18T03:41:38.899933+0000","last_active":"2024-04-18T03:41:38.899738+0000","last_peered":"2024-04-18T03:41:38.899738+0000","last_clean":"2024-04-18T03:41:38.899738+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:41:38.899738+0000","last_undegraded":"2024-04-18T03:41:38.899738+0000","last_fullsized":"2024-04-18T03:41:38.899738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:41:38.899689+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:41:38.899689+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.899689+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:20:58.444937+0000","scrub_duration":0.0032972489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'44","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.742331+0000","last_change":"2024-04-18T03:41:41.742622+0000","last_active":"2024-04-18T03:41:41.742331+0000","last_peered":"2024-04-18T03:41:41.742331+0000","last_clean":"2024-04-18T03:41:41.742331+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:41:41.742331+0000","last_undegraded":"2024-04-18T03:41:41.742331+0000","last_fullsized":"2024-04-18T03:41:41.742331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:41.742222+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:41.742222+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.742222+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:43.181309+0000","scrub_duration":0.0036324560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:59.247658+0000","last_change":"2024-04-18T03:41:59.247875+0000","last_active":"2024-04-18T03:41:59.247658+0000","last_peered":"2024-04-18T03:41:59.247658+0000","last_clean":"2024-04-18T03:41:59.247658+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:41:59.247658+0000","last_undegraded":"2024-04-18T03:41:59.247658+0000","last_fullsized":"2024-04-18T03:41:59.247658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:59.247600+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:59.247600+0000","last_clean_scrub_stamp":"2024-04-18T03:41:59.247600+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:12.081057+0000","scrub_duration":0.0030890760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'53","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.182813+0000","last_change":"2024-04-18T03:42:09.183014+0000","last_active":"2024-04-18T03:42:09.182813+0000","last_peered":"2024-04-18T03:42:09.182813+0000","last_clean":"2024-04-18T03:42:09.182813+0000","last_became_active":"2024-04-18T03:38:23.514732+0000","last_became_peered":"2024-04-18T03:38:23.514732+0000","last_unstale":"2024-04-18T03:42:09.182813+0000","last_undegraded":"2024-04-18T03:42:09.182813+0000","last_fullsized":"2024-04-18T03:42:09.182813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-18T03:42:09.182763+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-18T03:42:09.182763+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.182763+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:58.287645+0000","scrub_duration":0.003376305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'54","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.561913+0000","last_change":"2024-04-18T03:37:34.302528+0000","last_active":"2024-04-18T03:40:52.561913+0000","last_peered":"2024-04-18T03:40:52.561913+0000","last_clean":"2024-04-18T03:40:52.561913+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:40:52.561913+0000","last_undegraded":"2024-04-18T03:40:52.561913+0000","last_fullsized":"2024-04-18T03:40:52.561913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:06.872081+0000","last_change":"2024-04-18T03:42:06.872341+0000","last_active":"2024-04-18T03:42:06.872081+0000","last_peered":"2024-04-18T03:42:06.872081+0000","last_clean":"2024-04-18T03:42:06.872081+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:42:06.872081+0000","last_undegraded":"2024-04-18T03:42:06.872081+0000","last_fullsized":"2024-04-18T03:42:06.872081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:42:06.872027+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:42:06.872027+0000","last_clean_scrub_stamp":"2024-04-18T03:42:06.872027+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:30:54.457075+0000","scrub_duration":0.003440579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'54","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:07.656701+0000","last_change":"2024-04-18T03:42:07.656889+0000","last_active":"2024-04-18T03:42:07.656701+0000","last_peered":"2024-04-18T03:42:07.656701+0000","last_clean":"2024-04-18T03:42:07.656701+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:42:07.656701+0000","last_undegraded":"2024-04-18T03:42:07.656701+0000","last_fullsized":"2024-04-18T03:42:07.656701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-18T03:42:07.656648+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-18T03:42:07.656648+0000","last_clean_scrub_stamp":"2024-04-18T03:42:07.656648+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:53.559737+0000","scrub_duration":0.003300997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'51","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.547154+0000","last_change":"2024-04-18T03:37:34.307733+0000","last_active":"2024-04-18T03:40:52.547154+0000","last_peered":"2024-04-18T03:40:52.547154+0000","last_clean":"2024-04-18T03:40:52.547154+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:40:52.547154+0000","last_undegraded":"2024-04-18T03:40:52.547154+0000","last_fullsized":"2024-04-18T03:40:52.547154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'55","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:40:52.562606+0000","last_change":"2024-04-18T03:37:34.294949+0000","last_active":"2024-04-18T03:40:52.562606+0000","last_peered":"2024-04-18T03:40:52.562606+0000","last_clean":"2024-04-18T03:40:52.562606+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:40:52.562606+0000","last_undegraded":"2024-04-18T03:40:52.562606+0000","last_fullsized":"2024-04-18T03:40:52.562606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'40","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.778113+0000","last_change":"2024-04-18T03:42:09.778325+0000","last_active":"2024-04-18T03:42:09.778113+0000","last_peered":"2024-04-18T03:42:09.778113+0000","last_clean":"2024-04-18T03:42:09.778113+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:42:09.778113+0000","last_undegraded":"2024-04-18T03:42:09.778113+0000","last_fullsized":"2024-04-18T03:42:09.778113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-18T03:42:09.778054+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-18T03:42:09.778054+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.778054+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:40.985160+0000","scrub_duration":0.003457884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:48.269903+0000","last_change":"2024-04-18T03:41:48.270196+0000","last_active":"2024-04-18T03:41:48.269903+0000","last_peered":"2024-04-18T03:41:48.269903+0000","last_clean":"2024-04-18T03:41:48.269903+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:41:48.269903+0000","last_undegraded":"2024-04-18T03:41:48.269903+0000","last_fullsized":"2024-04-18T03:41:48.269903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:48.269851+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:48.269851+0000","last_clean_scrub_stamp":"2024-04-18T03:41:48.269851+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:50.730224+0000","scrub_duration":0.0035341819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.001693+0000","last_change":"2024-04-18T03:41:33.001693+0000","last_active":"2024-04-18T03:41:33.001693+0000","last_peered":"2024-04-18T03:41:33.001693+0000","last_clean":"2024-04-18T03:41:33.001693+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:41:33.001693+0000","last_undegraded":"2024-04-18T03:41:33.001693+0000","last_fullsized":"2024-04-18T03:41:33.001693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:33.001450+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:33.001450+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.001450+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:23.512254+0000","scrub_duration":0.0028028340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'48","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.600665+0000","last_change":"2024-04-18T03:37:34.313119+0000","last_active":"2024-04-18T03:41:35.600665+0000","last_peered":"2024-04-18T03:41:35.600665+0000","last_clean":"2024-04-18T03:41:35.600665+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:41:35.600665+0000","last_undegraded":"2024-04-18T03:41:35.600665+0000","last_fullsized":"2024-04-18T03:41:35.600665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T03:37:33.891056+0000","last_clean_scrub_stamp":"2024-04-18T03:37:33.891056+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31140456,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":3113,"num_write_kb":31587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62341120,"data_stored":62280912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3850,"ondisk_log_size":3850,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49160,"kb_used_data":13952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94322680,"statfs":{"total":96636764160,"available":96586424320,"internally_reserved":0,"allocated":14286848,"data_stored":14110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.127,"5min":1.286,"15min":1.286},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86599999999999999,"15min":0.89000000000000001},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.161,"5min":1.331,"15min":1.331},"last":1.004}]},{"osd":1,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83899999999999997,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1699999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.753},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82999999999999996,"15min":0.874},"min":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.208,"5min":1.724,"15min":1.724},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0820000000000001,"5min":1.274,"15min":1.274},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.95699999999999996,"15min":0.98599999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2150000000000001,"5min":1.329,"15min":1.329},"last":1.04}]},{"osd":3,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.88600000000000001},"min":{"1min":0.52300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1419999999999999,"5min":1.228,"15min":1.228},"last":1.083},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.83699999999999997},"min":{"1min":0.57199999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.095,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.97399999999999998}]},{"osd":4,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2609999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.871},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.093},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4239999999999999,"5min":2.198,"15min":2.198},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.63900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3839999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.999,"15min":1.0069999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2589999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.123}]},{"osd":7,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0469999999999999,"15min":1.0680000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.351,"5min":1.651,"15min":1.651},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.0629999999999999},"min":{"1min":0.67700000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4359999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.262}]}]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43684,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":8679424,"data_stored":8504374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80900000000000005,"15min":0.83999999999999997},"min":{"1min":0.52900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.044}]},{"osd":1,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.872,"15min":0.89200000000000002},"min":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.111,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.94299999999999995,"15min":0.96399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1879999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.878}]},{"osd":2,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.85499999999999998,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2829999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.68799999999999994,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.90300000000000002,"15min":0.90900000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.179,"5min":1.298,"15min":1.298},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.94399999999999995,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1180000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94199999999999995,"15min":0.93100000000000005},"min":{"1min":0.72999999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.304,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.63},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.133}]},{"osd":6,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.363,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1240000000000001,"15min":1.127},"min":{"1min":0.878,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3819999999999999,"5min":1.621,"15min":1.621},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0449999999999999,"15min":1.0509999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.21,"5min":1.395,"15min":1.395},"last":1.177},{"interface":"front","average":{"1min":1.125,"5min":1.1579999999999999,"15min":1.1259999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.45,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.0089999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542204,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57928,"kb_used_data":18624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94313912,"statfs":{"total":96636764160,"available":96577445888,"internally_reserved":0,"allocated":19070976,"data_stored":18894785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.78600000000000003,"15min":0.80600000000000005},"min":{"1min":0.56399999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.095,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.84799999999999998,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1499999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.044}]},{"osd":1,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90500000000000003,"15min":0.94499999999999995},"min":{"1min":0.62,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3540000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.123,"15min":1.123},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.86699999999999999,"15min":0.93000000000000005},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2490000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.90300000000000002,"15min":0.94199999999999995},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1899999999999999,"5min":1.272,"15min":1.272},"last":1.1000000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90000000000000002,"15min":0.94399999999999995},"min":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.232},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97399999999999998,"15min":1.014},"min":{"1min":0.66300000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.212,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.145}]},{"osd":4,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.91500000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2709999999999999,"5min":1.679,"15min":1.679},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.97499999999999998,"15min":0.98199999999999998},"min":{"1min":0.72899999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.268,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.89500000000000002,"15min":0.92200000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1120000000000001,"5min":1.617,"15min":1.617},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0389999999999999,"15min":1.0660000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3169999999999999,"5min":1.496,"15min":1.496},"last":1.079}]},{"osd":6,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.119},"min":{"1min":0.66200000000000003,"5min":0.625,"15min":0.625},"max":{"1min":1.3109999999999999,"5min":1.593,"15min":1.593},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.014,"15min":1.006},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2430000000000001,"5min":1.462,"15min":1.462},"last":0.88400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542204,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":116344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83399999999999996,"15min":0.89500000000000002},"min":{"1min":0.48599999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0760000000000001,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81899999999999995,"15min":0.84699999999999998},"min":{"1min":0.55800000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.101,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.96399999999999997}]},{"osd":1,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83799999999999997,"15min":0.88700000000000001},"min":{"1min":0.60299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.129,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.87},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.81299999999999994,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86299999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90200000000000002,"15min":0.93400000000000005},"min":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1359999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.046},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.98799999999999999,"15min":1.038},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1919999999999999,"5min":1.536,"15min":1.536},"last":1.0069999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":0.98599999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1890000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.236,"5min":1.472,"15min":1.472},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98299999999999998,"15min":1.03},"min":{"1min":0.58599999999999997,"5min":0.375,"15min":0.375},"max":{"1min":1.252,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0209999999999999,"15min":1.075},"min":{"1min":0.83199999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2749999999999999,"5min":1.631,"15min":1.631},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.90300000000000002,"15min":0.93700000000000006},"min":{"1min":0.64500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1739999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.0980000000000001,"15min":1.1419999999999999},"min":{"1min":0.65800000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.488,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Apr 18 03:41:29 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.998,"15min":1.04},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.256,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.089,"5min":1.1850000000000001,"15min":1.2470000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.627,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.0900000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":12932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":13242368,"data_stored":13068331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66200000000000003,"15min":0.67200000000000004},"min":{"1min":0.49399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1459999999999999,"5min":2.202,"15min":2.202},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70599999999999996,"15min":0.72099999999999997},"min":{"1min":0.42399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":0.753}]},{"osd":1,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.86299999999999999,"5min":1.272,"15min":1.272},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.753,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.0389999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.069,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.55200000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1890000000000001,"5min":1.821,"15min":1.821},"last":0.80600000000000005}]},{"osd":4,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.63700000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.619,"15min":1.619},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.96699999999999997,"15min":0.94699999999999995},"min":{"1min":0.77100000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.014,"15min":1.024},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3660000000000001,"5min":1.966,"15min":1.966},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.042,"15min":1.0229999999999999},"min":{"1min":0.70999999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2330000000000001,"5min":1.845,"15min":1.845},"last":0.93200000000000005}]},{"osd":6,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.042,"15min":1.0600000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2769999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.347},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.097,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.627,"5min":1.764,"15min":1.764},"last":1.107}]},{"osd":7,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.042,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.014},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4099999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.238}]}]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35844,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335996,"statfs":{"total":96636764160,"available":96600059904,"internally_reserved":0,"allocated":651264,"data_stored":484747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.626,"15min":0.64800000000000002},"min":{"1min":0.38300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.69899999999999995},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1679999999999999,"5min":1.532,"15min":1.532},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.228,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98299999999999998,"5min":1.214,"15min":1.214},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.28599999999999998,"5min":0.253,"15min":0.253},"max":{"1min":1.046,"5min":1.246,"15min":1.246},"last":0.624},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.438,"5min":0.318,"15min":0.318},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.89600000000000002,"15min":0.92500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.98299999999999998},"min":{"1min":0.59799999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98899999999999999,"15min":1.0129999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4710000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.754},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.008},"min":{"1min":0.58999999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.077,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.998,"15min":1.024},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.321,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.103}]},{"osd":7,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0209999999999999,"15min":1.0700000000000001},"min":{"1min":0.61299999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.242,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4710000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.1619999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35492,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336348,"statfs":{"total":96636764160,"available":96600420352,"internally_reserved":0,"allocated":290816,"data_stored":116414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58199999999999996,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.745,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76200000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.51900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92500000000000004,"5min":1.321,"15min":1.321},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.83299999999999996},"min":{"1min":0.66400000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0169999999999999,"5min":1.583,"15min":1.583},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.79800000000000004,"15min":0.79100000000000004},"min":{"1min":0.56899999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1259999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.90900000000000003,"15min":0.93500000000000005},"min":{"1min":0.72499999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.206,"5min":1.337,"15min":1.337},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.72399999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1870000000000001,"5min":1.274,"15min":1.274},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"min":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2250000000000001,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":0.998},"min":{"1min":0.71699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.296,"5min":1.353,"15min":1.353},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0640000000000001,"15min":1.1319999999999999},"min":{"1min":0.80500000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.423,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.325},{"interface":"front","average":{"1min":0.999,"5min":1.0620000000000001,"15min":1.1140000000000001},"min":{"1min":0.80400000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.256,"5min":2.242,"15min":2.242},"last":0.97299999999999998}]},{"osd":7,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.079,"15min":1.129},"min":{"1min":0.78500000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3799999999999999,"5min":2.044,"15min":2.044},"last":1.381},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1000000000000001,"15min":1.139},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.296,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.02}]}]},{"osd":0,"up_from":14,"seq":60129542204,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44264,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94327576,"statfs":{"total":96636764160,"available":96591437824,"internally_reserved":0,"allocated":9273344,"data_stored":9094201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86599999999999999,"5min":1.022,"15min":1.022},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.55300000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.69799999999999995},"min":{"1min":0.59199999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90500000000000003,"5min":1.016,"15min":1.016},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0029999999999999,"5min":1.103,"15min":1.103},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.68200000000000005},"min":{"1min":0.42499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.026,"5min":1.28,"15min":1.28},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74299999999999999,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":1.234,"15min":1.234},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Apr 18 03:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.69999999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.76700000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.081,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.999,"15min":0.97099999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0509999999999999},"min":{"1min":0.746,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.004}]},{"osd":6,"last update":"Thu Apr 18 03:41:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.036,"15min":1.032},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.099},{"interface":"front","average":{"1min":1.093,"5min":1.0840000000000001,"15min":1.0660000000000001},"min":{"1min":0.878,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2769999999999999,"5min":1.589,"15min":1.589},"last":1.2270000000000001}]},{"osd":7,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.89900000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2170000000000001,"5min":1.484,"15min":1.484},"last":1.198},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.91400000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.387,"5min":1.544,"15min":1.544},"last":1.159}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14004224,"data_stored":13993949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18194432,"data_stored":18188163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:42:16.702 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.702 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.702 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.702 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.703 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.703 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.703 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.703 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.703 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.704 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.704 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.704 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.704 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.704 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.704 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T03:37:37.293906+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=37, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.705 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.705 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.705 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.705 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.705 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-18T03:37:33.891056+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=37, tm_sec=33, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=3, tm_min=41, tm_sec=30, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T03:42:16.705 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T03:42:36.706 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T03:42:36.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc737fff700 1 Processor -- start 2024-04-18T03:42:36.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc737fff700 1 -- start start 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc737fff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7381597f0 0x7fc7380cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc737fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc7380cc0a0 0x7fc738159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc737fff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7380cbbd0 con 0x7fc73815a110 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc737fff700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73806ef20 con 0x7fc7380cc0a0 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc737fff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380701a0 con 0x7fc7381597f0 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc7367fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc7380cc0a0 0x7fc738159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc7367fc700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc7380cc0a0 0x7fc738159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36058/0 (socket says 172.21.15.157:36058) 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc7367fc700 1 -- 172.21.15.157:0/316594577 learned_addr learned my addr 172.21.15.157:0/316594577 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc736ffd700 1 --2- 172.21.15.157:0/316594577 >> v2:172.21.15.175:3300/0 conn(0x7fc7381597f0 0x7fc7380cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc7367fc700 1 -- 172.21.15.157:0/316594577 >> v2:172.21.15.175:3300/0 conn(0x7fc7381597f0 msgr2=0x7fc7380cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc7367fc700 1 --2- 172.21.15.157:0/316594577 >> v2:172.21.15.175:3300/0 conn(0x7fc7381597f0 0x7fc7380cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:36.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc7367fc700 1 -- 172.21.15.157:0/316594577 >> v1:172.21.15.175:6789/0 conn(0x7fc73815a110 legacy=0x7fc73806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:36.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc7367fc700 1 -- 172.21.15.157:0/316594577 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7380cc530 con 0x7fc7380cc0a0 2024-04-18T03:42:36.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc7367fc700 1 --2- 172.21.15.157:0/316594577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7380cc0a0 0x7fc738159bd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc738071c40 tx=0x7fc72800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abb9597f7c6c57b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:36.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc735ffb700 1 -- 172.21.15.157:0/316594577 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72800e070 con 0x7fc7380cc0a0 2024-04-18T03:42:36.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc735ffb700 1 -- 172.21.15.157:0/316594577 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72800b9c0 con 0x7fc7380cc0a0 2024-04-18T03:42:36.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.829+0000 7fc735ffb700 1 -- 172.21.15.157:0/316594577 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72800bd70 con 0x7fc7380cc0a0 2024-04-18T03:42:36.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- 172.21.15.157:0/316594577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7380cc0a0 msgr2=0x7fc738159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:36.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 --2- 172.21.15.157:0/316594577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7380cc0a0 0x7fc738159bd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc738071c40 tx=0x7fc72800b330 comp rx=0 tx=0).stop 2024-04-18T03:42:36.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- 172.21.15.157:0/316594577 shutdown_connections 2024-04-18T03:42:36.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 --2- 172.21.15.157:0/316594577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7380cc0a0 0x7fc738159bd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:36.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 --2- 172.21.15.157:0/316594577 >> v2:172.21.15.175:3300/0 conn(0x7fc7381597f0 0x7fc7380cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:36.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- 172.21.15.157:0/316594577 >> 172.21.15.157:0/316594577 conn(0x7fc7380b1330 msgr2=0x7fc73806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:36.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- 172.21.15.157:0/316594577 shutdown_connections 2024-04-18T03:42:36.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- 172.21.15.157:0/316594577 wait complete. 2024-04-18T03:42:36.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 Processor -- start 2024-04-18T03:42:36.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- start start 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7380cc0a0 0x7fc7381504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7381597f0 0x7fc7381573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73815a110 0x7fc738143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738152520 con 0x7fc73815a110 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738152800 con 0x7fc7380cc0a0 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc737fff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc738152ae0 con 0x7fc7381597f0 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc7377fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73815a110 0x7fc738143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc7367fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7381597f0 0x7fc7381573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:36.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc736ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7380cc0a0 0x7fc7381504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc7377fe700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73815a110 0x7fc738143040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36070/0 (socket says 172.21.15.157:36070) 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc7367fc700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7381597f0 0x7fc7381573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.157:60096/0 (socket says 172.21.15.157:60096) 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.833+0000 7fc7377fe700 1 -- 172.21.15.157:0/3920560663 learned_addr learned my addr 172.21.15.157:0/3920560663 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc7377fe700 1 -- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7381597f0 msgr2=0x7fc7381573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc7377fe700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7381597f0 0x7fc7381573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc7377fe700 1 -- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7380cc0a0 msgr2=0x7fc7381504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc7377fe700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7380cc0a0 0x7fc7381504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc7377fe700 1 -- 172.21.15.157:0/3920560663 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728009b30 con 0x7fc73815a110 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc736ffd700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7380cc0a0 0x7fc7381504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc7367fc700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7381597f0 0x7fc7381573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc7377fe700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73815a110 0x7fc738143040 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc73000c440 tx=0x7fc73000c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc72ffff700 1 -- 172.21.15.157:0/3920560663 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300052d0 con 0x7fc73815a110 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc72ffff700 1 -- 172.21.15.157:0/3920560663 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730005430 con 0x7fc73815a110 2024-04-18T03:42:36.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc72ffff700 1 -- 172.21.15.157:0/3920560663 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300055a0 con 0x7fc73815a110 2024-04-18T03:42:36.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc738152dc0 con 0x7fc73815a110 2024-04-18T03:42:36.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc738150a00 con 0x7fc73815a110 2024-04-18T03:42:36.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.837+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc738153000 con 0x7fc73815a110 2024-04-18T03:42:36.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.841+0000 7fc72ffff700 1 -- 172.21.15.157:0/3920560663 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7300036a0 con 0x7fc73815a110 2024-04-18T03:42:36.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.841+0000 7fc72ffff700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc718066730 0x7fc718068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:36.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.841+0000 7fc72ffff700 1 -- 172.21.15.157:0/3920560663 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc730083540 con 0x7fc73815a110 2024-04-18T03:42:36.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.841+0000 7fc736ffd700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc718066730 0x7fc718068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:36.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.841+0000 7fc736ffd700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc718066730 0x7fc718068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc720009df0 tx=0x7fc720008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:36.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:36.849+0000 7fc72ffff700 1 -- 172.21.15.157:0/3920560663 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fc7300504f0 con 0x7fc73815a110 2024-04-18T03:42:37.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.013+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 --> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc738070a00 con 0x7fc718066730 2024-04-18T03:42:37.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.037+0000 7fc72ffff700 1 -- 172.21.15.157:0/3920560663 <== mgr.4099 v2:172.21.15.175:6832/25864 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371865 (secure 0 0 0) 0x7fc720011ae0 con 0x7fc718066730 2024-04-18T03:42:37.044 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc718066730 msgr2=0x7fc718068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc718066730 0x7fc718068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc720009df0 tx=0x7fc720008040 comp rx=0 tx=0).stop 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73815a110 msgr2=0x7fc738143040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73815a110 0x7fc738143040 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc73000c440 tx=0x7fc73000c750 comp rx=0 tx=0).stop 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 shutdown_connections 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fc718066730 0x7fc718068bf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc73815a110 0x7fc738143040 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7381597f0 0x7fc7381573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 --2- 172.21.15.157:0/3920560663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7380cc0a0 0x7fc7381504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 >> 172.21.15.157:0/3920560663 conn(0x7fc7380b1330 msgr2=0x7fc7380cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:37.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 shutdown_connections 2024-04-18T03:42:37.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.041+0000 7fc737fff700 1 -- 172.21.15.157:0/3920560663 wait complete. 2024-04-18T03:42:37.048 INFO:teuthology.orchestra.run.smithi157.stderr:dumped all 2024-04-18T03:42:37.058 INFO:teuthology.orchestra.run.smithi157.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-04-18T03:42:35.886228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31730824,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":488,"num_write":3272,"num_write_kb":34003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8683,"ondisk_log_size":8683,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337712,"kb_used_data":64240,"kb_used_omap":12,"kb_used_meta":273395,"kb_avail":754637008,"statfs":{"total":773094113280,"available":772748296192,"internally_reserved":0,"allocated":65781760,"data_stored":64389399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":279957048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005282"},"pg_stats":[{"pgid":"2.1f","version":"27'44","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:47.313806+0000","last_change":"2024-04-18T03:41:47.313806+0000","last_active":"2024-04-18T03:41:47.313806+0000","last_peered":"2024-04-18T03:41:47.313806+0000","last_clean":"2024-04-18T03:41:47.313806+0000","last_became_active":"2024-04-18T03:37:33.922261+0000","last_became_peered":"2024-04-18T03:37:33.922261+0000","last_unstale":"2024-04-18T03:41:47.313806+0000","last_undegraded":"2024-04-18T03:41:47.313806+0000","last_fullsized":"2024-04-18T03:41:47.313806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:47.313394+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:47.313394+0000","last_clean_scrub_stamp":"2024-04-18T03:41:47.313394+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:44:53.111022+0000","scrub_duration":0.016391722000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'46","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.866590+0000","last_change":"2024-04-18T03:41:41.866853+0000","last_active":"2024-04-18T03:41:41.866590+0000","last_peered":"2024-04-18T03:41:41.866590+0000","last_clean":"2024-04-18T03:41:41.866590+0000","last_became_active":"2024-04-18T03:37:34.316576+0000","last_became_peered":"2024-04-18T03:37:34.316576+0000","last_unstale":"2024-04-18T03:41:41.866590+0000","last_undegraded":"2024-04-18T03:41:41.866590+0000","last_fullsized":"2024-04-18T03:41:41.866590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:41:41.866538+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:41:41.866538+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.866538+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:24:50.426740+0000","scrub_duration":0.0040658880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:10.759160+0000","last_change":"2024-04-18T03:42:10.759160+0000","last_active":"2024-04-18T03:42:10.759160+0000","last_peered":"2024-04-18T03:42:10.759160+0000","last_clean":"2024-04-18T03:42:10.759160+0000","last_became_active":"2024-04-18T03:37:38.557525+0000","last_became_peered":"2024-04-18T03:37:38.557525+0000","last_unstale":"2024-04-18T03:42:10.759160+0000","last_undegraded":"2024-04-18T03:42:10.759160+0000","last_fullsized":"2024-04-18T03:42:10.759160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:42:10.758788+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:42:10.758788+0000","last_clean_scrub_stamp":"2024-04-18T03:42:10.758788+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:31:09.759659+0000","scrub_duration":0.0038214120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'31","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:42.896356+0000","last_change":"2024-04-18T03:41:42.896476+0000","last_active":"2024-04-18T03:41:42.896356+0000","last_peered":"2024-04-18T03:41:42.896356+0000","last_clean":"2024-04-18T03:41:42.896356+0000","last_became_active":"2024-04-18T03:37:33.925224+0000","last_became_peered":"2024-04-18T03:37:33.925224+0000","last_unstale":"2024-04-18T03:41:42.896356+0000","last_undegraded":"2024-04-18T03:41:42.896356+0000","last_fullsized":"2024-04-18T03:41:42.896356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-18T03:41:42.896332+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-18T03:41:42.896332+0000","last_clean_scrub_stamp":"2024-04-18T03:41:42.896332+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:43.175299+0000","scrub_duration":0.013984702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:00.127133+0000","last_change":"2024-04-18T03:42:00.127409+0000","last_active":"2024-04-18T03:42:00.127133+0000","last_peered":"2024-04-18T03:42:00.127133+0000","last_clean":"2024-04-18T03:42:00.127133+0000","last_became_active":"2024-04-18T03:37:34.301822+0000","last_became_peered":"2024-04-18T03:37:34.301822+0000","last_unstale":"2024-04-18T03:42:00.127133+0000","last_undegraded":"2024-04-18T03:42:00.127133+0000","last_fullsized":"2024-04-18T03:42:00.127133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2024-04-18T03:42:00.127084+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2024-04-18T03:42:00.127084+0000","last_clean_scrub_stamp":"2024-04-18T03:42:00.127084+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:12:41.667041+0000","scrub_duration":0.002864746,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'43","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:11.736122+0000","last_change":"2024-04-18T03:42:11.736122+0000","last_active":"2024-04-18T03:42:11.736122+0000","last_peered":"2024-04-18T03:42:11.736122+0000","last_clean":"2024-04-18T03:42:11.736122+0000","last_became_active":"2024-04-18T03:37:38.328012+0000","last_became_peered":"2024-04-18T03:37:38.328012+0000","last_unstale":"2024-04-18T03:42:11.736122+0000","last_undegraded":"2024-04-18T03:42:11.736122+0000","last_fullsized":"2024-04-18T03:42:11.736122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:11.735577+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:11.735577+0000","last_clean_scrub_stamp":"2024-04-18T03:42:11.735577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:43:00.840459+0000","scrub_duration":0.0038637279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'67","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.648641+0000","last_change":"2024-04-18T03:42:02.648793+0000","last_active":"2024-04-18T03:42:02.648641+0000","last_peered":"2024-04-18T03:42:02.648641+0000","last_clean":"2024-04-18T03:42:02.648641+0000","last_became_active":"2024-04-18T03:37:33.930806+0000","last_became_peered":"2024-04-18T03:37:33.930806+0000","last_unstale":"2024-04-18T03:42:02.648641+0000","last_undegraded":"2024-04-18T03:42:02.648641+0000","last_fullsized":"2024-04-18T03:42:02.648641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'67","last_scrub_stamp":"2024-04-18T03:42:02.648608+0000","last_deep_scrub":"27'67","last_deep_scrub_stamp":"2024-04-18T03:42:02.648608+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.648608+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:38.402112+0000","scrub_duration":0.021057800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5604669,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":5495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'50","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.786740+0000","last_change":"2024-04-18T03:41:35.786953+0000","last_active":"2024-04-18T03:41:35.786740+0000","last_peered":"2024-04-18T03:41:35.786740+0000","last_clean":"2024-04-18T03:41:35.786740+0000","last_became_active":"2024-04-18T03:37:34.305555+0000","last_became_peered":"2024-04-18T03:37:34.305555+0000","last_unstale":"2024-04-18T03:41:35.786740+0000","last_undegraded":"2024-04-18T03:41:35.786740+0000","last_fullsized":"2024-04-18T03:41:35.786740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:35.786690+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:35.786690+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.786690+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:04.481446+0000","scrub_duration":0.0030209529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'44","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:18.784845+0000","last_change":"2024-04-18T03:42:18.785189+0000","last_active":"2024-04-18T03:42:18.784845+0000","last_peered":"2024-04-18T03:42:18.784845+0000","last_clean":"2024-04-18T03:42:18.784845+0000","last_became_active":"2024-04-18T03:37:38.329495+0000","last_became_peered":"2024-04-18T03:37:38.329495+0000","last_unstale":"2024-04-18T03:42:18.784845+0000","last_undegraded":"2024-04-18T03:42:18.784845+0000","last_fullsized":"2024-04-18T03:42:18.784845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:42:18.784791+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:42:18.784791+0000","last_clean_scrub_stamp":"2024-04-18T03:42:18.784791+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:33:55.853533+0000","scrub_duration":0.003711677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'17","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:00.656713+0000","last_change":"2024-04-18T03:42:00.656917+0000","last_active":"2024-04-18T03:42:00.656713+0000","last_peered":"2024-04-18T03:42:00.656713+0000","last_clean":"2024-04-18T03:42:00.656713+0000","last_became_active":"2024-04-18T03:37:33.925588+0000","last_became_peered":"2024-04-18T03:37:33.925588+0000","last_unstale":"2024-04-18T03:42:00.656713+0000","last_undegraded":"2024-04-18T03:42:00.656713+0000","last_fullsized":"2024-04-18T03:42:00.656713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-18T03:42:00.656663+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-18T03:42:00.656663+0000","last_clean_scrub_stamp":"2024-04-18T03:42:00.656663+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:43.824850+0000","scrub_duration":0.005832009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'58","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:06.818907+0000","last_change":"2024-04-18T03:42:06.819151+0000","last_active":"2024-04-18T03:42:06.818907+0000","last_peered":"2024-04-18T03:42:06.818907+0000","last_clean":"2024-04-18T03:42:06.818907+0000","last_became_active":"2024-04-18T03:37:34.296798+0000","last_became_peered":"2024-04-18T03:37:34.296798+0000","last_unstale":"2024-04-18T03:42:06.818907+0000","last_undegraded":"2024-04-18T03:42:06.818907+0000","last_fullsized":"2024-04-18T03:42:06.818907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:42:06.818850+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:42:06.818850+0000","last_clean_scrub_stamp":"2024-04-18T03:42:06.818850+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:52.721939+0000","scrub_duration":0.0030012229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'40","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:01.729611+0000","last_change":"2024-04-18T03:42:01.729947+0000","last_active":"2024-04-18T03:42:01.729611+0000","last_peered":"2024-04-18T03:42:01.729611+0000","last_clean":"2024-04-18T03:42:01.729611+0000","last_became_active":"2024-04-18T03:37:38.321717+0000","last_became_peered":"2024-04-18T03:37:38.321717+0000","last_unstale":"2024-04-18T03:42:01.729611+0000","last_undegraded":"2024-04-18T03:42:01.729611+0000","last_fullsized":"2024-04-18T03:42:01.729611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-18T03:42:01.729554+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-18T03:42:01.729554+0000","last_clean_scrub_stamp":"2024-04-18T03:42:01.729554+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:14.563011+0000","scrub_duration":0.0038496120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'42","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:56.150196+0000","last_change":"2024-04-18T03:41:56.150196+0000","last_active":"2024-04-18T03:41:56.150196+0000","last_peered":"2024-04-18T03:41:56.150196+0000","last_clean":"2024-04-18T03:41:56.150196+0000","last_became_active":"2024-04-18T03:37:34.310963+0000","last_became_peered":"2024-04-18T03:37:34.310963+0000","last_unstale":"2024-04-18T03:41:56.150196+0000","last_undegraded":"2024-04-18T03:41:56.150196+0000","last_fullsized":"2024-04-18T03:41:56.150196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:41:56.149882+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:41:56.149882+0000","last_clean_scrub_stamp":"2024-04-18T03:41:56.149882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:58.610255+0000","scrub_duration":0.0030500380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'529","reported_seq":560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:53.786319+0000","last_change":"2024-04-18T03:41:53.786319+0000","last_active":"2024-04-18T03:41:53.786319+0000","last_peered":"2024-04-18T03:41:53.786319+0000","last_clean":"2024-04-18T03:41:53.786319+0000","last_became_active":"2024-04-18T03:37:33.925601+0000","last_became_peered":"2024-04-18T03:37:33.925601+0000","last_unstale":"2024-04-18T03:41:53.786319+0000","last_undegraded":"2024-04-18T03:41:53.786319+0000","last_fullsized":"2024-04-18T03:41:53.786319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'529","last_scrub_stamp":"2024-04-18T03:41:53.786199+0000","last_deep_scrub":"27'529","last_deep_scrub_stamp":"2024-04-18T03:41:53.786199+0000","last_clean_scrub_stamp":"2024-04-18T03:41:53.786199+0000","objects_scrubbed":2,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:25:02.346400+0000","scrub_duration":0.019822007999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'41","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.759188+0000","last_change":"2024-04-18T03:42:09.759531+0000","last_active":"2024-04-18T03:42:09.759188+0000","last_peered":"2024-04-18T03:42:09.759188+0000","last_clean":"2024-04-18T03:42:09.759188+0000","last_became_active":"2024-04-18T03:37:38.328118+0000","last_became_peered":"2024-04-18T03:37:38.328118+0000","last_unstale":"2024-04-18T03:42:09.759188+0000","last_undegraded":"2024-04-18T03:42:09.759188+0000","last_fullsized":"2024-04-18T03:42:09.759188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'41","last_scrub_stamp":"2024-04-18T03:42:09.759067+0000","last_deep_scrub":"27'41","last_deep_scrub_stamp":"2024-04-18T03:42:09.759067+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.759067+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:48:22.550220+0000","scrub_duration":0.0045383639999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'55","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:19.966046+0000","last_change":"2024-04-18T03:42:19.966401+0000","last_active":"2024-04-18T03:42:19.966046+0000","last_peered":"2024-04-18T03:42:19.966046+0000","last_clean":"2024-04-18T03:42:19.966046+0000","last_became_active":"2024-04-18T03:38:23.516790+0000","last_became_peered":"2024-04-18T03:38:23.516790+0000","last_unstale":"2024-04-18T03:42:19.966046+0000","last_undegraded":"2024-04-18T03:42:19.966046+0000","last_fullsized":"2024-04-18T03:42:19.966046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:19.965916+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:19.965916+0000","last_clean_scrub_stamp":"2024-04-18T03:42:19.965916+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:24:11.567772+0000","scrub_duration":0.0029376860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"27'31","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.051224+0000","last_change":"2024-04-18T03:41:38.051224+0000","last_active":"2024-04-18T03:41:38.051224+0000","last_peered":"2024-04-18T03:41:38.051224+0000","last_clean":"2024-04-18T03:41:38.051224+0000","last_became_active":"2024-04-18T03:37:33.927846+0000","last_became_peered":"2024-04-18T03:37:33.927846+0000","last_unstale":"2024-04-18T03:41:38.051224+0000","last_undegraded":"2024-04-18T03:41:38.051224+0000","last_fullsized":"2024-04-18T03:41:38.051224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-04-18T03:41:38.050964+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-04-18T03:41:38.050964+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.050964+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:49.985927+0000","scrub_duration":0.0030233410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'48","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:12.716469+0000","last_change":"2024-04-18T03:42:12.716740+0000","last_active":"2024-04-18T03:42:12.716469+0000","last_peered":"2024-04-18T03:42:12.716469+0000","last_clean":"2024-04-18T03:42:12.716469+0000","last_became_active":"2024-04-18T03:37:38.327971+0000","last_became_peered":"2024-04-18T03:37:38.327971+0000","last_unstale":"2024-04-18T03:42:12.716469+0000","last_undegraded":"2024-04-18T03:42:12.716469+0000","last_fullsized":"2024-04-18T03:42:12.716469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:42:12.716404+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:42:12.716404+0000","last_clean_scrub_stamp":"2024-04-18T03:42:12.716404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:53:31.093346+0000","scrub_duration":0.003625531,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'48","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.948988+0000","last_change":"2024-04-18T03:41:52.948988+0000","last_active":"2024-04-18T03:41:52.948988+0000","last_peered":"2024-04-18T03:41:52.948988+0000","last_clean":"2024-04-18T03:41:52.948988+0000","last_became_active":"2024-04-18T03:37:34.303481+0000","last_became_peered":"2024-04-18T03:37:34.303481+0000","last_unstale":"2024-04-18T03:41:52.948988+0000","last_undegraded":"2024-04-18T03:41:52.948988+0000","last_fullsized":"2024-04-18T03:41:52.948988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:41:52.948738+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:41:52.948738+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.948738+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:03:04.866815+0000","scrub_duration":0.0037064210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.016858+0000","last_change":"2024-04-18T03:41:52.016858+0000","last_active":"2024-04-18T03:41:52.016858+0000","last_peered":"2024-04-18T03:41:52.016858+0000","last_clean":"2024-04-18T03:41:52.016858+0000","last_became_active":"2024-04-18T03:37:33.921049+0000","last_became_peered":"2024-04-18T03:37:33.921049+0000","last_unstale":"2024-04-18T03:41:52.016858+0000","last_undegraded":"2024-04-18T03:41:52.016858+0000","last_fullsized":"2024-04-18T03:41:52.016858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-04-18T03:41:52.016598+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-04-18T03:41:52.016598+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.016598+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:44:57.814226+0000","scrub_duration":0.0035341439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'40","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:14.072454+0000","last_change":"2024-04-18T03:42:14.072839+0000","last_active":"2024-04-18T03:42:14.072454+0000","last_peered":"2024-04-18T03:42:14.072454+0000","last_clean":"2024-04-18T03:42:14.072454+0000","last_became_active":"2024-04-18T03:37:38.553139+0000","last_became_peered":"2024-04-18T03:37:38.553139+0000","last_unstale":"2024-04-18T03:42:14.072454+0000","last_undegraded":"2024-04-18T03:42:14.072454+0000","last_fullsized":"2024-04-18T03:42:14.072454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-18T03:42:14.072333+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-18T03:42:14.072333+0000","last_clean_scrub_stamp":"2024-04-18T03:42:14.072333+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:10:20.990231+0000","scrub_duration":0.003847217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'48","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:55.666995+0000","last_change":"2024-04-18T03:41:55.666995+0000","last_active":"2024-04-18T03:41:55.666995+0000","last_peered":"2024-04-18T03:41:55.666995+0000","last_clean":"2024-04-18T03:41:55.666995+0000","last_became_active":"2024-04-18T03:37:34.291354+0000","last_became_peered":"2024-04-18T03:37:34.291354+0000","last_unstale":"2024-04-18T03:41:55.666995+0000","last_undegraded":"2024-04-18T03:41:55.666995+0000","last_fullsized":"2024-04-18T03:41:55.666995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:41:55.666666+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:41:55.666666+0000","last_clean_scrub_stamp":"2024-04-18T03:41:55.666666+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:12:47.655411+0000","scrub_duration":0.0035713089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'21","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:54.722841+0000","last_change":"2024-04-18T03:41:54.722841+0000","last_active":"2024-04-18T03:41:54.722841+0000","last_peered":"2024-04-18T03:41:54.722841+0000","last_clean":"2024-04-18T03:41:54.722841+0000","last_became_active":"2024-04-18T03:37:33.922772+0000","last_became_peered":"2024-04-18T03:37:33.922772+0000","last_unstale":"2024-04-18T03:41:54.722841+0000","last_undegraded":"2024-04-18T03:41:54.722841+0000","last_fullsized":"2024-04-18T03:41:54.722841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-18T03:41:54.722567+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-18T03:41:54.722567+0000","last_clean_scrub_stamp":"2024-04-18T03:41:54.722567+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:55.001534+0000","scrub_duration":0.003409151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'42","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:59.677537+0000","last_change":"2024-04-18T03:41:59.677537+0000","last_active":"2024-04-18T03:41:59.677537+0000","last_peered":"2024-04-18T03:41:59.677537+0000","last_clean":"2024-04-18T03:41:59.677537+0000","last_became_active":"2024-04-18T03:37:38.333873+0000","last_became_peered":"2024-04-18T03:37:38.333873+0000","last_unstale":"2024-04-18T03:41:59.677537+0000","last_undegraded":"2024-04-18T03:41:59.677537+0000","last_fullsized":"2024-04-18T03:41:59.677537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:41:59.677185+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:41:59.677185+0000","last_clean_scrub_stamp":"2024-04-18T03:41:59.677185+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:05:23.714724+0000","scrub_duration":0.0038581750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:03.208130+0000","last_change":"2024-04-18T03:42:03.208327+0000","last_active":"2024-04-18T03:42:03.208130+0000","last_peered":"2024-04-18T03:42:03.208130+0000","last_clean":"2024-04-18T03:42:03.208130+0000","last_became_active":"2024-04-18T03:37:34.289320+0000","last_became_peered":"2024-04-18T03:37:34.289320+0000","last_unstale":"2024-04-18T03:42:03.208130+0000","last_undegraded":"2024-04-18T03:42:03.208130+0000","last_fullsized":"2024-04-18T03:42:03.208130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:42:03.208076+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:42:03.208076+0000","last_clean_scrub_stamp":"2024-04-18T03:42:03.208076+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:32.952412+0000","scrub_duration":0.0030119750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'27","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.297161+0000","last_change":"2024-04-18T03:41:43.297161+0000","last_active":"2024-04-18T03:41:43.297161+0000","last_peered":"2024-04-18T03:41:43.297161+0000","last_clean":"2024-04-18T03:41:43.297161+0000","last_became_active":"2024-04-18T03:37:33.929420+0000","last_became_peered":"2024-04-18T03:37:33.929420+0000","last_unstale":"2024-04-18T03:41:43.297161+0000","last_undegraded":"2024-04-18T03:41:43.297161+0000","last_fullsized":"2024-04-18T03:41:43.297161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-04-18T03:41:43.296902+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-04-18T03:41:43.296902+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.296902+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:28:23.675175+0000","scrub_duration":0.0056293070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'46","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:08.776063+0000","last_change":"2024-04-18T03:42:08.776369+0000","last_active":"2024-04-18T03:42:08.776063+0000","last_peered":"2024-04-18T03:42:08.776063+0000","last_clean":"2024-04-18T03:42:08.776063+0000","last_became_active":"2024-04-18T03:37:38.551375+0000","last_became_peered":"2024-04-18T03:37:38.551375+0000","last_unstale":"2024-04-18T03:42:08.776063+0000","last_undegraded":"2024-04-18T03:42:08.776063+0000","last_fullsized":"2024-04-18T03:42:08.776063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:42:08.775983+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:42:08.775983+0000","last_clean_scrub_stamp":"2024-04-18T03:42:08.775983+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:33.358183+0000","scrub_duration":0.0040325609999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:59.983060+0000","last_change":"2024-04-18T03:41:59.983256+0000","last_active":"2024-04-18T03:41:59.983060+0000","last_peered":"2024-04-18T03:41:59.983060+0000","last_clean":"2024-04-18T03:41:59.983060+0000","last_became_active":"2024-04-18T03:37:34.304056+0000","last_became_peered":"2024-04-18T03:37:34.304056+0000","last_unstale":"2024-04-18T03:41:59.983060+0000","last_undegraded":"2024-04-18T03:41:59.983060+0000","last_fullsized":"2024-04-18T03:41:59.983060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:41:59.983006+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:41:59.983006+0000","last_clean_scrub_stamp":"2024-04-18T03:41:59.983006+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:31:51.836947+0000","scrub_duration":0.003587537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'39","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:40.098711+0000","last_change":"2024-04-18T03:41:40.098711+0000","last_active":"2024-04-18T03:41:40.098711+0000","last_peered":"2024-04-18T03:41:40.098711+0000","last_clean":"2024-04-18T03:41:40.098711+0000","last_became_active":"2024-04-18T03:37:33.932480+0000","last_became_peered":"2024-04-18T03:37:33.932480+0000","last_unstale":"2024-04-18T03:41:40.098711+0000","last_undegraded":"2024-04-18T03:41:40.098711+0000","last_fullsized":"2024-04-18T03:41:40.098711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-18T03:41:40.098426+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-18T03:41:40.098426+0000","last_clean_scrub_stamp":"2024-04-18T03:41:40.098426+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:41.537514+0000","scrub_duration":0.0076541339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'51","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:17.792148+0000","last_change":"2024-04-18T03:42:17.792421+0000","last_active":"2024-04-18T03:42:17.792148+0000","last_peered":"2024-04-18T03:42:17.792148+0000","last_clean":"2024-04-18T03:42:17.792148+0000","last_became_active":"2024-04-18T03:37:38.554046+0000","last_became_peered":"2024-04-18T03:37:38.554046+0000","last_unstale":"2024-04-18T03:42:17.792148+0000","last_undegraded":"2024-04-18T03:42:17.792148+0000","last_fullsized":"2024-04-18T03:42:17.792148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:42:17.792033+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:42:17.792033+0000","last_clean_scrub_stamp":"2024-04-18T03:42:17.792033+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:02:16.003465+0000","scrub_duration":0.0035534429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:58.028259+0000","last_change":"2024-04-18T03:41:58.028472+0000","last_active":"2024-04-18T03:41:58.028259+0000","last_peered":"2024-04-18T03:41:58.028259+0000","last_clean":"2024-04-18T03:41:58.028259+0000","last_became_active":"2024-04-18T03:37:34.296141+0000","last_became_peered":"2024-04-18T03:37:34.296141+0000","last_unstale":"2024-04-18T03:41:58.028259+0000","last_undegraded":"2024-04-18T03:41:58.028259+0000","last_fullsized":"2024-04-18T03:41:58.028259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-18T03:41:58.028208+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-18T03:41:58.028208+0000","last_clean_scrub_stamp":"2024-04-18T03:41:58.028208+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:42.871419+0000","scrub_duration":0.0028685780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'28","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.737598+0000","last_change":"2024-04-18T03:41:50.737794+0000","last_active":"2024-04-18T03:41:50.737598+0000","last_peered":"2024-04-18T03:41:50.737598+0000","last_clean":"2024-04-18T03:41:50.737598+0000","last_became_active":"2024-04-18T03:37:33.923959+0000","last_became_peered":"2024-04-18T03:37:33.923959+0000","last_unstale":"2024-04-18T03:41:50.737598+0000","last_undegraded":"2024-04-18T03:41:50.737598+0000","last_fullsized":"2024-04-18T03:41:50.737598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-04-18T03:41:50.737548+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-04-18T03:41:50.737548+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.737548+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:38.977573+0000","scrub_duration":0.003374279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'43","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:15.152279+0000","last_change":"2024-04-18T03:42:15.152554+0000","last_active":"2024-04-18T03:42:15.152279+0000","last_peered":"2024-04-18T03:42:15.152279+0000","last_clean":"2024-04-18T03:42:15.152279+0000","last_became_active":"2024-04-18T03:37:38.549254+0000","last_became_peered":"2024-04-18T03:37:38.549254+0000","last_unstale":"2024-04-18T03:42:15.152279+0000","last_undegraded":"2024-04-18T03:42:15.152279+0000","last_fullsized":"2024-04-18T03:42:15.152279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:15.152225+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:15.152225+0000","last_clean_scrub_stamp":"2024-04-18T03:42:15.152225+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:24:06.754081+0000","scrub_duration":0.0035695660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'46","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:05.820355+0000","last_change":"2024-04-18T03:42:05.820571+0000","last_active":"2024-04-18T03:42:05.820355+0000","last_peered":"2024-04-18T03:42:05.820355+0000","last_clean":"2024-04-18T03:42:05.820355+0000","last_became_active":"2024-04-18T03:37:34.300678+0000","last_became_peered":"2024-04-18T03:37:34.300678+0000","last_unstale":"2024-04-18T03:42:05.820355+0000","last_undegraded":"2024-04-18T03:42:05.820355+0000","last_fullsized":"2024-04-18T03:42:05.820355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:42:05.820302+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:42:05.820302+0000","last_clean_scrub_stamp":"2024-04-18T03:42:05.820302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:53:05.978403+0000","scrub_duration":0.0038203,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'22","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.994555+0000","last_change":"2024-04-18T03:41:52.994766+0000","last_active":"2024-04-18T03:41:52.994555+0000","last_peered":"2024-04-18T03:41:52.994555+0000","last_clean":"2024-04-18T03:41:52.994555+0000","last_became_active":"2024-04-18T03:37:33.925957+0000","last_became_peered":"2024-04-18T03:37:33.925957+0000","last_unstale":"2024-04-18T03:41:52.994555+0000","last_undegraded":"2024-04-18T03:41:52.994555+0000","last_fullsized":"2024-04-18T03:41:52.994555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-04-18T03:41:52.994506+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-04-18T03:41:52.994506+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.994506+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:55.454879+0000","scrub_duration":0.0032425269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:10.041157+0000","last_change":"2024-04-18T03:42:10.041535+0000","last_active":"2024-04-18T03:42:10.041157+0000","last_peered":"2024-04-18T03:42:10.041157+0000","last_clean":"2024-04-18T03:42:10.041157+0000","last_became_active":"2024-04-18T03:37:38.340744+0000","last_became_peered":"2024-04-18T03:37:38.340744+0000","last_unstale":"2024-04-18T03:42:10.041157+0000","last_undegraded":"2024-04-18T03:42:10.041157+0000","last_fullsized":"2024-04-18T03:42:10.041157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-18T03:42:10.041021+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-18T03:42:10.041021+0000","last_clean_scrub_stamp":"2024-04-18T03:42:10.041021+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:27:36.175495+0000","scrub_duration":0.004010441,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.808734+0000","last_change":"2024-04-18T03:41:39.808734+0000","last_active":"2024-04-18T03:41:39.808734+0000","last_peered":"2024-04-18T03:41:39.808734+0000","last_clean":"2024-04-18T03:41:39.808734+0000","last_became_active":"2024-04-18T03:37:34.308368+0000","last_became_peered":"2024-04-18T03:37:34.308368+0000","last_unstale":"2024-04-18T03:41:39.808734+0000","last_undegraded":"2024-04-18T03:41:39.808734+0000","last_fullsized":"2024-04-18T03:41:39.808734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:39.808285+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:39.808285+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.808285+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:51.743247+0000","scrub_duration":0.0034876019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'24","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:42.797791+0000","last_change":"2024-04-18T03:41:42.797791+0000","last_active":"2024-04-18T03:41:42.797791+0000","last_peered":"2024-04-18T03:41:42.797791+0000","last_clean":"2024-04-18T03:41:42.797791+0000","last_became_active":"2024-04-18T03:37:33.920306+0000","last_became_peered":"2024-04-18T03:37:33.920306+0000","last_unstale":"2024-04-18T03:41:42.797791+0000","last_undegraded":"2024-04-18T03:41:42.797791+0000","last_fullsized":"2024-04-18T03:41:42.797791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:42.797529+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:42.797529+0000","last_clean_scrub_stamp":"2024-04-18T03:41:42.797529+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:50.855947+0000","scrub_duration":0.0038311510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'43","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:05.042895+0000","last_change":"2024-04-18T03:42:05.043279+0000","last_active":"2024-04-18T03:42:05.042895+0000","last_peered":"2024-04-18T03:42:05.042895+0000","last_clean":"2024-04-18T03:42:05.042895+0000","last_became_active":"2024-04-18T03:37:38.338592+0000","last_became_peered":"2024-04-18T03:37:38.338592+0000","last_unstale":"2024-04-18T03:42:05.042895+0000","last_undegraded":"2024-04-18T03:42:05.042895+0000","last_fullsized":"2024-04-18T03:42:05.042895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:05.042757+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:05.042757+0000","last_clean_scrub_stamp":"2024-04-18T03:42:05.042757+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:12:46.582714+0000","scrub_duration":0.0038923299999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'45","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:57.037811+0000","last_change":"2024-04-18T03:41:57.038036+0000","last_active":"2024-04-18T03:41:57.037811+0000","last_peered":"2024-04-18T03:41:57.037811+0000","last_clean":"2024-04-18T03:41:57.037811+0000","last_became_active":"2024-04-18T03:37:34.296129+0000","last_became_peered":"2024-04-18T03:37:34.296129+0000","last_unstale":"2024-04-18T03:41:57.037811+0000","last_undegraded":"2024-04-18T03:41:57.037811+0000","last_fullsized":"2024-04-18T03:41:57.037811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-18T03:41:57.037759+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-18T03:41:57.037759+0000","last_clean_scrub_stamp":"2024-04-18T03:41:57.037759+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:29.492923+0000","scrub_duration":0.003157679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'74","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.514977+0000","last_change":"2024-04-18T03:41:38.514977+0000","last_active":"2024-04-18T03:41:38.514977+0000","last_peered":"2024-04-18T03:41:38.514977+0000","last_clean":"2024-04-18T03:41:38.514977+0000","last_became_active":"2024-04-18T03:37:33.916490+0000","last_became_peered":"2024-04-18T03:37:33.916490+0000","last_unstale":"2024-04-18T03:41:38.514977+0000","last_undegraded":"2024-04-18T03:41:38.514977+0000","last_fullsized":"2024-04-18T03:41:38.514977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-04-18T03:41:38.514723+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-04-18T03:41:38.514723+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.514723+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:21.174107+0000","scrub_duration":0.0071320410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":368493,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":44,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'49","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:07.088651+0000","last_change":"2024-04-18T03:42:07.089027+0000","last_active":"2024-04-18T03:42:07.088651+0000","last_peered":"2024-04-18T03:42:07.088651+0000","last_clean":"2024-04-18T03:42:07.088651+0000","last_became_active":"2024-04-18T03:37:38.338889+0000","last_became_peered":"2024-04-18T03:37:38.338889+0000","last_unstale":"2024-04-18T03:42:07.088651+0000","last_undegraded":"2024-04-18T03:42:07.088651+0000","last_fullsized":"2024-04-18T03:42:07.088651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:42:07.088598+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:42:07.088598+0000","last_clean_scrub_stamp":"2024-04-18T03:42:07.088598+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:53:25.465540+0000","scrub_duration":0.00372238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:51.144326+0000","last_change":"2024-04-18T03:41:51.144604+0000","last_active":"2024-04-18T03:41:51.144326+0000","last_peered":"2024-04-18T03:41:51.144326+0000","last_clean":"2024-04-18T03:41:51.144326+0000","last_became_active":"2024-04-18T03:37:34.297390+0000","last_became_peered":"2024-04-18T03:37:34.297390+0000","last_unstale":"2024-04-18T03:41:51.144326+0000","last_undegraded":"2024-04-18T03:41:51.144326+0000","last_fullsized":"2024-04-18T03:41:51.144326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:51.144273+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:51.144273+0000","last_clean_scrub_stamp":"2024-04-18T03:41:51.144273+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:42.399546+0000","scrub_duration":0.0034673759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'21","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:49.786059+0000","last_change":"2024-04-18T03:41:49.786244+0000","last_active":"2024-04-18T03:41:49.786059+0000","last_peered":"2024-04-18T03:41:49.786059+0000","last_clean":"2024-04-18T03:41:49.786059+0000","last_became_active":"2024-04-18T03:37:33.922622+0000","last_became_peered":"2024-04-18T03:37:33.922622+0000","last_unstale":"2024-04-18T03:41:49.786059+0000","last_undegraded":"2024-04-18T03:41:49.786059+0000","last_fullsized":"2024-04-18T03:41:49.786059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-18T03:41:49.786003+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-18T03:41:49.786003+0000","last_clean_scrub_stamp":"2024-04-18T03:41:49.786003+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:09.331251+0000","scrub_duration":0.0037904060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'40","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.305061+0000","last_change":"2024-04-18T03:42:09.305351+0000","last_active":"2024-04-18T03:42:09.305061+0000","last_peered":"2024-04-18T03:42:09.305061+0000","last_clean":"2024-04-18T03:42:09.305061+0000","last_became_active":"2024-04-18T03:38:23.755354+0000","last_became_peered":"2024-04-18T03:38:23.755354+0000","last_unstale":"2024-04-18T03:42:09.305061+0000","last_undegraded":"2024-04-18T03:42:09.305061+0000","last_fullsized":"2024-04-18T03:42:09.305061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-18T03:42:09.305008+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-18T03:42:09.305008+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.305008+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:10:16.222905+0000","scrub_duration":0.003659668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'57","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:55.954099+0000","last_change":"2024-04-18T03:41:55.954301+0000","last_active":"2024-04-18T03:41:55.954099+0000","last_peered":"2024-04-18T03:41:55.954099+0000","last_clean":"2024-04-18T03:41:55.954099+0000","last_became_active":"2024-04-18T03:37:34.305877+0000","last_became_peered":"2024-04-18T03:37:34.305877+0000","last_unstale":"2024-04-18T03:41:55.954099+0000","last_undegraded":"2024-04-18T03:41:55.954099+0000","last_fullsized":"2024-04-18T03:41:55.954099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'57","last_scrub_stamp":"2024-04-18T03:41:55.954047+0000","last_deep_scrub":"27'57","last_deep_scrub_stamp":"2024-04-18T03:41:55.954047+0000","last_clean_scrub_stamp":"2024-04-18T03:41:55.954047+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:41.857136+0000","scrub_duration":0.0033617180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'20","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:49.701739+0000","last_change":"2024-04-18T03:41:49.701952+0000","last_active":"2024-04-18T03:41:49.701739+0000","last_peered":"2024-04-18T03:41:49.701739+0000","last_clean":"2024-04-18T03:41:49.701739+0000","last_became_active":"2024-04-18T03:37:33.918978+0000","last_became_peered":"2024-04-18T03:37:33.918978+0000","last_unstale":"2024-04-18T03:41:49.701739+0000","last_undegraded":"2024-04-18T03:41:49.701739+0000","last_fullsized":"2024-04-18T03:41:49.701739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-18T03:41:49.701682+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-18T03:41:49.701682+0000","last_clean_scrub_stamp":"2024-04-18T03:41:49.701682+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:09.246929+0000","scrub_duration":0.003833768,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.824286+0000","last_change":"2024-04-18T03:41:43.824582+0000","last_active":"2024-04-18T03:41:43.824286+0000","last_peered":"2024-04-18T03:41:43.824286+0000","last_clean":"2024-04-18T03:41:43.824286+0000","last_became_active":"2024-04-18T03:37:28.880722+0000","last_became_peered":"2024-04-18T03:37:28.880722+0000","last_unstale":"2024-04-18T03:41:43.824286+0000","last_undegraded":"2024-04-18T03:41:43.824286+0000","last_fullsized":"2024-04-18T03:41:43.824286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-18T03:41:43.824180+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-18T03:41:43.824180+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.824180+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:40.311196+0000","scrub_duration":0.010381431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'35","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:14.205182+0000","last_change":"2024-04-18T03:42:14.205589+0000","last_active":"2024-04-18T03:42:14.205182+0000","last_peered":"2024-04-18T03:42:14.205182+0000","last_clean":"2024-04-18T03:42:14.205182+0000","last_became_active":"2024-04-18T03:37:38.549436+0000","last_became_peered":"2024-04-18T03:37:38.549436+0000","last_unstale":"2024-04-18T03:42:14.205182+0000","last_undegraded":"2024-04-18T03:42:14.205182+0000","last_fullsized":"2024-04-18T03:42:14.205182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-18T03:42:14.205063+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-18T03:42:14.205063+0000","last_clean_scrub_stamp":"2024-04-18T03:42:14.205063+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:27:40.339536+0000","scrub_duration":0.0036838650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'46","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.934709+0000","last_change":"2024-04-18T03:41:37.934709+0000","last_active":"2024-04-18T03:41:37.934709+0000","last_peered":"2024-04-18T03:41:37.934709+0000","last_clean":"2024-04-18T03:41:37.934709+0000","last_became_active":"2024-04-18T03:37:34.307665+0000","last_became_peered":"2024-04-18T03:37:34.307665+0000","last_unstale":"2024-04-18T03:41:37.934709+0000","last_undegraded":"2024-04-18T03:41:37.934709+0000","last_fullsized":"2024-04-18T03:41:37.934709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-04-18T03:41:37.934439+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-04-18T03:41:37.934439+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.934439+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:20.593823+0000","scrub_duration":0.0033057120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'29","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.559893+0000","last_change":"2024-04-18T03:41:39.559893+0000","last_active":"2024-04-18T03:41:39.559893+0000","last_peered":"2024-04-18T03:41:39.559893+0000","last_clean":"2024-04-18T03:41:39.559893+0000","last_became_active":"2024-04-18T03:37:33.922453+0000","last_became_peered":"2024-04-18T03:37:33.922453+0000","last_unstale":"2024-04-18T03:41:39.559893+0000","last_undegraded":"2024-04-18T03:41:39.559893+0000","last_fullsized":"2024-04-18T03:41:39.559893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-04-18T03:41:39.559453+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-04-18T03:41:39.559453+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.559453+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:02.058965+0000","scrub_duration":0.0039162629999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'34","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:11.161253+0000","last_change":"2024-04-18T03:42:11.161614+0000","last_active":"2024-04-18T03:42:11.161253+0000","last_peered":"2024-04-18T03:42:11.161253+0000","last_clean":"2024-04-18T03:42:11.161253+0000","last_became_active":"2024-04-18T03:37:38.549030+0000","last_became_peered":"2024-04-18T03:37:38.549030+0000","last_unstale":"2024-04-18T03:42:11.161253+0000","last_undegraded":"2024-04-18T03:42:11.161253+0000","last_fullsized":"2024-04-18T03:42:11.161253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-18T03:42:11.161195+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-18T03:42:11.161195+0000","last_clean_scrub_stamp":"2024-04-18T03:42:11.161195+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:53:29.538137+0000","scrub_duration":0.0038419629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.774727+0000","last_change":"2024-04-18T03:41:36.774727+0000","last_active":"2024-04-18T03:41:36.774727+0000","last_peered":"2024-04-18T03:41:36.774727+0000","last_clean":"2024-04-18T03:41:36.774727+0000","last_became_active":"2024-04-18T03:37:34.299801+0000","last_became_peered":"2024-04-18T03:37:34.299801+0000","last_unstale":"2024-04-18T03:41:36.774727+0000","last_undegraded":"2024-04-18T03:41:36.774727+0000","last_fullsized":"2024-04-18T03:41:36.774727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:36.774472+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:36.774472+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.774472+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:26:19.433856+0000","scrub_duration":0.0033108389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'25","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.076855+0000","last_change":"2024-04-18T03:41:36.076855+0000","last_active":"2024-04-18T03:41:36.076855+0000","last_peered":"2024-04-18T03:41:36.076855+0000","last_clean":"2024-04-18T03:41:36.076855+0000","last_became_active":"2024-04-18T03:37:33.915951+0000","last_became_peered":"2024-04-18T03:37:33.915951+0000","last_unstale":"2024-04-18T03:41:36.076855+0000","last_undegraded":"2024-04-18T03:41:36.076855+0000","last_fullsized":"2024-04-18T03:41:36.076855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-18T03:41:36.076533+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-18T03:41:36.076533+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.076533+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:32.739299+0000","scrub_duration":0.0067638259999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'55","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:05.283108+0000","last_change":"2024-04-18T03:42:05.283108+0000","last_active":"2024-04-18T03:42:05.283108+0000","last_peered":"2024-04-18T03:42:05.283108+0000","last_clean":"2024-04-18T03:42:05.283108+0000","last_became_active":"2024-04-18T03:38:23.706819+0000","last_became_peered":"2024-04-18T03:38:23.706819+0000","last_unstale":"2024-04-18T03:42:05.283108+0000","last_undegraded":"2024-04-18T03:42:05.283108+0000","last_fullsized":"2024-04-18T03:42:05.283108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:05.282603+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:05.282603+0000","last_clean_scrub_stamp":"2024-04-18T03:42:05.282603+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:27:31.417077+0000","scrub_duration":0.004194677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'47","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:12.727890+0000","last_change":"2024-04-18T03:42:12.728140+0000","last_active":"2024-04-18T03:42:12.727890+0000","last_peered":"2024-04-18T03:42:12.727890+0000","last_clean":"2024-04-18T03:42:12.727890+0000","last_became_active":"2024-04-18T03:37:34.309568+0000","last_became_peered":"2024-04-18T03:37:34.309568+0000","last_unstale":"2024-04-18T03:42:12.727890+0000","last_undegraded":"2024-04-18T03:42:12.727890+0000","last_fullsized":"2024-04-18T03:42:12.727890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-04-18T03:42:12.727836+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-04-18T03:42:12.727836+0000","last_clean_scrub_stamp":"2024-04-18T03:42:12.727836+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:24:32.616557+0000","scrub_duration":0.002874471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'21","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.457680+0000","last_change":"2024-04-18T03:41:36.457680+0000","last_active":"2024-04-18T03:41:36.457680+0000","last_peered":"2024-04-18T03:41:36.457680+0000","last_clean":"2024-04-18T03:41:36.457680+0000","last_became_active":"2024-04-18T03:37:33.923488+0000","last_became_peered":"2024-04-18T03:37:33.923488+0000","last_unstale":"2024-04-18T03:41:36.457680+0000","last_undegraded":"2024-04-18T03:41:36.457680+0000","last_fullsized":"2024-04-18T03:41:36.457680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-04-18T03:41:36.457421+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-04-18T03:41:36.457421+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.457421+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:52:05.152177+0000","scrub_duration":0.0051244159999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'50","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:19.835646+0000","last_change":"2024-04-18T03:42:19.835906+0000","last_active":"2024-04-18T03:42:19.835646+0000","last_peered":"2024-04-18T03:42:19.835646+0000","last_clean":"2024-04-18T03:42:19.835646+0000","last_became_active":"2024-04-18T03:37:38.552633+0000","last_became_peered":"2024-04-18T03:37:38.552633+0000","last_unstale":"2024-04-18T03:42:19.835646+0000","last_undegraded":"2024-04-18T03:42:19.835646+0000","last_fullsized":"2024-04-18T03:42:19.835646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:42:19.835588+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:42:19.835588+0000","last_clean_scrub_stamp":"2024-04-18T03:42:19.835588+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:31:07.420635+0000","scrub_duration":0.0032693150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'39","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:21.866708+0000","last_change":"2024-04-18T03:42:21.866844+0000","last_active":"2024-04-18T03:42:21.866708+0000","last_peered":"2024-04-18T03:42:21.866708+0000","last_clean":"2024-04-18T03:42:21.866708+0000","last_became_active":"2024-04-18T03:37:34.298904+0000","last_became_peered":"2024-04-18T03:37:34.298904+0000","last_unstale":"2024-04-18T03:42:21.866708+0000","last_undegraded":"2024-04-18T03:42:21.866708+0000","last_fullsized":"2024-04-18T03:42:21.866708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-18T03:42:21.866676+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-18T03:42:21.866676+0000","last_clean_scrub_stamp":"2024-04-18T03:42:21.866676+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:16.953183+0000","scrub_duration":0.0023704960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'24","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.839576+0000","last_change":"2024-04-18T03:41:34.839576+0000","last_active":"2024-04-18T03:41:34.839576+0000","last_peered":"2024-04-18T03:41:34.839576+0000","last_clean":"2024-04-18T03:41:34.839576+0000","last_became_active":"2024-04-18T03:37:33.921552+0000","last_became_peered":"2024-04-18T03:37:33.921552+0000","last_unstale":"2024-04-18T03:41:34.839576+0000","last_undegraded":"2024-04-18T03:41:34.839576+0000","last_fullsized":"2024-04-18T03:41:34.839576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:34.839312+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:34.839312+0000","last_clean_scrub_stamp":"2024-04-18T03:41:34.839312+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:25.350116+0000","scrub_duration":0.0055495320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'47","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:15.759990+0000","last_change":"2024-04-18T03:42:15.760270+0000","last_active":"2024-04-18T03:42:15.759990+0000","last_peered":"2024-04-18T03:42:15.759990+0000","last_clean":"2024-04-18T03:42:15.759990+0000","last_became_active":"2024-04-18T03:37:38.328474+0000","last_became_peered":"2024-04-18T03:37:38.328474+0000","last_unstale":"2024-04-18T03:42:15.759990+0000","last_undegraded":"2024-04-18T03:42:15.759990+0000","last_fullsized":"2024-04-18T03:42:15.759990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-04-18T03:42:15.759932+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-04-18T03:42:15.759932+0000","last_clean_scrub_stamp":"2024-04-18T03:42:15.759932+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:27:41.894405+0000","scrub_duration":0.0036360799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'47","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.930160+0000","last_change":"2024-04-18T03:41:38.930160+0000","last_active":"2024-04-18T03:41:38.930160+0000","last_peered":"2024-04-18T03:41:38.930160+0000","last_clean":"2024-04-18T03:41:38.930160+0000","last_became_active":"2024-04-18T03:37:34.303808+0000","last_became_peered":"2024-04-18T03:37:34.303808+0000","last_unstale":"2024-04-18T03:41:38.930160+0000","last_undegraded":"2024-04-18T03:41:38.930160+0000","last_fullsized":"2024-04-18T03:41:38.930160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-04-18T03:41:38.929757+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-04-18T03:41:38.929757+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.929757+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:01.429268+0000","scrub_duration":0.0032590219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'37","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:34.464926+0000","last_change":"2024-04-18T03:41:34.464926+0000","last_active":"2024-04-18T03:41:34.464926+0000","last_peered":"2024-04-18T03:41:34.464926+0000","last_clean":"2024-04-18T03:41:34.464926+0000","last_became_active":"2024-04-18T03:37:33.915669+0000","last_became_peered":"2024-04-18T03:37:33.915669+0000","last_unstale":"2024-04-18T03:41:34.464926+0000","last_undegraded":"2024-04-18T03:41:34.464926+0000","last_fullsized":"2024-04-18T03:41:34.464926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-18T03:41:34.464734+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-18T03:41:34.464734+0000","last_clean_scrub_stamp":"2024-04-18T03:41:34.464734+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:28.772334+0000","scrub_duration":0.00658305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'54","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:18.187054+0000","last_change":"2024-04-18T03:42:18.187054+0000","last_active":"2024-04-18T03:42:18.187054+0000","last_peered":"2024-04-18T03:42:18.187054+0000","last_clean":"2024-04-18T03:42:18.187054+0000","last_became_active":"2024-04-18T03:37:38.325202+0000","last_became_peered":"2024-04-18T03:37:38.325202+0000","last_unstale":"2024-04-18T03:42:18.187054+0000","last_undegraded":"2024-04-18T03:42:18.187054+0000","last_fullsized":"2024-04-18T03:42:18.187054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-18T03:42:18.186699+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-18T03:42:18.186699+0000","last_clean_scrub_stamp":"2024-04-18T03:42:18.186699+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:11:09.630426+0000","scrub_duration":0.0038372839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:57.194006+0000","last_change":"2024-04-18T03:41:57.194006+0000","last_active":"2024-04-18T03:41:57.194006+0000","last_peered":"2024-04-18T03:41:57.194006+0000","last_clean":"2024-04-18T03:41:57.194006+0000","last_became_active":"2024-04-18T03:37:34.302466+0000","last_became_peered":"2024-04-18T03:37:34.302466+0000","last_unstale":"2024-04-18T03:41:57.194006+0000","last_undegraded":"2024-04-18T03:41:57.194006+0000","last_fullsized":"2024-04-18T03:41:57.194006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:41:57.193694+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:41:57.193694+0000","last_clean_scrub_stamp":"2024-04-18T03:41:57.193694+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:48.448968+0000","scrub_duration":0.0035468969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'30","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.389380+0000","last_change":"2024-04-18T03:41:38.389380+0000","last_active":"2024-04-18T03:41:38.389380+0000","last_peered":"2024-04-18T03:41:38.389380+0000","last_clean":"2024-04-18T03:41:38.389380+0000","last_became_active":"2024-04-18T03:37:33.929619+0000","last_became_peered":"2024-04-18T03:37:33.929619+0000","last_unstale":"2024-04-18T03:41:38.389380+0000","last_undegraded":"2024-04-18T03:41:38.389380+0000","last_fullsized":"2024-04-18T03:41:38.389380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-04-18T03:41:38.389114+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-04-18T03:41:38.389114+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.389114+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:35.051880+0000","scrub_duration":0.002866005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'43","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:12.775777+0000","last_change":"2024-04-18T03:42:12.775777+0000","last_active":"2024-04-18T03:42:12.775777+0000","last_peered":"2024-04-18T03:42:12.775777+0000","last_clean":"2024-04-18T03:42:12.775777+0000","last_became_active":"2024-04-18T03:37:38.554650+0000","last_became_peered":"2024-04-18T03:37:38.554650+0000","last_unstale":"2024-04-18T03:42:12.775777+0000","last_undegraded":"2024-04-18T03:42:12.775777+0000","last_fullsized":"2024-04-18T03:42:12.775777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:12.775418+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:12.775418+0000","last_clean_scrub_stamp":"2024-04-18T03:42:12.775418+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:07.935179+0000","scrub_duration":0.0034385190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'63","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:14.767987+0000","last_change":"2024-04-18T03:42:14.767987+0000","last_active":"2024-04-18T03:42:14.767987+0000","last_peered":"2024-04-18T03:42:14.767987+0000","last_clean":"2024-04-18T03:42:14.767987+0000","last_became_active":"2024-04-18T03:37:34.308667+0000","last_became_peered":"2024-04-18T03:37:34.308667+0000","last_unstale":"2024-04-18T03:42:14.767987+0000","last_undegraded":"2024-04-18T03:42:14.767987+0000","last_fullsized":"2024-04-18T03:42:14.767987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2024-04-18T03:42:14.767590+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2024-04-18T03:42:14.767590+0000","last_clean_scrub_stamp":"2024-04-18T03:42:14.767590+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:10:16.375970+0000","scrub_duration":0.0037721579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'35","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:53.717823+0000","last_change":"2024-04-18T03:41:53.717823+0000","last_active":"2024-04-18T03:41:53.717823+0000","last_peered":"2024-04-18T03:41:53.717823+0000","last_clean":"2024-04-18T03:41:53.717823+0000","last_became_active":"2024-04-18T03:37:33.925749+0000","last_became_peered":"2024-04-18T03:37:33.925749+0000","last_unstale":"2024-04-18T03:41:53.717823+0000","last_undegraded":"2024-04-18T03:41:53.717823+0000","last_fullsized":"2024-04-18T03:41:53.717823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-04-18T03:41:53.717555+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-04-18T03:41:53.717555+0000","last_clean_scrub_stamp":"2024-04-18T03:41:53.717555+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:54:24.418727+0000","scrub_duration":0.003742118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'34","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:14.746822+0000","last_change":"2024-04-18T03:42:14.746822+0000","last_active":"2024-04-18T03:42:14.746822+0000","last_peered":"2024-04-18T03:42:14.746822+0000","last_clean":"2024-04-18T03:42:14.746822+0000","last_became_active":"2024-04-18T03:37:38.549226+0000","last_became_peered":"2024-04-18T03:37:38.549226+0000","last_unstale":"2024-04-18T03:42:14.746822+0000","last_undegraded":"2024-04-18T03:42:14.746822+0000","last_fullsized":"2024-04-18T03:42:14.746822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-04-18T03:42:14.746436+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-04-18T03:42:14.746436+0000","last_clean_scrub_stamp":"2024-04-18T03:42:14.746436+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:50:00.000190+0000","scrub_duration":0.004318863,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:53.174696+0000","last_change":"2024-04-18T03:41:53.174696+0000","last_active":"2024-04-18T03:41:53.174696+0000","last_peered":"2024-04-18T03:41:53.174696+0000","last_clean":"2024-04-18T03:41:53.174696+0000","last_became_active":"2024-04-18T03:37:34.298206+0000","last_became_peered":"2024-04-18T03:37:34.298206+0000","last_unstale":"2024-04-18T03:41:53.174696+0000","last_undegraded":"2024-04-18T03:41:53.174696+0000","last_fullsized":"2024-04-18T03:41:53.174696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:53.174233+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:53.174233+0000","last_clean_scrub_stamp":"2024-04-18T03:41:53.174233+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:03:38.017445+0000","scrub_duration":0.0037237210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'19","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.120215+0000","last_change":"2024-04-18T03:41:35.120215+0000","last_active":"2024-04-18T03:41:35.120215+0000","last_peered":"2024-04-18T03:41:35.120215+0000","last_clean":"2024-04-18T03:41:35.120215+0000","last_became_active":"2024-04-18T03:37:33.927081+0000","last_became_peered":"2024-04-18T03:37:33.927081+0000","last_unstale":"2024-04-18T03:41:35.120215+0000","last_undegraded":"2024-04-18T03:41:35.120215+0000","last_fullsized":"2024-04-18T03:41:35.120215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-18T03:41:35.119916+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-18T03:41:35.119916+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.119916+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:36.559004+0000","scrub_duration":0.0067098039999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'38","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:21.797067+0000","last_change":"2024-04-18T03:42:21.797067+0000","last_active":"2024-04-18T03:42:21.797067+0000","last_peered":"2024-04-18T03:42:21.797067+0000","last_clean":"2024-04-18T03:42:21.797067+0000","last_became_active":"2024-04-18T03:37:38.546964+0000","last_became_peered":"2024-04-18T03:37:38.546964+0000","last_unstale":"2024-04-18T03:42:21.797067+0000","last_undegraded":"2024-04-18T03:42:21.797067+0000","last_fullsized":"2024-04-18T03:42:21.797067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-04-18T03:42:21.796736+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-04-18T03:42:21.796736+0000","last_clean_scrub_stamp":"2024-04-18T03:42:21.796736+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:20.801258+0000","scrub_duration":0.0046345580000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.655517+0000","last_change":"2024-04-18T03:42:09.655517+0000","last_active":"2024-04-18T03:42:09.655517+0000","last_peered":"2024-04-18T03:42:09.655517+0000","last_clean":"2024-04-18T03:42:09.655517+0000","last_became_active":"2024-04-18T03:37:34.297425+0000","last_became_peered":"2024-04-18T03:37:34.297425+0000","last_unstale":"2024-04-18T03:42:09.655517+0000","last_undegraded":"2024-04-18T03:42:09.655517+0000","last_fullsized":"2024-04-18T03:42:09.655517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:09.655277+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:09.655277+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.655277+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:40.862383+0000","scrub_duration":0.0033977109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'912","reported_seq":943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.377560+0000","last_change":"2024-04-18T03:41:36.377560+0000","last_active":"2024-04-18T03:41:36.377560+0000","last_peered":"2024-04-18T03:41:36.377560+0000","last_clean":"2024-04-18T03:41:36.377560+0000","last_became_active":"2024-04-18T03:37:33.929636+0000","last_became_peered":"2024-04-18T03:37:33.929636+0000","last_unstale":"2024-04-18T03:41:36.377560+0000","last_undegraded":"2024-04-18T03:41:36.377560+0000","last_fullsized":"2024-04-18T03:41:36.377560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'912","last_scrub_stamp":"2024-04-18T03:41:36.377398+0000","last_deep_scrub":"27'912","last_deep_scrub_stamp":"2024-04-18T03:41:36.377398+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.377398+0000","objects_scrubbed":4,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:33:56.129888+0000","scrub_duration":0.019987532999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'43","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:08.039687+0000","last_change":"2024-04-18T03:42:08.039687+0000","last_active":"2024-04-18T03:42:08.039687+0000","last_peered":"2024-04-18T03:42:08.039687+0000","last_clean":"2024-04-18T03:42:08.039687+0000","last_became_active":"2024-04-18T03:37:38.335776+0000","last_became_peered":"2024-04-18T03:37:38.335776+0000","last_unstale":"2024-04-18T03:42:08.039687+0000","last_undegraded":"2024-04-18T03:42:08.039687+0000","last_fullsized":"2024-04-18T03:42:08.039687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:08.039308+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:08.039308+0000","last_clean_scrub_stamp":"2024-04-18T03:42:08.039308+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:37.783643+0000","scrub_duration":0.0037840830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.795901+0000","last_change":"2024-04-18T03:41:37.795901+0000","last_active":"2024-04-18T03:41:37.795901+0000","last_peered":"2024-04-18T03:41:37.795901+0000","last_clean":"2024-04-18T03:41:37.795901+0000","last_became_active":"2024-04-18T03:37:34.298928+0000","last_became_peered":"2024-04-18T03:37:34.298928+0000","last_unstale":"2024-04-18T03:41:37.795901+0000","last_undegraded":"2024-04-18T03:41:37.795901+0000","last_fullsized":"2024-04-18T03:41:37.795901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:41:37.795629+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:41:37.795629+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.795629+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:24:34.458395+0000","scrub_duration":0.0033140940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'50","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:56.042183+0000","last_change":"2024-04-18T03:41:56.042183+0000","last_active":"2024-04-18T03:41:56.042183+0000","last_peered":"2024-04-18T03:41:56.042183+0000","last_clean":"2024-04-18T03:41:56.042183+0000","last_became_active":"2024-04-18T03:37:33.923108+0000","last_became_peered":"2024-04-18T03:37:33.923108+0000","last_unstale":"2024-04-18T03:41:56.042183+0000","last_undegraded":"2024-04-18T03:41:56.042183+0000","last_fullsized":"2024-04-18T03:41:56.042183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:56.041839+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:56.041839+0000","last_clean_scrub_stamp":"2024-04-18T03:41:56.041839+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:47.297113+0000","scrub_duration":0.0076736870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'45","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:13.748286+0000","last_change":"2024-04-18T03:42:13.748286+0000","last_active":"2024-04-18T03:42:13.748286+0000","last_peered":"2024-04-18T03:42:13.748286+0000","last_clean":"2024-04-18T03:42:13.748286+0000","last_became_active":"2024-04-18T03:37:38.328135+0000","last_became_peered":"2024-04-18T03:37:38.328135+0000","last_unstale":"2024-04-18T03:42:13.748286+0000","last_undegraded":"2024-04-18T03:42:13.748286+0000","last_fullsized":"2024-04-18T03:42:13.748286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-04-18T03:42:13.747886+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-04-18T03:42:13.747886+0000","last_clean_scrub_stamp":"2024-04-18T03:42:13.747886+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:43.492222+0000","scrub_duration":0.0037208609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:59.080090+0000","last_change":"2024-04-18T03:41:59.080090+0000","last_active":"2024-04-18T03:41:59.080090+0000","last_peered":"2024-04-18T03:41:59.080090+0000","last_clean":"2024-04-18T03:41:59.080090+0000","last_became_active":"2024-04-18T03:37:34.301576+0000","last_became_peered":"2024-04-18T03:37:34.301576+0000","last_unstale":"2024-04-18T03:41:59.080090+0000","last_undegraded":"2024-04-18T03:41:59.080090+0000","last_fullsized":"2024-04-18T03:41:59.080090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:59.079799+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:59.079799+0000","last_clean_scrub_stamp":"2024-04-18T03:41:59.079799+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:34.822148+0000","scrub_duration":0.0036329330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'24","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.804588+0000","last_change":"2024-04-18T03:41:41.804588+0000","last_active":"2024-04-18T03:41:41.804588+0000","last_peered":"2024-04-18T03:41:41.804588+0000","last_clean":"2024-04-18T03:41:41.804588+0000","last_became_active":"2024-04-18T03:37:33.930929+0000","last_became_peered":"2024-04-18T03:37:33.930929+0000","last_unstale":"2024-04-18T03:41:41.804588+0000","last_undegraded":"2024-04-18T03:41:41.804588+0000","last_fullsized":"2024-04-18T03:41:41.804588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-04-18T03:41:41.804273+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-04-18T03:41:41.804273+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.804273+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:43.233719+0000","scrub_duration":0.0031319410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'39","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:08.844769+0000","last_change":"2024-04-18T03:42:08.844769+0000","last_active":"2024-04-18T03:42:08.844769+0000","last_peered":"2024-04-18T03:42:08.844769+0000","last_clean":"2024-04-18T03:42:08.844769+0000","last_became_active":"2024-04-18T03:37:38.333748+0000","last_became_peered":"2024-04-18T03:37:38.333748+0000","last_unstale":"2024-04-18T03:42:08.844769+0000","last_undegraded":"2024-04-18T03:42:08.844769+0000","last_fullsized":"2024-04-18T03:42:08.844769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-04-18T03:42:08.844465+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-04-18T03:42:08.844465+0000","last_clean_scrub_stamp":"2024-04-18T03:42:08.844465+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:04:03.930972+0000","scrub_duration":0.0034845290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'73","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:54.759303+0000","last_change":"2024-04-18T03:41:54.759303+0000","last_active":"2024-04-18T03:41:54.759303+0000","last_peered":"2024-04-18T03:41:54.759303+0000","last_clean":"2024-04-18T03:41:54.759303+0000","last_became_active":"2024-04-18T03:37:34.305200+0000","last_became_peered":"2024-04-18T03:37:34.305200+0000","last_unstale":"2024-04-18T03:41:54.759303+0000","last_undegraded":"2024-04-18T03:41:54.759303+0000","last_fullsized":"2024-04-18T03:41:54.759303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'73","last_scrub_stamp":"2024-04-18T03:41:54.759062+0000","last_deep_scrub":"27'73","last_deep_scrub_stamp":"2024-04-18T03:41:54.759062+0000","last_clean_scrub_stamp":"2024-04-18T03:41:54.759062+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:11:55.038029+0000","scrub_duration":0.0030487069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'23","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:55.168769+0000","last_change":"2024-04-18T03:41:55.168769+0000","last_active":"2024-04-18T03:41:55.168769+0000","last_peered":"2024-04-18T03:41:55.168769+0000","last_clean":"2024-04-18T03:41:55.168769+0000","last_became_active":"2024-04-18T03:37:33.930136+0000","last_became_peered":"2024-04-18T03:37:33.930136+0000","last_unstale":"2024-04-18T03:41:55.168769+0000","last_undegraded":"2024-04-18T03:41:55.168769+0000","last_fullsized":"2024-04-18T03:41:55.168769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-04-18T03:41:55.168517+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-04-18T03:41:55.168517+0000","last_clean_scrub_stamp":"2024-04-18T03:41:55.168517+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:45:00.966145+0000","scrub_duration":0.0029569890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'42","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:07.834452+0000","last_change":"2024-04-18T03:42:07.834452+0000","last_active":"2024-04-18T03:42:07.834452+0000","last_peered":"2024-04-18T03:42:07.834452+0000","last_clean":"2024-04-18T03:42:07.834452+0000","last_became_active":"2024-04-18T03:37:38.557396+0000","last_became_peered":"2024-04-18T03:37:38.557396+0000","last_unstale":"2024-04-18T03:42:07.834452+0000","last_undegraded":"2024-04-18T03:42:07.834452+0000","last_fullsized":"2024-04-18T03:42:07.834452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:42:07.833893+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:42:07.833893+0000","last_clean_scrub_stamp":"2024-04-18T03:42:07.833893+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:06.838416+0000","scrub_duration":0.0038990800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'43","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:19.148107+0000","last_change":"2024-04-18T03:42:19.148352+0000","last_active":"2024-04-18T03:42:19.148107+0000","last_peered":"2024-04-18T03:42:19.148107+0000","last_clean":"2024-04-18T03:42:19.148107+0000","last_became_active":"2024-04-18T03:37:38.555743+0000","last_became_peered":"2024-04-18T03:37:38.555743+0000","last_unstale":"2024-04-18T03:42:19.148107+0000","last_undegraded":"2024-04-18T03:42:19.148107+0000","last_fullsized":"2024-04-18T03:42:19.148107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:42:19.148055+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:42:19.148055+0000","last_clean_scrub_stamp":"2024-04-18T03:42:19.148055+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:35:40.336098+0000","scrub_duration":0.0037260629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'54","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.076501+0000","last_change":"2024-04-18T03:42:02.076501+0000","last_active":"2024-04-18T03:42:02.076501+0000","last_peered":"2024-04-18T03:42:02.076501+0000","last_clean":"2024-04-18T03:42:02.076501+0000","last_became_active":"2024-04-18T03:37:34.298182+0000","last_became_peered":"2024-04-18T03:37:34.298182+0000","last_unstale":"2024-04-18T03:42:02.076501+0000","last_undegraded":"2024-04-18T03:42:02.076501+0000","last_fullsized":"2024-04-18T03:42:02.076501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-18T03:42:02.076086+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-18T03:42:02.076086+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.076086+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:42:28.496274+0000","scrub_duration":0.0031972139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'20","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:37.774141+0000","last_change":"2024-04-18T03:41:37.774141+0000","last_active":"2024-04-18T03:41:37.774141+0000","last_peered":"2024-04-18T03:41:37.774141+0000","last_clean":"2024-04-18T03:41:37.774141+0000","last_became_active":"2024-04-18T03:37:33.923726+0000","last_became_peered":"2024-04-18T03:37:33.923726+0000","last_unstale":"2024-04-18T03:41:37.774141+0000","last_undegraded":"2024-04-18T03:41:37.774141+0000","last_fullsized":"2024-04-18T03:41:37.774141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-04-18T03:41:37.773836+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-04-18T03:41:37.773836+0000","last_clean_scrub_stamp":"2024-04-18T03:41:37.773836+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:23:00.273347+0000","scrub_duration":0.0031860970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'50","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:12.184910+0000","last_change":"2024-04-18T03:42:12.185148+0000","last_active":"2024-04-18T03:42:12.184910+0000","last_peered":"2024-04-18T03:42:12.184910+0000","last_clean":"2024-04-18T03:42:12.184910+0000","last_became_active":"2024-04-18T03:38:23.707524+0000","last_became_peered":"2024-04-18T03:38:23.707524+0000","last_unstale":"2024-04-18T03:42:12.184910+0000","last_undegraded":"2024-04-18T03:42:12.184910+0000","last_fullsized":"2024-04-18T03:42:12.184910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:42:12.184847+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:42:12.184847+0000","last_clean_scrub_stamp":"2024-04-18T03:42:12.184847+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:41.929183+0000","scrub_duration":0.0038614320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'65","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.942288+0000","last_change":"2024-04-18T03:42:02.942288+0000","last_active":"2024-04-18T03:42:02.942288+0000","last_peered":"2024-04-18T03:42:02.942288+0000","last_clean":"2024-04-18T03:42:02.942288+0000","last_became_active":"2024-04-18T03:37:34.309897+0000","last_became_peered":"2024-04-18T03:37:34.309897+0000","last_unstale":"2024-04-18T03:42:02.942288+0000","last_undegraded":"2024-04-18T03:42:02.942288+0000","last_fullsized":"2024-04-18T03:42:02.942288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2024-04-18T03:42:02.942017+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2024-04-18T03:42:02.942017+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.942017+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:13:58.923916+0000","scrub_duration":0.0030766470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'19","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.981853+0000","last_change":"2024-04-18T03:41:50.981853+0000","last_active":"2024-04-18T03:41:50.981853+0000","last_peered":"2024-04-18T03:41:50.981853+0000","last_clean":"2024-04-18T03:41:50.981853+0000","last_became_active":"2024-04-18T03:37:33.932130+0000","last_became_peered":"2024-04-18T03:37:33.932130+0000","last_unstale":"2024-04-18T03:41:50.981853+0000","last_undegraded":"2024-04-18T03:41:50.981853+0000","last_fullsized":"2024-04-18T03:41:50.981853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-18T03:41:50.981601+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-18T03:41:50.981601+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.981601+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:26.735105+0000","scrub_duration":0.0030809969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'43","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.363413+0000","last_change":"2024-04-18T03:41:41.363413+0000","last_active":"2024-04-18T03:41:41.363413+0000","last_peered":"2024-04-18T03:41:41.363413+0000","last_clean":"2024-04-18T03:41:41.363413+0000","last_became_active":"2024-04-18T03:37:33.929412+0000","last_became_peered":"2024-04-18T03:37:33.929412+0000","last_unstale":"2024-04-18T03:41:41.363413+0000","last_undegraded":"2024-04-18T03:41:41.363413+0000","last_fullsized":"2024-04-18T03:41:41.363413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:41.363263+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:41.363263+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.363263+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:57.623994+0000","scrub_duration":0.015753157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:52.178745+0000","last_change":"2024-04-18T03:41:52.178932+0000","last_active":"2024-04-18T03:41:52.178745+0000","last_peered":"2024-04-18T03:41:52.178745+0000","last_clean":"2024-04-18T03:41:52.178745+0000","last_became_active":"2024-04-18T03:37:34.306302+0000","last_became_peered":"2024-04-18T03:37:34.306302+0000","last_unstale":"2024-04-18T03:41:52.178745+0000","last_undegraded":"2024-04-18T03:41:52.178745+0000","last_fullsized":"2024-04-18T03:41:52.178745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:41:52.178693+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:41:52.178693+0000","last_clean_scrub_stamp":"2024-04-18T03:41:52.178693+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:24.633857+0000","scrub_duration":0.0034843679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'36","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:50.485713+0000","last_change":"2024-04-18T03:41:50.486008+0000","last_active":"2024-04-18T03:41:50.485713+0000","last_peered":"2024-04-18T03:41:50.485713+0000","last_clean":"2024-04-18T03:41:50.485713+0000","last_became_active":"2024-04-18T03:37:38.336274+0000","last_became_peered":"2024-04-18T03:37:38.336274+0000","last_unstale":"2024-04-18T03:41:50.485713+0000","last_undegraded":"2024-04-18T03:41:50.485713+0000","last_fullsized":"2024-04-18T03:41:50.485713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-04-18T03:41:50.485653+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-04-18T03:41:50.485653+0000","last_clean_scrub_stamp":"2024-04-18T03:41:50.485653+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:21:10.030901+0000","scrub_duration":0.0037180400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'1516","reported_seq":1546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:48.945074+0000","last_change":"2024-04-18T03:41:48.945260+0000","last_active":"2024-04-18T03:41:48.945074+0000","last_peered":"2024-04-18T03:41:48.945074+0000","last_clean":"2024-04-18T03:41:48.945074+0000","last_became_active":"2024-04-18T03:37:33.922882+0000","last_became_peered":"2024-04-18T03:37:33.922882+0000","last_unstale":"2024-04-18T03:41:48.945074+0000","last_undegraded":"2024-04-18T03:41:48.945074+0000","last_fullsized":"2024-04-18T03:41:48.945074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1516","last_scrub_stamp":"2024-04-18T03:41:48.945028+0000","last_deep_scrub":"27'1516","last_deep_scrub_stamp":"2024-04-18T03:41:48.945028+0000","last_clean_scrub_stamp":"2024-04-18T03:41:48.945028+0000","objects_scrubbed":1,"log_size":1516,"log_dups_size":0,"ondisk_log_size":1516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:32.113215+0000","scrub_duration":0.02246687,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1489,"num_write_kb":4584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'44","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:36.811359+0000","last_change":"2024-04-18T03:41:36.811567+0000","last_active":"2024-04-18T03:41:36.811359+0000","last_peered":"2024-04-18T03:41:36.811359+0000","last_clean":"2024-04-18T03:41:36.811359+0000","last_became_active":"2024-04-18T03:37:34.288559+0000","last_became_peered":"2024-04-18T03:37:34.288559+0000","last_unstale":"2024-04-18T03:41:36.811359+0000","last_undegraded":"2024-04-18T03:41:36.811359+0000","last_fullsized":"2024-04-18T03:41:36.811359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:36.811310+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:36.811310+0000","last_clean_scrub_stamp":"2024-04-18T03:41:36.811310+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:21:31.448768+0000","scrub_duration":0.0032001960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'55","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:23.717142+0000","last_change":"2024-04-18T03:42:23.717463+0000","last_active":"2024-04-18T03:42:23.717142+0000","last_peered":"2024-04-18T03:42:23.717142+0000","last_clean":"2024-04-18T03:42:23.717142+0000","last_became_active":"2024-04-18T03:37:38.336158+0000","last_became_peered":"2024-04-18T03:37:38.336158+0000","last_unstale":"2024-04-18T03:42:23.717142+0000","last_undegraded":"2024-04-18T03:42:23.717142+0000","last_fullsized":"2024-04-18T03:42:23.717142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:23.717090+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:23.717090+0000","last_clean_scrub_stamp":"2024-04-18T03:42:23.717090+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:59:17.499338+0000","scrub_duration":0.0040146230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'69","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:06.206422+0000","last_change":"2024-04-18T03:42:06.206612+0000","last_active":"2024-04-18T03:42:06.206422+0000","last_peered":"2024-04-18T03:42:06.206422+0000","last_clean":"2024-04-18T03:42:06.206422+0000","last_became_active":"2024-04-18T03:37:34.302819+0000","last_became_peered":"2024-04-18T03:37:34.302819+0000","last_unstale":"2024-04-18T03:42:06.206422+0000","last_undegraded":"2024-04-18T03:42:06.206422+0000","last_fullsized":"2024-04-18T03:42:06.206422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'69","last_scrub_stamp":"2024-04-18T03:42:06.206365+0000","last_deep_scrub":"27'69","last_deep_scrub_stamp":"2024-04-18T03:42:06.206365+0000","last_clean_scrub_stamp":"2024-04-18T03:42:06.206365+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:46:30.788566+0000","scrub_duration":0.003256349,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'59","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:44.527159+0000","last_change":"2024-04-18T03:41:44.527159+0000","last_active":"2024-04-18T03:41:44.527159+0000","last_peered":"2024-04-18T03:41:44.527159+0000","last_clean":"2024-04-18T03:41:44.527159+0000","last_became_active":"2024-04-18T03:37:34.294765+0000","last_became_peered":"2024-04-18T03:37:34.294765+0000","last_unstale":"2024-04-18T03:41:44.527159+0000","last_undegraded":"2024-04-18T03:41:44.527159+0000","last_fullsized":"2024-04-18T03:41:44.527159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2024-04-18T03:41:44.526795+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2024-04-18T03:41:44.526795+0000","last_clean_scrub_stamp":"2024-04-18T03:41:44.526795+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:52.585213+0000","scrub_duration":0.0037446340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:15.774254+0000","last_change":"2024-04-18T03:42:15.774440+0000","last_active":"2024-04-18T03:42:15.774254+0000","last_peered":"2024-04-18T03:42:15.774254+0000","last_clean":"2024-04-18T03:42:15.774254+0000","last_became_active":"2024-04-18T03:37:34.304170+0000","last_became_peered":"2024-04-18T03:37:34.304170+0000","last_unstale":"2024-04-18T03:42:15.774254+0000","last_undegraded":"2024-04-18T03:42:15.774254+0000","last_fullsized":"2024-04-18T03:42:15.774254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:42:15.774203+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:42:15.774203+0000","last_clean_scrub_stamp":"2024-04-18T03:42:15.774203+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:10:17.382583+0000","scrub_duration":0.0031036879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'52","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.116526+0000","last_change":"2024-04-18T03:41:33.116526+0000","last_active":"2024-04-18T03:41:33.116526+0000","last_peered":"2024-04-18T03:41:33.116526+0000","last_clean":"2024-04-18T03:41:33.116526+0000","last_became_active":"2024-04-18T03:37:34.305317+0000","last_became_peered":"2024-04-18T03:37:34.305317+0000","last_unstale":"2024-04-18T03:41:33.116526+0000","last_undegraded":"2024-04-18T03:41:33.116526+0000","last_fullsized":"2024-04-18T03:41:33.116526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-04-18T03:41:33.116136+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-04-18T03:41:33.116136+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.116136+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:45.051099+0000","scrub_duration":0.003731814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:03.906474+0000","last_change":"2024-04-18T03:42:03.906675+0000","last_active":"2024-04-18T03:42:03.906474+0000","last_peered":"2024-04-18T03:42:03.906474+0000","last_clean":"2024-04-18T03:42:03.906474+0000","last_became_active":"2024-04-18T03:37:34.310208+0000","last_became_peered":"2024-04-18T03:37:34.310208+0000","last_unstale":"2024-04-18T03:42:03.906474+0000","last_undegraded":"2024-04-18T03:42:03.906474+0000","last_fullsized":"2024-04-18T03:42:03.906474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:42:03.906421+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:42:03.906421+0000","last_clean_scrub_stamp":"2024-04-18T03:42:03.906421+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:41.268305+0000","scrub_duration":0.0035130080000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'37","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:35.023421+0000","last_change":"2024-04-18T03:41:35.023421+0000","last_active":"2024-04-18T03:41:35.023421+0000","last_peered":"2024-04-18T03:41:35.023421+0000","last_clean":"2024-04-18T03:41:35.023421+0000","last_became_active":"2024-04-18T03:37:34.298170+0000","last_became_peered":"2024-04-18T03:37:34.298170+0000","last_unstale":"2024-04-18T03:41:35.023421+0000","last_undegraded":"2024-04-18T03:41:35.023421+0000","last_fullsized":"2024-04-18T03:41:35.023421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-04-18T03:41:35.023149+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-04-18T03:41:35.023149+0000","last_clean_scrub_stamp":"2024-04-18T03:41:35.023149+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T08:21:29.660608+0000","scrub_duration":0.002591814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'66","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:07.169587+0000","last_change":"2024-04-18T03:42:07.169902+0000","last_active":"2024-04-18T03:42:07.169587+0000","last_peered":"2024-04-18T03:42:07.169587+0000","last_clean":"2024-04-18T03:42:07.169587+0000","last_became_active":"2024-04-18T03:38:23.514633+0000","last_became_peered":"2024-04-18T03:38:23.514633+0000","last_unstale":"2024-04-18T03:42:07.169587+0000","last_undegraded":"2024-04-18T03:42:07.169587+0000","last_fullsized":"2024-04-18T03:42:07.169587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-04-18T03:42:07.169535+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-04-18T03:42:07.169535+0000","last_clean_scrub_stamp":"2024-04-18T03:42:07.169535+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:42.911884+0000","scrub_duration":0.003465311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'42","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.893909+0000","last_change":"2024-04-18T03:41:33.893909+0000","last_active":"2024-04-18T03:41:33.893909+0000","last_peered":"2024-04-18T03:41:33.893909+0000","last_clean":"2024-04-18T03:41:33.893909+0000","last_became_active":"2024-04-18T03:37:34.310070+0000","last_became_peered":"2024-04-18T03:37:34.310070+0000","last_unstale":"2024-04-18T03:41:33.893909+0000","last_undegraded":"2024-04-18T03:41:33.893909+0000","last_fullsized":"2024-04-18T03:41:33.893909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-04-18T03:41:33.893717+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-04-18T03:41:33.893717+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.893717+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:16:57.681786+0000","scrub_duration":0.0032070879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'49","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:00.862610+0000","last_change":"2024-04-18T03:42:00.862899+0000","last_active":"2024-04-18T03:42:00.862610+0000","last_peered":"2024-04-18T03:42:00.862610+0000","last_clean":"2024-04-18T03:42:00.862610+0000","last_became_active":"2024-04-18T03:37:34.296876+0000","last_became_peered":"2024-04-18T03:37:34.296876+0000","last_unstale":"2024-04-18T03:42:00.862610+0000","last_undegraded":"2024-04-18T03:42:00.862610+0000","last_fullsized":"2024-04-18T03:42:00.862610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2024-04-18T03:42:00.862559+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2024-04-18T03:42:00.862559+0000","last_clean_scrub_stamp":"2024-04-18T03:42:00.862559+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T09:38:44.030746+0000","scrub_duration":0.003493576,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:39.875077+0000","last_change":"2024-04-18T03:41:39.875077+0000","last_active":"2024-04-18T03:41:39.875077+0000","last_peered":"2024-04-18T03:41:39.875077+0000","last_clean":"2024-04-18T03:41:39.875077+0000","last_became_active":"2024-04-18T03:37:34.309967+0000","last_became_peered":"2024-04-18T03:37:34.309967+0000","last_unstale":"2024-04-18T03:41:39.875077+0000","last_undegraded":"2024-04-18T03:41:39.875077+0000","last_fullsized":"2024-04-18T03:41:39.875077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:39.874768+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:39.874768+0000","last_clean_scrub_stamp":"2024-04-18T03:41:39.874768+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:28.114792+0000","scrub_duration":0.0035169509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'58","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:51.449204+0000","last_change":"2024-04-18T03:41:51.449409+0000","last_active":"2024-04-18T03:41:51.449204+0000","last_peered":"2024-04-18T03:41:51.449204+0000","last_clean":"2024-04-18T03:41:51.449204+0000","last_became_active":"2024-04-18T03:38:23.753851+0000","last_became_peered":"2024-04-18T03:38:23.753851+0000","last_unstale":"2024-04-18T03:41:51.449204+0000","last_undegraded":"2024-04-18T03:41:51.449204+0000","last_fullsized":"2024-04-18T03:41:51.449204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:41:51.449154+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:41:51.449154+0000","last_clean_scrub_stamp":"2024-04-18T03:41:51.449154+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:31:39.689178+0000","scrub_duration":0.003459279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"27'63","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.159973+0000","last_change":"2024-04-18T03:42:02.159973+0000","last_active":"2024-04-18T03:42:02.159973+0000","last_peered":"2024-04-18T03:42:02.159973+0000","last_clean":"2024-04-18T03:42:02.159973+0000","last_became_active":"2024-04-18T03:37:34.300560+0000","last_became_peered":"2024-04-18T03:37:34.300560+0000","last_unstale":"2024-04-18T03:42:02.159973+0000","last_undegraded":"2024-04-18T03:42:02.159973+0000","last_fullsized":"2024-04-18T03:42:02.159973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'63","last_scrub_stamp":"2024-04-18T03:42:02.159716+0000","last_deep_scrub":"27'63","last_deep_scrub_stamp":"2024-04-18T03:42:02.159716+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.159716+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:53:20.536658+0000","scrub_duration":0.0032552639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'62","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:58.229817+0000","last_change":"2024-04-18T03:41:58.229817+0000","last_active":"2024-04-18T03:41:58.229817+0000","last_peered":"2024-04-18T03:41:58.229817+0000","last_clean":"2024-04-18T03:41:58.229817+0000","last_became_active":"2024-04-18T03:37:34.302363+0000","last_became_peered":"2024-04-18T03:37:34.302363+0000","last_unstale":"2024-04-18T03:41:58.229817+0000","last_undegraded":"2024-04-18T03:41:58.229817+0000","last_fullsized":"2024-04-18T03:41:58.229817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'62","last_scrub_stamp":"2024-04-18T03:41:58.229566+0000","last_deep_scrub":"27'62","last_deep_scrub_stamp":"2024-04-18T03:41:58.229566+0000","last_clean_scrub_stamp":"2024-04-18T03:41:58.229566+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:29:30.684730+0000","scrub_duration":0.0029384929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'51","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:04.676997+0000","last_change":"2024-04-18T03:42:04.676997+0000","last_active":"2024-04-18T03:42:04.676997+0000","last_peered":"2024-04-18T03:42:04.676997+0000","last_clean":"2024-04-18T03:42:04.676997+0000","last_became_active":"2024-04-18T03:37:34.300265+0000","last_became_peered":"2024-04-18T03:37:34.300265+0000","last_unstale":"2024-04-18T03:42:04.676997+0000","last_undegraded":"2024-04-18T03:42:04.676997+0000","last_fullsized":"2024-04-18T03:42:04.676997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:42:04.676743+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:42:04.676743+0000","last_clean_scrub_stamp":"2024-04-18T03:42:04.676743+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:03:16.594820+0000","scrub_duration":0.003832252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'58","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:43.546229+0000","last_change":"2024-04-18T03:41:43.546229+0000","last_active":"2024-04-18T03:41:43.546229+0000","last_peered":"2024-04-18T03:41:43.546229+0000","last_clean":"2024-04-18T03:41:43.546229+0000","last_became_active":"2024-04-18T03:37:34.312878+0000","last_became_peered":"2024-04-18T03:37:34.312878+0000","last_unstale":"2024-04-18T03:41:43.546229+0000","last_undegraded":"2024-04-18T03:41:43.546229+0000","last_fullsized":"2024-04-18T03:41:43.546229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2024-04-18T03:41:43.545942+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2024-04-18T03:41:43.545942+0000","last_clean_scrub_stamp":"2024-04-18T03:41:43.545942+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:15:44.975388+0000","scrub_duration":0.003138166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:02.807044+0000","last_change":"2024-04-18T03:42:02.807044+0000","last_active":"2024-04-18T03:42:02.807044+0000","last_peered":"2024-04-18T03:42:02.807044+0000","last_clean":"2024-04-18T03:42:02.807044+0000","last_became_active":"2024-04-18T03:37:34.304812+0000","last_became_peered":"2024-04-18T03:37:34.304812+0000","last_unstale":"2024-04-18T03:42:02.807044+0000","last_undegraded":"2024-04-18T03:42:02.807044+0000","last_fullsized":"2024-04-18T03:42:02.807044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:02.806793+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:02.806793+0000","last_clean_scrub_stamp":"2024-04-18T03:42:02.806793+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:38.560297+0000","scrub_duration":0.0034323320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:04.846321+0000","last_change":"2024-04-18T03:42:04.846321+0000","last_active":"2024-04-18T03:42:04.846321+0000","last_peered":"2024-04-18T03:42:04.846321+0000","last_clean":"2024-04-18T03:42:04.846321+0000","last_became_active":"2024-04-18T03:37:34.307715+0000","last_became_peered":"2024-04-18T03:37:34.307715+0000","last_unstale":"2024-04-18T03:42:04.846321+0000","last_undegraded":"2024-04-18T03:42:04.846321+0000","last_fullsized":"2024-04-18T03:42:04.846321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:04.845993+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:04.845993+0000","last_clean_scrub_stamp":"2024-04-18T03:42:04.845993+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:03:16.764069+0000","scrub_duration":0.0038714449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'53","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:04.018934+0000","last_change":"2024-04-18T03:42:04.018934+0000","last_active":"2024-04-18T03:42:04.018934+0000","last_peered":"2024-04-18T03:42:04.018934+0000","last_clean":"2024-04-18T03:42:04.018934+0000","last_became_active":"2024-04-18T03:37:34.291606+0000","last_became_peered":"2024-04-18T03:37:34.291606+0000","last_unstale":"2024-04-18T03:42:04.018934+0000","last_undegraded":"2024-04-18T03:42:04.018934+0000","last_fullsized":"2024-04-18T03:42:04.018934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-18T03:42:04.018638+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-18T03:42:04.018638+0000","last_clean_scrub_stamp":"2024-04-18T03:42:04.018638+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:09:39.760987+0000","scrub_duration":0.003460089,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'59","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:57.145900+0000","last_change":"2024-04-18T03:41:57.145900+0000","last_active":"2024-04-18T03:41:57.145900+0000","last_peered":"2024-04-18T03:41:57.145900+0000","last_clean":"2024-04-18T03:41:57.145900+0000","last_became_active":"2024-04-18T03:37:34.288606+0000","last_became_peered":"2024-04-18T03:37:34.288606+0000","last_unstale":"2024-04-18T03:41:57.145900+0000","last_undegraded":"2024-04-18T03:41:57.145900+0000","last_fullsized":"2024-04-18T03:41:57.145900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'59","last_scrub_stamp":"2024-04-18T03:41:57.145649+0000","last_deep_scrub":"27'59","last_deep_scrub_stamp":"2024-04-18T03:41:57.145649+0000","last_clean_scrub_stamp":"2024-04-18T03:41:57.145649+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:42:23.565837+0000","scrub_duration":0.0027827289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'48","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:38.899933+0000","last_change":"2024-04-18T03:41:38.899933+0000","last_active":"2024-04-18T03:41:38.899933+0000","last_peered":"2024-04-18T03:41:38.899933+0000","last_clean":"2024-04-18T03:41:38.899933+0000","last_became_active":"2024-04-18T03:37:34.314058+0000","last_became_peered":"2024-04-18T03:37:34.314058+0000","last_unstale":"2024-04-18T03:41:38.899933+0000","last_undegraded":"2024-04-18T03:41:38.899933+0000","last_fullsized":"2024-04-18T03:41:38.899933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:41:38.899689+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:41:38.899689+0000","last_clean_scrub_stamp":"2024-04-18T03:41:38.899689+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:20:58.444937+0000","scrub_duration":0.0032972489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'44","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:41.742622+0000","last_change":"2024-04-18T03:41:41.742622+0000","last_active":"2024-04-18T03:41:41.742622+0000","last_peered":"2024-04-18T03:41:41.742622+0000","last_clean":"2024-04-18T03:41:41.742622+0000","last_became_active":"2024-04-18T03:37:34.298569+0000","last_became_peered":"2024-04-18T03:37:34.298569+0000","last_unstale":"2024-04-18T03:41:41.742622+0000","last_undegraded":"2024-04-18T03:41:41.742622+0000","last_fullsized":"2024-04-18T03:41:41.742622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-04-18T03:41:41.742222+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-04-18T03:41:41.742222+0000","last_clean_scrub_stamp":"2024-04-18T03:41:41.742222+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:43.181309+0000","scrub_duration":0.0036324560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'50","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:59.247875+0000","last_change":"2024-04-18T03:41:59.247875+0000","last_active":"2024-04-18T03:41:59.247875+0000","last_peered":"2024-04-18T03:41:59.247875+0000","last_clean":"2024-04-18T03:41:59.247875+0000","last_became_active":"2024-04-18T03:37:34.310217+0000","last_became_peered":"2024-04-18T03:37:34.310217+0000","last_unstale":"2024-04-18T03:41:59.247875+0000","last_undegraded":"2024-04-18T03:41:59.247875+0000","last_fullsized":"2024-04-18T03:41:59.247875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'50","last_scrub_stamp":"2024-04-18T03:41:59.247600+0000","last_deep_scrub":"27'50","last_deep_scrub_stamp":"2024-04-18T03:41:59.247600+0000","last_clean_scrub_stamp":"2024-04-18T03:41:59.247600+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:12.081057+0000","scrub_duration":0.0030890760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'53","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.183014+0000","last_change":"2024-04-18T03:42:09.183014+0000","last_active":"2024-04-18T03:42:09.183014+0000","last_peered":"2024-04-18T03:42:09.183014+0000","last_clean":"2024-04-18T03:42:09.183014+0000","last_became_active":"2024-04-18T03:38:23.514732+0000","last_became_peered":"2024-04-18T03:38:23.514732+0000","last_unstale":"2024-04-18T03:42:09.183014+0000","last_undegraded":"2024-04-18T03:42:09.183014+0000","last_fullsized":"2024-04-18T03:42:09.183014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-04-18T03:42:09.182763+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-04-18T03:42:09.182763+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.182763+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:58.287645+0000","scrub_duration":0.003376305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'54","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:15.791732+0000","last_change":"2024-04-18T03:42:15.791732+0000","last_active":"2024-04-18T03:42:15.791732+0000","last_peered":"2024-04-18T03:42:15.791732+0000","last_clean":"2024-04-18T03:42:15.791732+0000","last_became_active":"2024-04-18T03:37:34.301252+0000","last_became_peered":"2024-04-18T03:37:34.301252+0000","last_unstale":"2024-04-18T03:42:15.791732+0000","last_undegraded":"2024-04-18T03:42:15.791732+0000","last_fullsized":"2024-04-18T03:42:15.791732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-18T03:42:15.791411+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-18T03:42:15.791411+0000","last_clean_scrub_stamp":"2024-04-18T03:42:15.791411+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:53.153295+0000","scrub_duration":0.0029386949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:06.872081+0000","last_change":"2024-04-18T03:42:06.872341+0000","last_active":"2024-04-18T03:42:06.872081+0000","last_peered":"2024-04-18T03:42:06.872081+0000","last_clean":"2024-04-18T03:42:06.872081+0000","last_became_active":"2024-04-18T03:37:34.305998+0000","last_became_peered":"2024-04-18T03:37:34.305998+0000","last_unstale":"2024-04-18T03:42:06.872081+0000","last_undegraded":"2024-04-18T03:42:06.872081+0000","last_fullsized":"2024-04-18T03:42:06.872081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:42:06.872027+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:42:06.872027+0000","last_clean_scrub_stamp":"2024-04-18T03:42:06.872027+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:30:54.457075+0000","scrub_duration":0.003440579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'54","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:07.656701+0000","last_change":"2024-04-18T03:42:07.656889+0000","last_active":"2024-04-18T03:42:07.656701+0000","last_peered":"2024-04-18T03:42:07.656701+0000","last_clean":"2024-04-18T03:42:07.656701+0000","last_became_active":"2024-04-18T03:37:34.308239+0000","last_became_peered":"2024-04-18T03:37:34.308239+0000","last_unstale":"2024-04-18T03:42:07.656701+0000","last_undegraded":"2024-04-18T03:42:07.656701+0000","last_fullsized":"2024-04-18T03:42:07.656701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-04-18T03:42:07.656648+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-04-18T03:42:07.656648+0000","last_clean_scrub_stamp":"2024-04-18T03:42:07.656648+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:32:53.559737+0000","scrub_duration":0.003300997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'51","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:16.773578+0000","last_change":"2024-04-18T03:42:16.773809+0000","last_active":"2024-04-18T03:42:16.773578+0000","last_peered":"2024-04-18T03:42:16.773578+0000","last_clean":"2024-04-18T03:42:16.773578+0000","last_became_active":"2024-04-18T03:37:34.307469+0000","last_became_peered":"2024-04-18T03:37:34.307469+0000","last_unstale":"2024-04-18T03:42:16.773578+0000","last_undegraded":"2024-04-18T03:42:16.773578+0000","last_fullsized":"2024-04-18T03:42:16.773578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'51","last_scrub_stamp":"2024-04-18T03:42:16.773523+0000","last_deep_scrub":"27'51","last_deep_scrub_stamp":"2024-04-18T03:42:16.773523+0000","last_clean_scrub_stamp":"2024-04-18T03:42:16.773523+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:34:54.135407+0000","scrub_duration":0.003548271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'55","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:18.864263+0000","last_change":"2024-04-18T03:42:18.864507+0000","last_active":"2024-04-18T03:42:18.864263+0000","last_peered":"2024-04-18T03:42:18.864263+0000","last_clean":"2024-04-18T03:42:18.864263+0000","last_became_active":"2024-04-18T03:37:34.294556+0000","last_became_peered":"2024-04-18T03:37:34.294556+0000","last_unstale":"2024-04-18T03:42:18.864263+0000","last_undegraded":"2024-04-18T03:42:18.864263+0000","last_fullsized":"2024-04-18T03:42:18.864263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:42:18.864215+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:42:18.864215+0000","last_clean_scrub_stamp":"2024-04-18T03:42:18.864215+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:31:06.449262+0000","scrub_duration":0.0033306519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'40","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:09.778113+0000","last_change":"2024-04-18T03:42:09.778325+0000","last_active":"2024-04-18T03:42:09.778113+0000","last_peered":"2024-04-18T03:42:09.778113+0000","last_clean":"2024-04-18T03:42:09.778113+0000","last_became_active":"2024-04-18T03:37:34.299858+0000","last_became_peered":"2024-04-18T03:37:34.299858+0000","last_unstale":"2024-04-18T03:42:09.778113+0000","last_undegraded":"2024-04-18T03:42:09.778113+0000","last_fullsized":"2024-04-18T03:42:09.778113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-04-18T03:42:09.778054+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-04-18T03:42:09.778054+0000","last_clean_scrub_stamp":"2024-04-18T03:42:09.778054+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:40.985160+0000","scrub_duration":0.003457884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'55","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:48.269903+0000","last_change":"2024-04-18T03:41:48.270196+0000","last_active":"2024-04-18T03:41:48.269903+0000","last_peered":"2024-04-18T03:41:48.269903+0000","last_clean":"2024-04-18T03:41:48.269903+0000","last_became_active":"2024-04-18T03:37:34.297643+0000","last_became_peered":"2024-04-18T03:37:34.297643+0000","last_unstale":"2024-04-18T03:41:48.269903+0000","last_undegraded":"2024-04-18T03:41:48.269903+0000","last_fullsized":"2024-04-18T03:41:48.269903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'55","last_scrub_stamp":"2024-04-18T03:41:48.269851+0000","last_deep_scrub":"27'55","last_deep_scrub_stamp":"2024-04-18T03:41:48.269851+0000","last_clean_scrub_stamp":"2024-04-18T03:41:48.269851+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:50.730224+0000","scrub_duration":0.0035341819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'43","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:41:33.001693+0000","last_change":"2024-04-18T03:41:33.001693+0000","last_active":"2024-04-18T03:41:33.001693+0000","last_peered":"2024-04-18T03:41:33.001693+0000","last_clean":"2024-04-18T03:41:33.001693+0000","last_became_active":"2024-04-18T03:37:34.289203+0000","last_became_peered":"2024-04-18T03:37:34.289203+0000","last_unstale":"2024-04-18T03:41:33.001693+0000","last_undegraded":"2024-04-18T03:41:33.001693+0000","last_fullsized":"2024-04-18T03:41:33.001693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-04-18T03:41:33.001450+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-04-18T03:41:33.001450+0000","last_clean_scrub_stamp":"2024-04-18T03:41:33.001450+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:14:23.512254+0000","scrub_duration":0.0028028340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'48","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-18T03:42:20.882873+0000","last_change":"2024-04-18T03:42:20.883086+0000","last_active":"2024-04-18T03:42:20.882873+0000","last_peered":"2024-04-18T03:42:20.882873+0000","last_clean":"2024-04-18T03:42:20.882873+0000","last_became_active":"2024-04-18T03:37:34.312824+0000","last_became_peered":"2024-04-18T03:37:34.312824+0000","last_unstale":"2024-04-18T03:42:20.882873+0000","last_undegraded":"2024-04-18T03:42:20.882873+0000","last_fullsized":"2024-04-18T03:42:20.882873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-04-18T03:42:20.882823+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-04-18T03:42:20.882823+0000","last_clean_scrub_stamp":"2024-04-18T03:42:20.882823+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:39:19.887345+0000","scrub_duration":0.0031572430000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1407,"ondisk_log_size":1407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31140456,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":388,"num_write":3113,"num_write_kb":31587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62341120,"data_stored":62280912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3850,"ondisk_log_size":3850,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49160,"kb_used_data":13952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94322680,"statfs":{"total":96636764160,"available":96586424320,"internally_reserved":0,"allocated":14286848,"data_stored":14110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.127,"5min":1.286,"15min":1.286},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.86599999999999999,"15min":0.89000000000000001},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.161,"5min":1.331,"15min":1.331},"last":1.0309999999999999}]},{"osd":1,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83899999999999997,"15min":0.877},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1699999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82999999999999996,"15min":0.874},"min":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.208,"5min":1.724,"15min":1.724},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.85299999999999998},"min":{"1min":0.45700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0820000000000001,"5min":1.274,"15min":1.274},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.95699999999999996,"15min":0.98599999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2150000000000001,"5min":1.329,"15min":1.329},"last":1}]},{"osd":3,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.88600000000000001},"min":{"1min":0.52300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.1419999999999999,"5min":1.228,"15min":1.228},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.83699999999999997},"min":{"1min":0.57199999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.095,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2609999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.093},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4239999999999999,"5min":2.198,"15min":2.198},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.63900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3839999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.999,"15min":1.0069999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2589999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Apr 18 03:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0469999999999999,"15min":1.0680000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.351,"5min":1.651,"15min":1.651},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.0629999999999999},"min":{"1min":0.67700000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4359999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.0780000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43684,"kb_used_data":8476,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":8679424,"data_stored":8504374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80900000000000005,"15min":0.83999999999999997},"min":{"1min":0.52900000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.872,"15min":0.89200000000000002},"min":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.111,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.94299999999999995,"15min":0.96399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1879999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.0329999999999999}]},{"osd":2,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.85499999999999998,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2829999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90900000000000003,"15min":0.91700000000000004},"min":{"1min":0.68799999999999994,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.90300000000000002,"15min":0.90900000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.179,"5min":1.298,"15min":1.298},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.94399999999999995,"15min":0.92500000000000004},"min":{"1min":0.65000000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1180000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.1200000000000001}]},{"osd":5,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94199999999999995,"15min":0.93100000000000005},"min":{"1min":0.72999999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.304,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.95299999999999996,"15min":0.96099999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.0660000000000001}]},{"osd":6,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.363,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.236},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1240000000000001,"15min":1.127},"min":{"1min":0.878,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.3819999999999999,"5min":1.621,"15min":1.621},"last":1.202}]},{"osd":7,"last update":"Thu Apr 18 03:41:40 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0449999999999999,"15min":1.0509999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.21,"5min":1.395,"15min":1.395},"last":1.149},{"interface":"front","average":{"1min":1.125,"5min":1.1579999999999999,"15min":1.1259999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.45,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.306}]}]},{"osd":7,"up_from":14,"seq":60129542208,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57928,"kb_used_data":18624,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94313912,"statfs":{"total":96636764160,"available":96577445888,"internally_reserved":0,"allocated":19070976,"data_stored":18894785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40237515},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.78600000000000003,"15min":0.80600000000000005},"min":{"1min":0.56399999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.095,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.84799999999999998,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1499999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.093}]},{"osd":1,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90500000000000003,"15min":0.94499999999999995},"min":{"1min":0.62,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3540000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.56599999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.1220000000000001,"5min":1.123,"15min":1.123},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.86699999999999999,"15min":0.93000000000000005},"min":{"1min":0.56599999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2490000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.054},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.90300000000000002,"15min":0.94199999999999995},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1899999999999999,"5min":1.272,"15min":1.272},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.90000000000000002,"15min":0.94399999999999995},"min":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.232},"last":1.143},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97399999999999998,"15min":1.014},"min":{"1min":0.66300000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.212,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.89500000000000002,"15min":0.91500000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2709999999999999,"5min":1.679,"15min":1.679},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.995,"5min":0.97499999999999998,"15min":0.98199999999999998},"min":{"1min":0.72899999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.268,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.169}]},{"osd":5,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.89500000000000002,"15min":0.92200000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1120000000000001,"5min":1.617,"15min":1.617},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0389999999999999,"15min":1.0660000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3169999999999999,"5min":1.496,"15min":1.496},"last":1.206}]},{"osd":6,"last update":"Thu Apr 18 03:41:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.119},"min":{"1min":0.66200000000000003,"5min":0.625,"15min":0.625},"max":{"1min":1.3109999999999999,"5min":1.593,"15min":1.593},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.014,"15min":1.006},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.2430000000000001,"5min":1.462,"15min":1.462},"last":0.98499999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542208,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":116344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81000000000000005,"15min":0.88700000000000001},"min":{"1min":0.56599999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0920000000000001,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.84299999999999997},"min":{"1min":0.501,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.089,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Apr 18 03:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.82299999999999995,"15min":0.88200000000000001},"min":{"1min":0.64700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0129999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.86199999999999999},"min":{"1min":0.65100000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0149999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Apr 18 03:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.88300000000000001,"15min":0.92700000000000005},"min":{"1min":0.627,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0529999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.026,"5min":0.98099999999999998,"15min":1.0349999999999999},"min":{"1min":0.747,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.23,"5min":1.536,"15min":1.536},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.94599999999999995,"15min":0.98099999999999998},"min":{"1min":0.70899999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1459999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.94499999999999995,"15min":0.93200000000000005},"min":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.157,"5min":1.472,"15min":1.472},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.98299999999999998,"15min":1.03},"min":{"1min":0.58599999999999997,"5min":0.375,"15min":0.375},"max":{"1min":1.252,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0209999999999999,"15min":1.075},"min":{"1min":0.83199999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2749999999999999,"5min":1.631,"15min":1.631},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.90300000000000002,"15min":0.93700000000000006},"min":{"1min":0.64500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1739999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.0980000000000001,"15min":1.1419999999999999},"min":{"1min":0.65800000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.488,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.024}]},{"osd":7,"last update":"Thu Apr 18 03:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.97699999999999998,"15min":1.0329999999999999},"min":{"1min":0.78900000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.115,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.1419999999999999,"15min":1.2330000000000001},"min":{"1min":0.82499999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.216,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.1930000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542208,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":12932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":13242368,"data_stored":13068331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66200000000000003,"15min":0.67200000000000004},"min":{"1min":0.49399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1459999999999999,"5min":2.202,"15min":2.202},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70599999999999996,"15min":0.72099999999999997},"min":{"1min":0.42399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.86299999999999999,"5min":1.272,"15min":1.272},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.753,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.0389999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.069,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.55200000000000005,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1890000000000001,"5min":1.821,"15min":1.821},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.63700000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.619,"15min":1.619},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.96699999999999997,"15min":0.94699999999999995},"min":{"1min":0.77100000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.014,"15min":1.024},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3660000000000001,"5min":1.966,"15min":1.966},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.042,"15min":1.0229999999999999},"min":{"1min":0.70999999999999996,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2330000000000001,"5min":1.845,"15min":1.845},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.042,"15min":1.0600000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2769999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.107},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.097,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.627,"5min":1.764,"15min":1.764},"last":1.024}]},{"osd":7,"last update":"Thu Apr 18 03:41:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.042,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.1200000000000001,"15min":1.1379999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.4099999999999999,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.1479999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542208,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35844,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335996,"statfs":{"total":96636764160,"available":96600059904,"internally_reserved":0,"allocated":651264,"data_stored":484747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.626,"15min":0.64800000000000002},"min":{"1min":0.38300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.69899999999999995},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1679999999999999,"5min":1.532,"15min":1.532},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77800000000000002,"15min":0.80800000000000005},"min":{"1min":0.32700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.228,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98299999999999998,"5min":1.214,"15min":1.214},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.28599999999999998,"5min":0.253,"15min":0.253},"max":{"1min":1.046,"5min":1.246,"15min":1.246},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.438,"5min":0.318,"15min":0.318},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.89600000000000002,"15min":0.92500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.98299999999999998},"min":{"1min":0.59799999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98899999999999999,"15min":1.0129999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4710000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.008},"min":{"1min":0.58999999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.077,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0840000000000001}]},{"osd":6,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.0580000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.998,"15min":1.024},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.321,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Apr 18 03:41:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0209999999999999,"15min":1.0700000000000001},"min":{"1min":0.61299999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.242,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.0489999999999999,"15min":1.069},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4710000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.96699999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542209,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35492,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336348,"statfs":{"total":96636764160,"available":96600420352,"internally_reserved":0,"allocated":290816,"data_stored":116414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58199999999999996,"15min":0.60099999999999998},"min":{"1min":0.44400000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.39200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.745,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.629}]},{"osd":2,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76200000000000001,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.51900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92500000000000004,"5min":1.321,"15min":1.321},"last":1.175}]},{"osd":3,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.79800000000000004,"15min":0.83299999999999996},"min":{"1min":0.66400000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0169999999999999,"5min":1.583,"15min":1.583},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.79800000000000004,"15min":0.79100000000000004},"min":{"1min":0.56899999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1259999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.90900000000000003,"15min":0.93500000000000005},"min":{"1min":0.72499999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.206,"5min":1.337,"15min":1.337},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.72399999999999998,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1870000000000001,"5min":1.274,"15min":1.274},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"min":{"1min":0.66100000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.2250000000000001,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":0.998},"min":{"1min":0.71699999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.296,"5min":1.353,"15min":1.353},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0640000000000001,"15min":1.1319999999999999},"min":{"1min":0.80500000000000005,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.423,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.383},{"interface":"front","average":{"1min":0.999,"5min":1.0620000000000001,"15min":1.1140000000000001},"min":{"1min":0.80400000000000005,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.256,"5min":2.242,"15min":2.242},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Apr 18 03:41:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.079,"15min":1.129},"min":{"1min":0.78500000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3799999999999999,"5min":2.044,"15min":2.044},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1000000000000001,"15min":1.139},"min":{"1min":0.78400000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.296,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.0389999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44264,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94327576,"statfs":{"total":96636764160,"available":96591437824,"internally_reserved":0,"allocated":9273344,"data_stored":9094201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.41199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86599999999999999,"5min":1.022,"15min":1.022},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.55300000000000005,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.69799999999999995},"min":{"1min":0.59199999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90500000000000003,"5min":1.016,"15min":1.016},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.47099999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0029999999999999,"5min":1.103,"15min":1.103},"last":0.748}]},{"osd":3,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71099999999999997,"15min":0.68200000000000005},"min":{"1min":0.42499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.026,"5min":1.28,"15min":1.28},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74299999999999999,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90400000000000003,"5min":1.234,"15min":1.234},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Apr 18 03:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94499999999999995,"15min":0.95099999999999996},"min":{"1min":0.69999999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.76700000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.081,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.999,"15min":0.97099999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0509999999999999},"min":{"1min":0.746,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3400000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.016}]},{"osd":6,"last update":"Thu Apr 18 03:41:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.036,"15min":1.032},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.393,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.0840000000000001,"15min":1.0660000000000001},"min":{"1min":0.878,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2769999999999999,"5min":1.589,"15min":1.589},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Apr 18 03:41:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.89900000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2170000000000001,"5min":1.484,"15min":1.484},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.91400000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.387,"5min":1.544,"15min":1.544},"last":1.1100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":368493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12959744,"data_stored":12952077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14004224,"data_stored":13993949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18194432,"data_stored":18188163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T03:42:37.067 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-18T03:42:37.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.177+0000 7fb9aef28700 1 Processor -- start 2024-04-18T03:42:37.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.177+0000 7fb9aef28700 1 -- start start 2024-04-18T03:42:37.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb9a8071080 0x7fb9a8071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9a8161660 0x7fb9a806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a80719a0 con 0x7fb9a80b5f90 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a806a770 con 0x7fb9a8161660 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a806aa50 con 0x7fb9a8071080 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9ad725700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9a8161660 0x7fb9a806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9ad725700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9a8161660 0x7fb9a806c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36074/0 (socket says 172.21.15.157:36074) 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9ad725700 1 -- 172.21.15.157:0/1077202143 learned_addr learned my addr 172.21.15.157:0/1077202143 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9adf26700 1 --2- 172.21.15.157:0/1077202143 >> v2:172.21.15.175:3300/0 conn(0x7fb9a8071080 0x7fb9a8071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9ad725700 1 -- 172.21.15.157:0/1077202143 >> v2:172.21.15.175:3300/0 conn(0x7fb9a8071080 msgr2=0x7fb9a8071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9ad725700 1 --2- 172.21.15.157:0/1077202143 >> v2:172.21.15.175:3300/0 conn(0x7fb9a8071080 0x7fb9a8071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9ad725700 1 -- 172.21.15.157:0/1077202143 >> v1:172.21.15.175:6789/0 conn(0x7fb9a80b5f90 legacy=0x7fb9a80b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9ad725700 1 -- 172.21.15.157:0/1077202143 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a806ad30 con 0x7fb9a8161660 2024-04-18T03:42:37.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9ad725700 1 --2- 172.21.15.157:0/1077202143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a8161660 0x7fb9a806c3a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80cff60 tx=0x7fb99c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abaaa6e4f2be2a79 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9acf24700 1 -- 172.21.15.157:0/1077202143 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00b8a0 con 0x7fb9a8161660 2024-04-18T03:42:37.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9acf24700 1 -- 172.21.15.157:0/1077202143 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c00ba00 con 0x7fb9a8161660 2024-04-18T03:42:37.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9acf24700 1 -- 172.21.15.157:0/1077202143 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00bd90 con 0x7fb9a8161660 2024-04-18T03:42:37.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 -- 172.21.15.157:0/1077202143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a8161660 msgr2=0x7fb9a806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1077202143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a8161660 0x7fb9a806c3a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80cff60 tx=0x7fb99c009bf0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 -- 172.21.15.157:0/1077202143 shutdown_connections 2024-04-18T03:42:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1077202143 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a8161660 0x7fb9a806c3a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1077202143 >> v2:172.21.15.175:3300/0 conn(0x7fb9a8071080 0x7fb9a8071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 -- 172.21.15.157:0/1077202143 >> 172.21.15.157:0/1077202143 conn(0x7fb9a806e020 msgr2=0x7fb9a806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 -- 172.21.15.157:0/1077202143 shutdown_connections 2024-04-18T03:42:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.181+0000 7fb9aef28700 1 -- 172.21.15.157:0/1077202143 wait complete. 2024-04-18T03:42:37.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9aef28700 1 Processor -- start 2024-04-18T03:42:37.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9aef28700 1 -- start start 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9aef28700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9a8071080 0x7fb9a815b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9aef28700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a80b5f90 0x7fb9a815c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9aef28700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a8161660 0x7fb9a80c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9aef28700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a815b7a0 con 0x7fb9a80b5f90 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9aef28700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a815ba80 con 0x7fb9a8161660 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9aef28700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a815bd60 con 0x7fb9a8071080 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a80b5f90 0x7fb9a815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a80b5f90 0x7fb9a815c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36078/0 (socket says 172.21.15.157:36078) 2024-04-18T03:42:37.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 -- 172.21.15.157:0/1711680465 learned_addr learned my addr 172.21.15.157:0/1711680465 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:37.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ae727700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a8161660 0x7fb9a80c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9adf26700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9a8071080 0x7fb9a815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 -- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9a8071080 msgr2=0x7fb9a815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9a8071080 0x7fb9a815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 -- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a8161660 msgr2=0x7fb9a80c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a8161660 0x7fb9a80c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 -- 172.21.15.157:0/1711680465 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c009570 con 0x7fb9a80b5f90 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.185+0000 7fb9ad725700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a80b5f90 0x7fb9a815c840 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb99c000c00 tx=0x7fb99c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb99a7fc700 1 -- 172.21.15.157:0/1711680465 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c012d20 con 0x7fb9a80b5f90 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a815c040 con 0x7fb9a80b5f90 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb99a7fc700 1 -- 172.21.15.157:0/1711680465 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c01e070 con 0x7fb9a80b5f90 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb99a7fc700 1 -- 172.21.15.157:0/1711680465 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c004250 con 0x7fb9a80b5f90 2024-04-18T03:42:37.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a80c8db0 con 0x7fb9a80b5f90 2024-04-18T03:42:37.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb99a7fc700 1 -- 172.21.15.157:0/1711680465 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb99c0043b0 con 0x7fb9a80b5f90 2024-04-18T03:42:37.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a804e650 con 0x7fb9a80b5f90 2024-04-18T03:42:37.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb99a7fc700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb98c066730 0x7fb98c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb99a7fc700 1 -- 172.21.15.157:0/1711680465 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb99c020070 con 0x7fb9a80b5f90 2024-04-18T03:42:37.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.189+0000 7fb9adf26700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb98c066730 0x7fb98c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.193+0000 7fb9adf26700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb98c066730 0x7fb98c068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8160120 tx=0x7fb9a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.201+0000 7fb99a7fc700 1 -- 172.21.15.157:0/1711680465 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fb99c052d50 con 0x7fb9a80b5f90 2024-04-18T03:42:37.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.365+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb9a806a550 con 0x7fb9a80b5f90 2024-04-18T03:42:37.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.373+0000 7fb99a7fc700 1 -- 172.21.15.157:0/1711680465 <== mon.0 v2:172.21.15.157:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb99c08c080 con 0x7fb9a80b5f90 2024-04-18T03:42:37.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb99a7fc700 1 -- 172.21.15.157:0/1711680465 <== mon.0 v2:172.21.15.157:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb99c02a0c0 con 0x7fb9a80b5f90 2024-04-18T03:42:37.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb98c066730 msgr2=0x7fb98c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb98c066730 0x7fb98c068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8160120 tx=0x7fb9a4008040 comp rx=0 tx=0).stop 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a80b5f90 msgr2=0x7fb9a815c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a80b5f90 0x7fb9a815c840 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb99c000c00 tx=0x7fb99c004770 comp rx=0 tx=0).stop 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 shutdown_connections 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fb98c066730 0x7fb98c068bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a8161660 0x7fb9a80c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb9a80b5f90 0x7fb9a815c840 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 --2- 172.21.15.157:0/1711680465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9a8071080 0x7fb9a815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 >> 172.21.15.157:0/1711680465 conn(0x7fb9a806e020 msgr2=0x7fb9a80b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 shutdown_connections 2024-04-18T03:42:37.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.377+0000 7fb9aef28700 1 -- 172.21.15.157:0/1711680465 wait complete. 2024-04-18T03:42:37.394 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-18T03:42:37.394 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:42:37.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416359e700 1 Processor -- start 2024-04-18T03:42:37.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416359e700 1 -- start start 2024-04-18T03:42:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640adf00 0x7f4164071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f416415ac90 0x7f416415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416359e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416415bf10 con 0x7f41640716c0 2024-04-18T03:42:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416415b5c0 con 0x7f416415ac90 2024-04-18T03:42:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4164071b40 con 0x7f41640adf00 2024-04-18T03:42:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416259c700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640adf00 0x7f4164071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f4162d9d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f416415ac90 0x7f416415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f4161d9b700 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f41640716c0 0x7f416415a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.157:37598/0 (socket says 172.21.15.157:37598) 2024-04-18T03:42:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f4161d9b700 1 -- 172.21.15.157:0/3459486238 learned_addr learned my addr 172.21.15.157:0/3459486238 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416159a700 1 -- 172.21.15.157:0/3459486238 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473634993 0 0) 0x7f416415bf10 con 0x7f41640716c0 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416159a700 1 -- 172.21.15.157:0/3459486238 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41440035d0 con 0x7f41640716c0 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f4162d9d700 1 -- 172.21.15.157:0/3459486238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640adf00 msgr2=0x7f4164071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f4162d9d700 1 --2- 172.21.15.157:0/3459486238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640adf00 0x7f4164071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f4162d9d700 1 -- 172.21.15.157:0/3459486238 >> v1:172.21.15.175:6789/0 conn(0x7f41640716c0 legacy=0x7f416415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f4162d9d700 1 -- 172.21.15.157:0/3459486238 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41640ae2e0 con 0x7f416415ac90 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416259c700 1 --2- 172.21.15.157:0/3459486238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640adf00 0x7f4164071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f4162d9d700 1 --2- 172.21.15.157:0/3459486238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f416415ac90 0x7f416415c3a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f415c009d90 tx=0x7f415c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaa3c47720e37237 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416159a700 1 -- 172.21.15.157:0/3459486238 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c00e070 con 0x7f416415ac90 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416159a700 1 -- 172.21.15.157:0/3459486238 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f415c00bb20 con 0x7f416415ac90 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.505+0000 7f416159a700 1 -- 172.21.15.157:0/3459486238 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c012430 con 0x7f416415ac90 2024-04-18T03:42:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- 172.21.15.157:0/3459486238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f416415ac90 msgr2=0x7f416415c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 --2- 172.21.15.157:0/3459486238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f416415ac90 0x7f416415c3a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f415c009d90 tx=0x7f415c00b330 comp rx=0 tx=0).stop 2024-04-18T03:42:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- 172.21.15.157:0/3459486238 shutdown_connections 2024-04-18T03:42:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 --2- 172.21.15.157:0/3459486238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f416415ac90 0x7f416415c3a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 --2- 172.21.15.157:0/3459486238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640adf00 0x7f4164071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- 172.21.15.157:0/3459486238 >> 172.21.15.157:0/3459486238 conn(0x7f41640b1330 msgr2=0x7f416406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- 172.21.15.157:0/3459486238 shutdown_connections 2024-04-18T03:42:37.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- 172.21.15.157:0/3459486238 wait complete. 2024-04-18T03:42:37.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 Processor -- start 2024-04-18T03:42:37.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- start start 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640716c0 0x7f41640a81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41640adf00 0x7f4164157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f416415ac90 0x7f41641f0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416414ad40 con 0x7f416415ac90 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41640a8df0 con 0x7f41640adf00 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.509+0000 7f416359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4164157bb0 con 0x7f41640716c0 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41640adf00 0x7f4164157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41640adf00 0x7f4164157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:60550/0 (socket says 172.21.15.157:60550) 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 -- 172.21.15.157:0/866699162 learned_addr learned my addr 172.21.15.157:0/866699162 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f416259c700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640716c0 0x7f41640a81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4162d9d700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f416415ac90 0x7f41641f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 -- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640716c0 msgr2=0x7f41640a81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640716c0 0x7f41640a81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 -- 172.21.15.157:0/866699162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f416415ac90 msgr2=0x7f41641f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f416415ac90 0x7f41641f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 -- 172.21.15.157:0/866699162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540094b0 con 0x7f41640adf00 2024-04-18T03:42:37.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f4161d9b700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41640adf00 0x7f4164157670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f414c00c520 tx=0x7f414c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f415affd700 1 -- 172.21.15.157:0/866699162 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c005d90 con 0x7f41640adf00 2024-04-18T03:42:37.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f415affd700 1 -- 172.21.15.157:0/866699162 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f414c0070d0 con 0x7f41640adf00 2024-04-18T03:42:37.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c009a70 con 0x7f41640adf00 2024-04-18T03:42:37.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f415affd700 1 -- 172.21.15.157:0/866699162 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c007460 con 0x7f41640adf00 2024-04-18T03:42:37.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41640a8b10 con 0x7f41640adf00 2024-04-18T03:42:37.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416404e650 con 0x7f41640adf00 2024-04-18T03:42:37.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f415affd700 1 -- 172.21.15.157:0/866699162 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f414c0075c0 con 0x7f41640adf00 2024-04-18T03:42:37.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.513+0000 7f415affd700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4148066730 0x7f4148068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.517+0000 7f415affd700 1 -- 172.21.15.157:0/866699162 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f414c083a90 con 0x7f41640adf00 2024-04-18T03:42:37.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.517+0000 7f416259c700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4148066730 0x7f4148068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.517+0000 7f416259c700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4148066730 0x7f4148068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4154009d80 tx=0x7f4154009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.525+0000 7f415affd700 1 -- 172.21.15.157:0/866699162 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f414c050910 con 0x7f41640adf00 2024-04-18T03:42:37.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.729+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f416406f040 con 0x7f41640adf00 2024-04-18T03:42:37.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f415affd700 1 -- 172.21.15.157:0/866699162 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4742 (secure 0 0 0) 0x7f414c017020 con 0x7f41640adf00 2024-04-18T03:42:37.734 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:42:37.734 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T03:37:34.273529+0000","modified":"2024-04-18T03:37:50.365620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T03:42:37.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4148066730 msgr2=0x7f4148068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4148066730 0x7f4148068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4154009d80 tx=0x7f4154009240 comp rx=0 tx=0).stop 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41640adf00 msgr2=0x7f4164157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41640adf00 0x7f4164157670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f414c00c520 tx=0x7f414c00c830 comp rx=0 tx=0).stop 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 shutdown_connections 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f4148066730 0x7f4148068bf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41640adf00 0x7f4164157670 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f416415ac90 0x7f41641f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 --2- 172.21.15.157:0/866699162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41640716c0 0x7f41640a81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 >> 172.21.15.157:0/866699162 conn(0x7f41640b1330 msgr2=0x7f416406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 shutdown_connections 2024-04-18T03:42:37.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.733+0000 7f416359e700 1 -- 172.21.15.157:0/866699162 wait complete. 2024-04-18T03:42:37.738 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 9 2024-04-18T03:42:37.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T03:42:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06fd370700 1 Processor -- start 2024-04-18T03:42:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06fd370700 1 -- start start 2024-04-18T03:42:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06fd370700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f06f81433c0 0x7f06f80b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06fd370700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f80b2c30 con 0x7f06f81437a0 2024-04-18T03:42:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06fd370700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f80b41a0 con 0x7f06f80b3d30 2024-04-18T03:42:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06fd370700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80b2390 con 0x7f06f81433c0 2024-04-18T03:42:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f67fc700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f06f81437a0 0x7f06f815a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:60454/0 (socket says 172.21.15.157:60454) 2024-04-18T03:42:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f67fc700 1 -- 172.21.15.157:0/3558101856 learned_addr learned my addr 172.21.15.157:0/3558101856 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:42:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f6ffd700 1 --2- 172.21.15.157:0/3558101856 >> v2:172.21.15.175:3300/0 conn(0x7f06f81433c0 0x7f06f80b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f5ffb700 1 -- 172.21.15.157:0/3558101856 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072148487 0 0) 0x7f06f80b2c30 con 0x7f06f81437a0 2024-04-18T03:42:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f5ffb700 1 -- 172.21.15.157:0/3558101856 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e40035d0 con 0x7f06f81437a0 2024-04-18T03:42:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f5ffb700 1 -- 172.21.15.157:0/3558101856 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429534936 0 0) 0x7f06f80b41a0 con 0x7f06f80b3d30 2024-04-18T03:42:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f5ffb700 1 -- 172.21.15.157:0/3558101856 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06f80b2c30 con 0x7f06f80b3d30 2024-04-18T03:42:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f6ffd700 1 -- 172.21.15.157:0/3558101856 >> v1:172.21.15.175:6789/0 conn(0x7f06f80b3d30 legacy=0x7f06f815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f6ffd700 1 -- 172.21.15.157:0/3558101856 >> v1:172.21.15.157:6789/0 conn(0x7f06f81437a0 legacy=0x7f06f815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f6ffd700 1 -- 172.21.15.157:0/3558101856 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80b2670 con 0x7f06f81433c0 2024-04-18T03:42:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f6ffd700 1 --2- 172.21.15.157:0/3558101856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f81433c0 0x7f06f80b1d00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009880 tx=0x7f06e0009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f02a035eec4497 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f5ffb700 1 -- 172.21.15.157:0/3558101856 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011830 con 0x7f06f81433c0 2024-04-18T03:42:37.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f5ffb700 1 -- 172.21.15.157:0/3558101856 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f06e0011990 con 0x7f06f81433c0 2024-04-18T03:42:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.861+0000 7f06f5ffb700 1 -- 172.21.15.157:0/3558101856 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0011d40 con 0x7f06f81433c0 2024-04-18T03:42:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- 172.21.15.157:0/3558101856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f81433c0 msgr2=0x7f06f80b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 --2- 172.21.15.157:0/3558101856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f81433c0 0x7f06f80b1d00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009880 tx=0x7f06e0009b90 comp rx=0 tx=0).stop 2024-04-18T03:42:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- 172.21.15.157:0/3558101856 shutdown_connections 2024-04-18T03:42:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 --2- 172.21.15.157:0/3558101856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f81433c0 0x7f06f80b1d00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- 172.21.15.157:0/3558101856 >> 172.21.15.157:0/3558101856 conn(0x7f06f80b1170 msgr2=0x7f06f806e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- 172.21.15.157:0/3558101856 shutdown_connections 2024-04-18T03:42:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- 172.21.15.157:0/3558101856 wait complete. 2024-04-18T03:42:37.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 Processor -- start 2024-04-18T03:42:37.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- start start 2024-04-18T03:42:37.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f80b3d30 0x7f06f812f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06f81433c0 0x7f06f80ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f81437a0 0x7f06f806e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80aa7c0 con 0x7f06f81433c0 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80aa330 con 0x7f06f80b3d30 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06fd370700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80a9720 con 0x7f06f81437a0 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.865+0000 7f06f67fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06f81433c0 0x7f06f80ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f6ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f80b3d30 0x7f06f812f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f67fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06f81433c0 0x7f06f80ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36096/0 (socket says 172.21.15.157:36096) 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f67fc700 1 -- 172.21.15.157:0/2014894717 learned_addr learned my addr 172.21.15.157:0/2014894717 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f77fe700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f81437a0 0x7f06f806e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f67fc700 1 -- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f81437a0 msgr2=0x7f06f806e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f67fc700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f81437a0 0x7f06f806e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f67fc700 1 -- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f80b3d30 msgr2=0x7f06f812f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f67fc700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f80b3d30 0x7f06f812f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f67fc700 1 -- 172.21.15.157:0/2014894717 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00094b0 con 0x7f06f81433c0 2024-04-18T03:42:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f6ffd700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f80b3d30 0x7f06f812f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:42:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06f67fc700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06f81433c0 0x7f06f80ad860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f06e800cbf0 tx=0x7f06e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06ef7fe700 1 -- 172.21.15.157:0/2014894717 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8007480 con 0x7f06f81433c0 2024-04-18T03:42:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06ef7fe700 1 -- 172.21.15.157:0/2014894717 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f06e80075e0 con 0x7f06f81433c0 2024-04-18T03:42:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06ef7fe700 1 -- 172.21.15.157:0/2014894717 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8007950 con 0x7f06f81433c0 2024-04-18T03:42:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f80a9a00 con 0x7f06f81433c0 2024-04-18T03:42:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f80a9fc0 con 0x7f06f81433c0 2024-04-18T03:42:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06ef7fe700 1 -- 172.21.15.157:0/2014894717 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06e801b3b0 con 0x7f06f81433c0 2024-04-18T03:42:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f804e6c0 con 0x7f06f81433c0 2024-04-18T03:42:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.869+0000 7f06ef7fe700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f06d8066760 0x7f06d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.873+0000 7f06ef7fe700 1 -- 172.21.15.157:0/2014894717 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06e8083dd0 con 0x7f06f81433c0 2024-04-18T03:42:37.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.873+0000 7f06f6ffd700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f06d8066760 0x7f06d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:37.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.873+0000 7f06f6ffd700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f06d8066760 0x7f06d8068c20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f06e00090b0 tx=0x7f06e0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:37.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:37.877+0000 7f06ef7fe700 1 -- 172.21.15.157:0/2014894717 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f06e8050da0 con 0x7f06f81433c0 2024-04-18T03:42:38.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06f80aa180 con 0x7f06f81433c0 2024-04-18T03:42:38.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06ef7fe700 1 -- 172.21.15.157:0/2014894717 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4742 (secure 0 0 0) 0x7f06e8085020 con 0x7f06f81433c0 2024-04-18T03:42:38.086 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:42:38.086 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/3365397279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":3365397279},{"type":"v1","addr":"172.21.15.157:6833","nonce":3365397279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1278782341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1278782341},{"type":"v1","addr":"172.21.15.175:6835","nonce":1278782341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3341152448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":3341152448},{"type":"v1","addr":"172.21.15.157:6835","nonce":3341152448}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T03:37:34.273529+0000","modified":"2024-04-18T03:37:50.365620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1564130449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1564130449},{"type":"v1","addr":"172.21.15.175:6837","nonce":1564130449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f06d8066760 msgr2=0x7f06d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f06d8066760 0x7f06d8068c20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f06e00090b0 tx=0x7f06e0008030 comp rx=0 tx=0).stop 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06f81433c0 msgr2=0x7f06f80ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06f81433c0 0x7f06f80ad860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f06e800cbf0 tx=0x7f06e800cc20 comp rx=0 tx=0).stop 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 shutdown_connections 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f06d8066760 0x7f06d8068c20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f81437a0 0x7f06f806e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06f81433c0 0x7f06f80ad860 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 --2- 172.21.15.157:0/2014894717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f80b3d30 0x7f06f812f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 >> 172.21.15.157:0/2014894717 conn(0x7f06f80b1170 msgr2=0x7f06f81e4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 shutdown_connections 2024-04-18T03:42:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.085+0000 7f06fd370700 1 -- 172.21.15.157:0/2014894717 wait complete. 2024-04-18T03:42:38.090 INFO:teuthology.orchestra.run.smithi157.stderr:dumped fsmap epoch 9 2024-04-18T03:42:38.101 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T03:42:38.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 Processor -- start 2024-04-18T03:42:38.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- start start 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd414071890 0x7fd41415a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 0x7fd41415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41415bf10 con 0x7fd4140adf00 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41415b5c0 con 0x7fd414071890 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140ae2e0 con 0x7fd41415aac0 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd412ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd414071890 0x7fd41415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd413fff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 0x7fd41415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd412ffd700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd414071890 0x7fd41415a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.157:60566/0 (socket says 172.21.15.157:60566) 2024-04-18T03:42:38.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd412ffd700 1 -- 172.21.15.157:0/4241665362 learned_addr learned my addr 172.21.15.157:0/4241665362 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd412ffd700 1 -- 172.21.15.157:0/4241665362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 msgr2=0x7fd41415c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd412ffd700 1 --2- 172.21.15.157:0/4241665362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 0x7fd41415c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd412ffd700 1 -- 172.21.15.157:0/4241665362 >> v1:172.21.15.175:6789/0 conn(0x7fd4140adf00 legacy=0x7fd414071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd412ffd700 1 -- 172.21.15.157:0/4241665362 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41415b2e0 con 0x7fd414071890 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd412ffd700 1 --2- 172.21.15.157:0/4241665362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 0x7fd41415a580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009910 tx=0x7fd3fc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a1d8f302cd2988e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd4127fc700 1 -- 172.21.15.157:0/4241665362 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc011830 con 0x7fd414071890 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd4127fc700 1 -- 172.21.15.157:0/4241665362 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd3fc011990 con 0x7fd414071890 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd4127fc700 1 -- 172.21.15.157:0/4241665362 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc011d60 con 0x7fd414071890 2024-04-18T03:42:38.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- 172.21.15.157:0/4241665362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 msgr2=0x7fd41415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 --2- 172.21.15.157:0/4241665362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 0x7fd41415a580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009910 tx=0x7fd3fc009c20 comp rx=0 tx=0).stop 2024-04-18T03:42:38.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- 172.21.15.157:0/4241665362 shutdown_connections 2024-04-18T03:42:38.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 --2- 172.21.15.157:0/4241665362 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 0x7fd41415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 --2- 172.21.15.157:0/4241665362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 0x7fd41415a580 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- 172.21.15.157:0/4241665362 >> 172.21.15.157:0/4241665362 conn(0x7fd4140b1330 msgr2=0x7fd41406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:38.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- 172.21.15.157:0/4241665362 shutdown_connections 2024-04-18T03:42:38.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.213+0000 7fd418d1d700 1 -- 172.21.15.157:0/4241665362 wait complete. 2024-04-18T03:42:38.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd418d1d700 1 Processor -- start 2024-04-18T03:42:38.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd418d1d700 1 -- start start 2024-04-18T03:42:38.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd418d1d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 0x7fd4141efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd418d1d700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4140adf00 0x7fd414158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd418d1d700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 0x7fd4141586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd418d1d700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd414152310 con 0x7fd4140adf00 2024-04-18T03:42:38.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd418d1d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140a76c0 con 0x7fd414071890 2024-04-18T03:42:38.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd418d1d700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4141599d0 con 0x7fd41415aac0 2024-04-18T03:42:38.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd412ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4140adf00 0x7fd414158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd412ffd700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4140adf00 0x7fd414158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36110/0 (socket says 172.21.15.157:36110) 2024-04-18T03:42:38.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd4137fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 0x7fd4141efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd412ffd700 1 -- 172.21.15.157:0/495437972 learned_addr learned my addr 172.21.15.157:0/495437972 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:38.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd413fff700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 0x7fd4141586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd412ffd700 1 -- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 msgr2=0x7fd4141586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd412ffd700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 0x7fd4141586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd412ffd700 1 -- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 msgr2=0x7fd4141efff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd412ffd700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 0x7fd4141efff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd412ffd700 1 -- 172.21.15.157:0/495437972 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc009570 con 0x7fd4140adf00 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.217+0000 7fd4137fe700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 0x7fd4141efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd412ffd700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4140adf00 0x7fd414158180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc000c00 tx=0x7fd3fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd40bfff700 1 -- 172.21.15.157:0/495437972 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc004510 con 0x7fd4140adf00 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd40bfff700 1 -- 172.21.15.157:0/495437972 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd3fc0036c0 con 0x7fd4140adf00 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41414f0c0 con 0x7fd4140adf00 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd40bfff700 1 -- 172.21.15.157:0/495437972 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc003a90 con 0x7fd4140adf00 2024-04-18T03:42:38.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41414f450 con 0x7fd4140adf00 2024-04-18T03:42:38.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41404e650 con 0x7fd4140adf00 2024-04-18T03:42:38.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd40bfff700 1 -- 172.21.15.157:0/495437972 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3fc003bf0 con 0x7fd4140adf00 2024-04-18T03:42:38.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.221+0000 7fd40bfff700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3f4066730 0x7fd3f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.225+0000 7fd40bfff700 1 -- 172.21.15.157:0/495437972 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3fc021030 con 0x7fd4140adf00 2024-04-18T03:42:38.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.225+0000 7fd4137fe700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3f4066730 0x7fd3f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.225+0000 7fd4137fe700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3f4066730 0x7fd3f4068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd404000f60 tx=0x7fd404009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.229+0000 7fd40bfff700 1 -- 172.21.15.157:0/495437972 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fd3fc052aa0 con 0x7fd4140adf00 2024-04-18T03:42:38.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.405+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd41406f040 con 0x7fd4140adf00 2024-04-18T03:42:38.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.409+0000 7fd40bfff700 1 -- 172.21.15.157:0/495437972 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18314 (secure 0 0 0) 0x7fd3fc015090 con 0x7fd4140adf00 2024-04-18T03:42:38.428 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-18T03:42:38.428 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":27,"fsid":"f4d3acd0-980f-44ff-9559-06e2da8e4de0","created":"2024-04-18T03:37:16.507890+0000","modified":"2024-04-18T03:38:23.499711+0000","last_up_change":"2024-04-18T03:37:27.828246+0000","last_in_change":"2024-04-18T03:37:19.569434+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T03:37:27.828061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-18T03:37:32.619811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-18T03:37:33.276945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-18T03:37:36.333331+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"165c2f33-363d-484c-8207-ae6b65dac033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":26046},{"type":"v1","addr":"172.21.15.157:6822","nonce":26046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":26046},{"type":"v1","addr":"172.21.15.157:6827","nonce":26046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":26046},{"type":"v1","addr":"172.21.15.157:6831","nonce":26046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":26046},{"type":"v1","addr":"172.21.15.157:6829","nonce":26046}]},"public_addr":"172.21.15.157:6822/26046","cluster_addr":"172.21.15.157:6827/26046","heartbeat_back_addr":"172.21.15.157:6831/26046","heartbeat_front_addr":"172.21.15.157:6829/26046","state":["exists","up"]},{"osd":1,"uuid":"d9a44f35-aaa1-4852-8915-e09a3db3a69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":26043},{"type":"v1","addr":"172.21.15.157:6809","nonce":26043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":26043},{"type":"v1","addr":"172.21.15.157:6811","nonce":26043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":26043},{"type":"v1","addr":"172.21.15.157:6815","nonce":26043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":26043},{"type":"v1","addr":"172.21.15.157:6813","nonce":26043}]},"public_addr":"172.21.15.157:6809/26043","cluster_addr":"172.21.15.157:6811/26043","heartbeat_back_addr":"172.21.15.157:6815/26043","heartbeat_front_addr":"172.21.15.157:6813/26043","state":["exists","up"]},{"osd":2,"uuid":"1609c2d8-8c94-4fcc-83b8-814080945e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":26044},{"type":"v1","addr":"172.21.15.157:6801","nonce":26044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":26044},{"type":"v1","addr":"172.21.15.157:6803","nonce":26044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":26044},{"type":"v1","addr":"172.21.15.157:6807","nonce":26044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":26044},{"type":"v1","addr":"172.21.15.157:6805","nonce":26044}]},"public_addr":"172.21.15.157:6801/26044","cluster_addr":"172.21.15.157:6803/26044","heartbeat_back_addr":"172.21.15.157:6807/26044","heartbeat_front_addr":"172.21.15.157:6805/26044","state":["exists","up"]},{"osd":3,"uuid":"9ebb0677-95fc-47c6-84a7-12a33666c582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":26045},{"type":"v1","addr":"172.21.15.157:6817","nonce":26045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":26045},{"type":"v1","addr":"172.21.15.157:6819","nonce":26045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6825","nonce":26045},{"type":"v1","addr":"172.21.15.157:6826","nonce":26045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6821","nonce":26045},{"type":"v1","addr":"172.21.15.157:6823","nonce":26045}]},"public_addr":"172.21.15.157:6817/26045","cluster_addr":"172.21.15.157:6819/26045","heartbeat_back_addr":"172.21.15.157:6826/26045","heartbeat_front_addr":"172.21.15.157:6823/26045","state":["exists","up"]},{"osd":4,"uuid":"ddcb2147-b03c-478b-afb0-ab02c990eb37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":26209},{"type":"v1","addr":"172.21.15.175:6801","nonce":26209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":26209},{"type":"v1","addr":"172.21.15.175:6803","nonce":26209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":26209},{"type":"v1","addr":"172.21.15.175:6807","nonce":26209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":26209},{"type":"v1","addr":"172.21.15.175:6805","nonce":26209}]},"public_addr":"172.21.15.175:6801/26209","cluster_addr":"172.21.15.175:6803/26209","heartbeat_back_addr":"172.21.15.175:6807/26209","heartbeat_front_addr":"172.21.15.175:6805/26209","state":["exists","up"]},{"osd":5,"uuid":"61c6e576-8a03-4f71-a038-70c825757adf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":26210},{"type":"v1","addr":"172.21.15.175:6825","nonce":26210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":26210},{"type":"v1","addr":"172.21.15.175:6827","nonce":26210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":26210},{"type":"v1","addr":"172.21.15.175:6831","nonce":26210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":26210},{"type":"v1","addr":"172.21.15.175:6829","nonce":26210}]},"public_addr":"172.21.15.175:6825/26210","cluster_addr":"172.21.15.175:6827/26210","heartbeat_back_addr":"172.21.15.175:6831/26210","heartbeat_front_addr":"172.21.15.175:6829/26210","state":["exists","up"]},{"osd":6,"uuid":"d5efcff2-47ac-4251-b7a7-0824d81eada7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":26207},{"type":"v1","addr":"172.21.15.175:6810","nonce":26207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":26207},{"type":"v1","addr":"172.21.15.175:6814","nonce":26207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":26207},{"type":"v1","addr":"172.21.15.175:6822","nonce":26207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":26207},{"type":"v1","addr":"172.21.15.175:6818","nonce":26207}]},"public_addr":"172.21.15.175:6810/26207","cluster_addr":"172.21.15.175:6814/26207","heartbeat_back_addr":"172.21.15.175:6822/26207","heartbeat_front_addr":"172.21.15.175:6818/26207","state":["exists","up"]},{"osd":7,"uuid":"27fea2a0-4e98-4a08-b43c-de96cd113585","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":26208},{"type":"v1","addr":"172.21.15.175:6811","nonce":26208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":26208},{"type":"v1","addr":"172.21.15.175:6815","nonce":26208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":26208},{"type":"v1","addr":"172.21.15.175:6823","nonce":26208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":26208},{"type":"v1","addr":"172.21.15.175:6819","nonce":26208}]},"public_addr":"172.21.15.175:6811/26208","cluster_addr":"172.21.15.175:6815/26208","heartbeat_back_addr":"172.21.15.175:6823/26208","heartbeat_front_addr":"172.21.15.175:6819/26208","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.876989+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.899496+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.352439+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.359331+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.847053+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.574529+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:25.019677+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T03:37:24.534422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T03:42:38.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.409+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3f4066730 msgr2=0x7fd3f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.409+0000 7fd418d1d700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3f4066730 0x7fd3f4068bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd404000f60 tx=0x7fd404009040 comp rx=0 tx=0).stop 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.409+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4140adf00 msgr2=0x7fd414158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.409+0000 7fd418d1d700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4140adf00 0x7fd414158180 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc000c00 tx=0x7fd3fc004770 comp rx=0 tx=0).stop 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.413+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 shutdown_connections 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.413+0000 7fd418d1d700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fd3f4066730 0x7fd3f4068bf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.413+0000 7fd418d1d700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd41415aac0 0x7fd4141586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.413+0000 7fd418d1d700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4140adf00 0x7fd414158180 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.413+0000 7fd418d1d700 1 --2- 172.21.15.157:0/495437972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd414071890 0x7fd4141efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.413+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 >> 172.21.15.157:0/495437972 conn(0x7fd4140b1330 msgr2=0x7fd4140ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.413+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 shutdown_connections 2024-04-18T03:42:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.413+0000 7fd418d1d700 1 -- 172.21.15.157:0/495437972 wait complete. 2024-04-18T03:42:38.431 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-18T03:42:38.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.545+0000 7fba3aa3b700 1 Processor -- start 2024-04-18T03:42:38.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.545+0000 7fba3aa3b700 1 -- start start 2024-04-18T03:42:38.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.545+0000 7fba3aa3b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba340b7b30 0x7fba340b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.545+0000 7fba3aa3b700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba34070b40 con 0x7fba3406b7d0 2024-04-18T03:42:38.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.545+0000 7fba3aa3b700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba34070210 con 0x7fba34146aa0 2024-04-18T03:42:38.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.545+0000 7fba3aa3b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba340b8520 con 0x7fba340b7b30 2024-04-18T03:42:38.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba2b7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fba3406b7d0 0x7fba340d05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:60458/0 (socket says 172.21.15.157:60458) 2024-04-18T03:42:38.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba2b7fe700 1 -- 172.21.15.157:0/3916781028 learned_addr learned my addr 172.21.15.157:0/3916781028 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:42:38.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba38fd8700 1 --2- 172.21.15.157:0/3916781028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba340b7b30 0x7fba340b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba337fe700 1 -- 172.21.15.157:0/3916781028 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270498774 0 0) 0x7fba34070b40 con 0x7fba3406b7d0 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba337fe700 1 -- 172.21.15.157:0/3916781028 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba200035d0 con 0x7fba3406b7d0 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba337fe700 1 -- 172.21.15.157:0/3916781028 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485916361 0 0) 0x7fba34070210 con 0x7fba34146aa0 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba38fd8700 1 -- 172.21.15.157:0/3916781028 >> v1:172.21.15.175:6789/0 conn(0x7fba34146aa0 legacy=0x7fba340b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba38fd8700 1 -- 172.21.15.157:0/3916781028 >> v1:172.21.15.157:6789/0 conn(0x7fba3406b7d0 legacy=0x7fba340d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba38fd8700 1 -- 172.21.15.157:0/3916781028 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340704f0 con 0x7fba340b7b30 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba38fd8700 1 --2- 172.21.15.157:0/3916781028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba340b7b30 0x7fba340b7fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009df0 tx=0x7fba2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10ffe6125cb44bf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba337fe700 1 -- 172.21.15.157:0/3916781028 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00e070 con 0x7fba340b7b30 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba337fe700 1 -- 172.21.15.157:0/3916781028 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fba2c00bae0 con 0x7fba340b7b30 2024-04-18T03:42:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba337fe700 1 -- 172.21.15.157:0/3916781028 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00be50 con 0x7fba340b7b30 2024-04-18T03:42:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba3aa3b700 1 -- 172.21.15.157:0/3916781028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba340b7b30 msgr2=0x7fba340b7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba3aa3b700 1 --2- 172.21.15.157:0/3916781028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba340b7b30 0x7fba340b7fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009df0 tx=0x7fba2c00b330 comp rx=0 tx=0).stop 2024-04-18T03:42:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba3aa3b700 1 -- 172.21.15.157:0/3916781028 shutdown_connections 2024-04-18T03:42:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba3aa3b700 1 --2- 172.21.15.157:0/3916781028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba340b7b30 0x7fba340b7fe0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba3aa3b700 1 -- 172.21.15.157:0/3916781028 >> 172.21.15.157:0/3916781028 conn(0x7fba3406e0e0 msgr2=0x7fba3406e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba3aa3b700 1 -- 172.21.15.157:0/3916781028 shutdown_connections 2024-04-18T03:42:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.549+0000 7fba3aa3b700 1 -- 172.21.15.157:0/3916781028 wait complete. 2024-04-18T03:42:38.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 Processor -- start 2024-04-18T03:42:38.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 -- start start 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba3406b7d0 0x7fba3415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba340b7b30 0x7fba341f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba34146aa0 0x7fba3415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba341f59c0 con 0x7fba3406b7d0 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3415cb30 con 0x7fba340b7b30 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba341406a0 con 0x7fba34146aa0 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba3406b7d0 0x7fba3415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba3406b7d0 0x7fba3415c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36122/0 (socket says 172.21.15.157:36122) 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba38fd8700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba34146aa0 0x7fba3415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 -- 172.21.15.157:0/1813437539 learned_addr learned my addr 172.21.15.157:0/1813437539 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba2b7fe700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba340b7b30 0x7fba341f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 -- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba34146aa0 msgr2=0x7fba3415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba34146aa0 0x7fba3415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 -- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba340b7b30 msgr2=0x7fba341f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba340b7b30 0x7fba341f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 -- 172.21.15.157:0/1813437539 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c009a70 con 0x7fba3406b7d0 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba38fd8700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba34146aa0 0x7fba3415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba33fff700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba3406b7d0 0x7fba3415c5f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fba2400c550 tx=0x7fba2400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba317fa700 1 -- 172.21.15.157:0/1813437539 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba240054e0 con 0x7fba3406b7d0 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba317fa700 1 -- 172.21.15.157:0/1813437539 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fba240036a0 con 0x7fba3406b7d0 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba317fa700 1 -- 172.21.15.157:0/1813437539 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24003a70 con 0x7fba3406b7d0 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba34140980 con 0x7fba3406b7d0 2024-04-18T03:42:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.553+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba340c8520 con 0x7fba3406b7d0 2024-04-18T03:42:38.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.557+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3404e6c0 con 0x7fba3406b7d0 2024-04-18T03:42:38.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.557+0000 7fba317fa700 1 -- 172.21.15.157:0/1813437539 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba24003bd0 con 0x7fba3406b7d0 2024-04-18T03:42:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.557+0000 7fba317fa700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fba14066730 0x7fba14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.557+0000 7fba317fa700 1 -- 172.21.15.157:0/1813437539 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fba24083930 con 0x7fba3406b7d0 2024-04-18T03:42:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.557+0000 7fba2b7fe700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fba14066730 0x7fba14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.561+0000 7fba2b7fe700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fba14066730 0x7fba14068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba1c007fd0 tx=0x7fba1c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.565+0000 7fba317fa700 1 -- 172.21.15.157:0/1813437539 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fba24050850 con 0x7fba3406b7d0 2024-04-18T03:42:38.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.765+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fba34140b70 con 0x7fba3406b7d0 2024-04-18T03:42:38.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba317fa700 1 -- 172.21.15.157:0/1813437539 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fba24017020 con 0x7fba3406b7d0 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fba14066730 msgr2=0x7fba14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fba14066730 0x7fba14068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba1c007fd0 tx=0x7fba1c009040 comp rx=0 tx=0).stop 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba3406b7d0 msgr2=0x7fba3415c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba3406b7d0 0x7fba3415c5f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fba2400c550 tx=0x7fba2400c860 comp rx=0 tx=0).stop 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 shutdown_connections 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fba14066730 0x7fba14068bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba340b7b30 0x7fba341f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba34146aa0 0x7fba3415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 --2- 172.21.15.157:0/1813437539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fba3406b7d0 0x7fba3415c5f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 >> 172.21.15.157:0/1813437539 conn(0x7fba3406e0e0 msgr2=0x7fba34070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:38.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 shutdown_connections 2024-04-18T03:42:38.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.785+0000 7fba3aa3b700 1 -- 172.21.15.157:0/1813437539 wait complete. 2024-04-18T03:42:38.790 INFO:teuthology.orchestra.run.smithi157.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-18T03:42:38.804 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-18T03:42:38.832 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-04-18T03:42:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b2359e700 1 Processor -- start 2024-04-18T03:42:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b2359e700 1 -- start start 2024-04-18T03:42:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b2359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 0x7f8b24070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b2359e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b240ac820 0x7f8b240accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b2359e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b240afd30 con 0x7f8b24071e90 2024-04-18T03:42:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b2359e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b240b0a10 con 0x7f8b240ac820 2024-04-18T03:42:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b2359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240b5140 con 0x7f8b2415cc20 2024-04-18T03:42:38.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b1bfff700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8b24071e90 0x7f8b24070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:60466/0 (socket says 172.21.15.157:60466) 2024-04-18T03:42:38.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.921+0000 7f8b1bfff700 1 -- 172.21.15.157:0/1048227250 learned_addr learned my addr 172.21.15.157:0/1048227250 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:42:38.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2259c700 1 --2- 172.21.15.157:0/1048227250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 0x7f8b24070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b22d9d700 1 --2- 172.21.15.157:0/1048227250 >> v2:172.21.15.175:3300/0 conn(0x7f8b240ac820 0x7f8b240accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b21d9b700 1 -- 172.21.15.157:0/1048227250 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519107148 0 0) 0x7f8b240afd30 con 0x7f8b24071e90 2024-04-18T03:42:38.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b21d9b700 1 -- 172.21.15.157:0/1048227250 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b100035d0 con 0x7f8b24071e90 2024-04-18T03:42:38.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b22d9d700 1 -- 172.21.15.157:0/1048227250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 msgr2=0x7f8b24070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:38.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b22d9d700 1 --2- 172.21.15.157:0/1048227250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 0x7f8b24070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b22d9d700 1 -- 172.21.15.157:0/1048227250 >> v1:172.21.15.157:6789/0 conn(0x7f8b24071e90 legacy=0x7f8b24070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b22d9d700 1 -- 172.21.15.157:0/1048227250 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b240b41f0 con 0x7f8b240ac820 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b22d9d700 1 --2- 172.21.15.157:0/1048227250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b240ac820 0x7f8b240accd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009d90 tx=0x7f8b1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816adb3e17166a37 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b21d9b700 1 -- 172.21.15.157:0/1048227250 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00e070 con 0x7f8b240ac820 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b21d9b700 1 -- 172.21.15.157:0/1048227250 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8b1c00bb20 con 0x7f8b240ac820 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b21d9b700 1 -- 172.21.15.157:0/1048227250 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c012430 con 0x7f8b240ac820 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- 172.21.15.157:0/1048227250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b240ac820 msgr2=0x7f8b240accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1048227250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b240ac820 0x7f8b240accd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009d90 tx=0x7f8b1c00b330 comp rx=0 tx=0).stop 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- 172.21.15.157:0/1048227250 shutdown_connections 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1048227250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b240ac820 0x7f8b240accd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1048227250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 0x7f8b24070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- 172.21.15.157:0/1048227250 >> 172.21.15.157:0/1048227250 conn(0x7f8b24098a50 msgr2=0x7f8b240b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- 172.21.15.157:0/1048227250 shutdown_connections 2024-04-18T03:42:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- 172.21.15.157:0/1048227250 wait complete. 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 Processor -- start 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- start start 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24071e90 0x7f8b2409ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b240ac820 0x7f8b241edee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 0x7f8b24157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240c6d90 con 0x7f8b240ac820 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2409d3f0 con 0x7f8b24071e90 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.925+0000 7f8b2359e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241ee420 con 0x7f8b2415cc20 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b240ac820 0x7f8b241edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b240ac820 0x7f8b241edee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36128/0 (socket says 172.21.15.157:36128) 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b2259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24071e90 0x7f8b2409ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 -- 172.21.15.157:0/1071205801 learned_addr learned my addr 172.21.15.157:0/1071205801 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b22d9d700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 0x7f8b24157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 -- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 msgr2=0x7f8b24157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 0x7f8b24157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 -- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24071e90 msgr2=0x7f8b2409ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24071e90 0x7f8b2409ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 -- 172.21.15.157:0/1071205801 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c009a70 con 0x7f8b240ac820 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1bfff700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b240ac820 0x7f8b241edee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00c700 tx=0x7f8b0c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1affd700 1 -- 172.21.15.157:0/1071205801 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c005d90 con 0x7f8b240ac820 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2409b620 con 0x7f8b240ac820 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1affd700 1 -- 172.21.15.157:0/1071205801 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8b0c0070d0 con 0x7f8b240ac820 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b1affd700 1 -- 172.21.15.157:0/1071205801 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0074a0 con 0x7f8b240ac820 2024-04-18T03:42:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b241ee930 con 0x7f8b240ac820 2024-04-18T03:42:38.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.929+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b240673b0 con 0x7f8b240ac820 2024-04-18T03:42:38.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.933+0000 7f8b1affd700 1 -- 172.21.15.157:0/1071205801 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b0c007600 con 0x7f8b240ac820 2024-04-18T03:42:38.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.933+0000 7f8b1affd700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8b04066730 0x7f8b04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.933+0000 7f8b1affd700 1 -- 172.21.15.157:0/1071205801 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f8b0c083be0 con 0x7f8b240ac820 2024-04-18T03:42:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.933+0000 7f8b2259c700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8b04066730 0x7f8b04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.933+0000 7f8b2259c700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8b04066730 0x7f8b04068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009b50 tx=0x7f8b14009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:38.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:38.937+0000 7f8b1affd700 1 -- 172.21.15.157:0/1071205801 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8b0c050990 con 0x7f8b240ac820 2024-04-18T03:42:39.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.145+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8b2404e650 con 0x7f8b240ac820 2024-04-18T03:42:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.785+0000 7f8b1affd700 1 -- 172.21.15.157:0/1071205801 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8b0c053fb0 con 0x7f8b240ac820 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8b04066730 msgr2=0x7f8b04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8b04066730 0x7f8b04068bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009b50 tx=0x7f8b14009240 comp rx=0 tx=0).stop 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b240ac820 msgr2=0x7f8b241edee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b240ac820 0x7f8b241edee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00c700 tx=0x7f8b0c00ca10 comp rx=0 tx=0).stop 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 shutdown_connections 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8b04066730 0x7f8b04068bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2415cc20 0x7f8b24157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b240ac820 0x7f8b241edee0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 --2- 172.21.15.157:0/1071205801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b24071e90 0x7f8b2409ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 >> 172.21.15.157:0/1071205801 conn(0x7f8b24098a50 msgr2=0x7f8b240ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 shutdown_connections 2024-04-18T03:42:39.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.793+0000 7f8b2359e700 1 -- 172.21.15.157:0/1071205801 wait complete. 2024-04-18T03:42:39.810 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-18T03:42:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc8f35700 1 Processor -- start 2024-04-18T03:42:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc8f35700 1 -- start start 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc8f35700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 0x7f8bc40b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc8f35700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8bc415a1e0 0x7f8bc415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc8f35700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc40afbe0 con 0x7f8bc40af6e0 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc8f35700 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc40afec0 con 0x7f8bc415a1e0 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc8f35700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40b01a0 con 0x7f8bc406c860 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc3fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8bc415a1e0 0x7f8bc415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc3fff700 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8bc415a1e0 0x7f8bc415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36142/0 (socket says 172.21.15.157:36142) 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc3fff700 1 -- 172.21.15.157:0/3198395657 learned_addr learned my addr 172.21.15.157:0/3198395657 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc37fe700 1 --2- 172.21.15.157:0/3198395657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 0x7f8bc40b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc3fff700 1 -- 172.21.15.157:0/3198395657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 msgr2=0x7f8bc40b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:39.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc3fff700 1 --2- 172.21.15.157:0/3198395657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 0x7f8bc40b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc3fff700 1 -- 172.21.15.157:0/3198395657 >> v1:172.21.15.175:6789/0 conn(0x7f8bc40af6e0 legacy=0x7f8bc406cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:39.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc3fff700 1 -- 172.21.15.157:0/3198395657 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40b0480 con 0x7f8bc415a1e0 2024-04-18T03:42:39.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc3fff700 1 --2- 172.21.15.157:0/3198395657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc415a670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc009e50 tx=0x7f8bbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8a9d50ae955f20 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc27fc700 1 -- 172.21.15.157:0/3198395657 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00e070 con 0x7f8bc415a1e0 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc27fc700 1 -- 172.21.15.157:0/3198395657 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8bbc00b9c0 con 0x7f8bc415a1e0 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.941+0000 7f8bc27fc700 1 -- 172.21.15.157:0/3198395657 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00bd90 con 0x7f8bc415a1e0 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3198395657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 msgr2=0x7f8bc415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3198395657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc415a670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc009e50 tx=0x7f8bbc00b330 comp rx=0 tx=0).stop 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3198395657 shutdown_connections 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3198395657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc415a670 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3198395657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 0x7f8bc40b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3198395657 >> 172.21.15.157:0/3198395657 conn(0x7f8bc40b16c0 msgr2=0x7f8bc40b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3198395657 shutdown_connections 2024-04-18T03:42:39.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3198395657 wait complete. 2024-04-18T03:42:39.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 Processor -- start 2024-04-18T03:42:39.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.945+0000 7f8bc8f35700 1 -- start start 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc8f35700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 0x7f8bc41ec870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc8f35700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc40af6e0 0x7f8bc40a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc8f35700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc40ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc8f35700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc414b140 con 0x7f8bc415a1e0 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc8f35700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc41ecdb0 con 0x7f8bc40af6e0 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc8f35700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40aa720 con 0x7f8bc406c860 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc40ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc40ade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36144/0 (socket says 172.21.15.157:36144) 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc37fe700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 0x7f8bc41ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 -- 172.21.15.157:0/3442462328 learned_addr learned my addr 172.21.15.157:0/3442462328 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc2ffd700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc40af6e0 0x7f8bc40a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 -- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 msgr2=0x7f8bc41ec870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 0x7f8bc41ec870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 -- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc40af6e0 msgr2=0x7f8bc40a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc40af6e0 0x7f8bc40a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 -- 172.21.15.157:0/3442462328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc009b30 con 0x7f8bc415a1e0 2024-04-18T03:42:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc3fff700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc40ade20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40d0b30 tx=0x7f8bbc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8babfff700 1 -- 172.21.15.157:0/3442462328 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0099b0 con 0x7f8bc415a1e0 2024-04-18T03:42:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8babfff700 1 -- 172.21.15.157:0/3442462328 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8bbc004250 con 0x7f8bc415a1e0 2024-04-18T03:42:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc40aaa00 con 0x7f8bc415a1e0 2024-04-18T03:42:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8babfff700 1 -- 172.21.15.157:0/3442462328 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc004600 con 0x7f8bc415a1e0 2024-04-18T03:42:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.949+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc40aafc0 con 0x7f8bc415a1e0 2024-04-18T03:42:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.953+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc414b280 con 0x7f8bc415a1e0 2024-04-18T03:42:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.953+0000 7f8babfff700 1 -- 172.21.15.157:0/3442462328 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8bbc004760 con 0x7f8bc415a1e0 2024-04-18T03:42:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.953+0000 7f8babfff700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8bb0066730 0x7f8bb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:39.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.953+0000 7f8babfff700 1 -- 172.21.15.157:0/3442462328 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f8bbc085b20 con 0x7f8bc415a1e0 2024-04-18T03:42:39.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.953+0000 7f8bc37fe700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8bb0066730 0x7f8bb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:39.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.953+0000 7f8bc37fe700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8bb0066730 0x7f8bb0068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009a00 tx=0x7f8bb8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:39.961+0000 7f8babfff700 1 -- 172.21.15.157:0/3442462328 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f8bc414b280 con 0x7f8bc415a1e0 2024-04-18T03:42:40.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.133+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8bc414b280 con 0x7f8bc415a1e0 2024-04-18T03:42:40.758 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:42:40.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:42:40.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.797+0000 7f8babfff700 1 -- 172.21.15.157:0/3442462328 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8bc414b280 con 0x7f8bc415a1e0 2024-04-18T03:42:40.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8bb0066730 msgr2=0x7f8bb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:40.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8bb0066730 0x7f8bb0068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009a00 tx=0x7f8bb8008040 comp rx=0 tx=0).stop 2024-04-18T03:42:40.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 msgr2=0x7f8bc40ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:40.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc40ade20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40d0b30 tx=0x7f8bbc004af0 comp rx=0 tx=0).stop 2024-04-18T03:42:40.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 shutdown_connections 2024-04-18T03:42:40.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f8bb0066730 0x7f8bb0068bf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:40.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bc40af6e0 0x7f8bc40a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:40.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8bc415a1e0 0x7f8bc40ade20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:40.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 --2- 172.21.15.157:0/3442462328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8bc406c860 0x7f8bc41ec870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:40.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.801+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 >> 172.21.15.157:0/3442462328 conn(0x7f8bc40b16c0 msgr2=0x7f8bc4142370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:40.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.805+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 shutdown_connections 2024-04-18T03:42:40.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.805+0000 7f8bc8f35700 1 -- 172.21.15.157:0/3442462328 wait complete. 2024-04-18T03:42:40.807 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_metadata' removed 2024-04-18T03:42:40.820 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-18T03:42:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.929+0000 7f08effff700 1 Processor -- start 2024-04-18T03:42:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.929+0000 7f08effff700 1 -- start start 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f08f0146a90 0x7f08f006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00b67c0 con 0x7f08f0071080 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00b6aa0 con 0x7f08f015e3d0 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00b6d80 con 0x7f08f0146a90 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08ef7fe700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f08f0071080 0x7f08f00d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:60482/0 (socket says 172.21.15.157:60482) 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08ef7fe700 1 -- 172.21.15.157:0/3860287110 learned_addr learned my addr 172.21.15.157:0/3860287110 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08eeffd700 1 --2- 172.21.15.157:0/3860287110 >> v2:172.21.15.175:3300/0 conn(0x7f08f0146a90 0x7f08f006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08edffb700 1 -- 172.21.15.157:0/3860287110 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192494409 0 0) 0x7f08f00b67c0 con 0x7f08f0071080 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08edffb700 1 -- 172.21.15.157:0/3860287110 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08dc0035d0 con 0x7f08f0071080 2024-04-18T03:42:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08edffb700 1 -- 172.21.15.157:0/3860287110 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570676028 0 0) 0x7f08f00b6aa0 con 0x7f08f015e3d0 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08edffb700 1 -- 172.21.15.157:0/3860287110 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08f00b67c0 con 0x7f08f015e3d0 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08edffb700 1 -- 172.21.15.157:0/3860287110 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2270641725 0 0) 0x7f08dc0035d0 con 0x7f08f0071080 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08eeffd700 1 -- 172.21.15.157:0/3860287110 >> v1:172.21.15.175:6789/0 conn(0x7f08f015e3d0 legacy=0x7f08f00b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08eeffd700 1 -- 172.21.15.157:0/3860287110 >> v1:172.21.15.157:6789/0 conn(0x7f08f0071080 legacy=0x7f08f00d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08eeffd700 1 -- 172.21.15.157:0/3860287110 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00d1850 con 0x7f08f0146a90 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08eeffd700 1 --2- 172.21.15.157:0/3860287110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0146a90 0x7f08f006a770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009850 tx=0x7f08d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36afcbf3c42f8bed server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08edffb700 1 -- 172.21.15.157:0/3860287110 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80019f0 con 0x7f08f0146a90 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08edffb700 1 -- 172.21.15.157:0/3860287110 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08d8004030 con 0x7f08f0146a90 2024-04-18T03:42:40.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08edffb700 1 -- 172.21.15.157:0/3860287110 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80043e0 con 0x7f08f0146a90 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 -- 172.21.15.157:0/3860287110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0146a90 msgr2=0x7f08f006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 --2- 172.21.15.157:0/3860287110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0146a90 0x7f08f006a770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009850 tx=0x7f08d8009b60 comp rx=0 tx=0).stop 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 -- 172.21.15.157:0/3860287110 shutdown_connections 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 --2- 172.21.15.157:0/3860287110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0146a90 0x7f08f006a770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 -- 172.21.15.157:0/3860287110 >> 172.21.15.157:0/3860287110 conn(0x7f08f006e200 msgr2=0x7f08f006e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 -- 172.21.15.157:0/3860287110 shutdown_connections 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.933+0000 7f08effff700 1 -- 172.21.15.157:0/3860287110 wait complete. 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 Processor -- start 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 -- start start 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0071080 0x7f08f0159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f0146a90 0x7f08f0144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08f015e3d0 0x7f08f0144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0144f60 con 0x7f08f0146a90 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0145240 con 0x7f08f0071080 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0145520 con 0x7f08f015e3d0 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f0146a90 0x7f08f0144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f0146a90 0x7f08f0144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36150/0 (socket says 172.21.15.157:36150) 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 -- 172.21.15.157:0/392568258 learned_addr learned my addr 172.21.15.157:0/392568258 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ef7fe700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08f015e3d0 0x7f08f0144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08eeffd700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0071080 0x7f08f0159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 -- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08f015e3d0 msgr2=0x7f08f0144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08f015e3d0 0x7f08f0144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 -- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0071080 msgr2=0x7f08f0159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0071080 0x7f08f0159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 -- 172.21.15.157:0/392568258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80094b0 con 0x7f08f0146a90 2024-04-18T03:42:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08ee7fc700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f0146a90 0x7f08f0144330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c490 tx=0x7f08e000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08e77fe700 1 -- 172.21.15.157:0/392568258 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e00052d0 con 0x7f08f0146a90 2024-04-18T03:42:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08e77fe700 1 -- 172.21.15.157:0/392568258 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08e0005450 con 0x7f08f0146a90 2024-04-18T03:42:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f0145800 con 0x7f08f0146a90 2024-04-18T03:42:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08e77fe700 1 -- 172.21.15.157:0/392568258 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0003900 con 0x7f08f0146a90 2024-04-18T03:42:40.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f0146000 con 0x7f08f0146a90 2024-04-18T03:42:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.937+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f0145d20 con 0x7f08f0146a90 2024-04-18T03:42:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.941+0000 7f08e77fe700 1 -- 172.21.15.157:0/392568258 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08e0003a60 con 0x7f08f0146a90 2024-04-18T03:42:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.941+0000 7f08e77fe700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f08d0066730 0x7f08d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.941+0000 7f08e77fe700 1 -- 172.21.15.157:0/392568258 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f08e0083a80 con 0x7f08f0146a90 2024-04-18T03:42:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.941+0000 7f08eeffd700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f08d0066730 0x7f08d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:40.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.941+0000 7f08eeffd700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f08d0066730 0x7f08d0068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08d80090b0 tx=0x7f08d8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:40.945+0000 7f08e77fe700 1 -- 172.21.15.157:0/392568258 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7f08f0145d20 con 0x7f08f0146a90 2024-04-18T03:42:41.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.113+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f08f0145d20 con 0x7f08f0146a90 2024-04-18T03:42:41.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.801+0000 7f08e77fe700 1 -- 172.21.15.157:0/392568258 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f08f0145d20 con 0x7f08f0146a90 2024-04-18T03:42:41.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f08d0066730 msgr2=0x7f08d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:41.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f08d0066730 0x7f08d0068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08d80090b0 tx=0x7f08d8008030 comp rx=0 tx=0).stop 2024-04-18T03:42:41.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f0146a90 msgr2=0x7f08f0144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:41.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f0146a90 0x7f08f0144330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c490 tx=0x7f08e000c850 comp rx=0 tx=0).stop 2024-04-18T03:42:41.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 shutdown_connections 2024-04-18T03:42:41.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7f08d0066730 0x7f08d0068bf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08f015e3d0 0x7f08f0144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08f0146a90 0x7f08f0144330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 --2- 172.21.15.157:0/392568258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08f0071080 0x7f08f0159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 >> 172.21.15.157:0/392568258 conn(0x7f08f006e200 msgr2=0x7f08f0160b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:41.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 shutdown_connections 2024-04-18T03:42:41.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.809+0000 7f08effff700 1 -- 172.21.15.157:0/392568258 wait complete. 2024-04-18T03:42:41.812 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_data' removed 2024-04-18T03:42:41.824 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-18T03:42:41.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.945+0000 7fcbef59e700 1 Processor -- start 2024-04-18T03:42:41.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.945+0000 7fcbef59e700 1 -- start start 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbef59e700 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcbe80e33a0 0x7fcbe8058950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbef59e700 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe80578b0 con 0x7fcbe8007280 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbef59e700 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe8057b90 con 0x7fcbe803ebd0 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbef59e700 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe80576c0 con 0x7fcbe80e33a0 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbeed9d700 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fcbe8007280 0x7fcbe803c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:60496/0 (socket says 172.21.15.157:60496) 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbeed9d700 1 -- 172.21.15.157:0/2415599857 learned_addr learned my addr 172.21.15.157:0/2415599857 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbee59c700 1 --2- 172.21.15.157:0/2415599857 >> v2:172.21.15.175:3300/0 conn(0x7fcbe80e33a0 0x7fcbe8058950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 <== mon.0 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502548659 0 0) 0x7fcbe80578b0 con 0x7fcbe8007280 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd80035d0 con 0x7fcbe8007280 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430091678 0 0) 0x7fcbe8057b90 con 0x7fcbe803ebd0 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe80578b0 con 0x7fcbe803ebd0 2024-04-18T03:42:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 <== mon.0 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1314828429 0 0) 0x7fcbd80035d0 con 0x7fcbe8007280 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 >> v2:172.21.15.175:3300/0 conn(0x7fcbe80e33a0 msgr2=0x7fcbe8058950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 --2- 172.21.15.157:0/2415599857 >> v2:172.21.15.175:3300/0 conn(0x7fcbe80e33a0 0x7fcbe8058950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 >> v1:172.21.15.175:6789/0 conn(0x7fcbe803ebd0 legacy=0x7fcbe8056fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8057e70 con 0x7fcbe8007280 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 <== mon.0 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 177629228 0 0) 0x7fcbf0073ba0 con 0x7fcbe8007280 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 >> v1:172.21.15.157:6789/0 conn(0x7fcbe8007280 legacy=0x7fcbe803c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbd8003bb0 0x7fcbd8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbd8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbd8005230 0x7fcbd800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd800bf70 con 0x7fcbd8004870 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd800c0b0 con 0x7fcbd8005230 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd800c220 con 0x7fcbd8003bb0 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbedd9b700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbd8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:41.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbee59c700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbd8003bb0 0x7fcbd8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbeed9d700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbd8005230 0x7fcbd800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbedd9b700 1 -- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbd8003bb0 msgr2=0x7fcbd8003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbedd9b700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbd8003bb0 0x7fcbd8003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbedd9b700 1 -- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbd8005230 msgr2=0x7fcbd800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbedd9b700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbd8005230 0x7fcbd800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbedd9b700 1 -- 172.21.15.157:0/2415599857 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd80035d0 con 0x7fcbd8004870 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbeed9d700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbd8005230 0x7fcbd800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbeed9d700 1 -- 172.21.15.157:0/2415599857 reap_dead start 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbee59c700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbd8003bb0 0x7fcbd8003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbedd9b700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbd8004cf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0001960 tx=0x7fcbd80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce271232159e3c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0001450 con 0x7fcbd8004870 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcbe0006a80 con 0x7fcbd8004870 2024-04-18T03:42:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.949+0000 7fcbed59a700 1 -- 172.21.15.157:0/2415599857 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0006e50 con 0x7fcbd8004870 2024-04-18T03:42:41.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 -- 172.21.15.157:0/2415599857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 msgr2=0x7fcbd8004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:41.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbd8004cf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0001960 tx=0x7fcbd80058a0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 -- 172.21.15.157:0/2415599857 shutdown_connections 2024-04-18T03:42:41.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 --2- 172.21.15.157:0/2415599857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbd8004cf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 -- 172.21.15.157:0/2415599857 >> 172.21.15.157:0/2415599857 conn(0x7fcbe8055a10 msgr2=0x7fcbe8055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:41.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 -- 172.21.15.157:0/2415599857 shutdown_connections 2024-04-18T03:42:41.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 -- 172.21.15.157:0/2415599857 wait complete. 2024-04-18T03:42:41.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 Processor -- start 2024-04-18T03:42:41.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.953+0000 7fcbef59e700 1 -- start start 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbe803b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe80389f0 0x7fcbe80df1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbe8039380 0x7fcbe8039800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80390d0 con 0x7fcbd8004870 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80e42c0 con 0x7fcbe80389f0 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8039d40 con 0x7fcbe8039380 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbe803b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbe803b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36170/0 (socket says 172.21.15.157:36170) 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 -- 172.21.15.157:0/1570992840 learned_addr learned my addr 172.21.15.157:0/1570992840 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbedd9b700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe80389f0 0x7fcbe80df1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbeed9d700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbe8039380 0x7fcbe8039800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 -- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbe8039380 msgr2=0x7fcbe8039800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbe8039380 0x7fcbe8039800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 -- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe80389f0 msgr2=0x7fcbe80df1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe80389f0 0x7fcbe80df1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 -- 172.21.15.157:0/1570992840 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8038400 con 0x7fcbd8004870 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbee59c700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbe803b310 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4011600 tx=0x7fcbe40119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbdeffd700 1 -- 172.21.15.157:0/1570992840 <== mon.0 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4004220 con 0x7fcbd8004870 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbdeffd700 1 -- 172.21.15.157:0/1570992840 <== mon.0 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcbe4004380 con 0x7fcbd8004870 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbdeffd700 1 -- 172.21.15.157:0/1570992840 <== mon.0 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40036c0 con 0x7fcbd8004870 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe8038e50 con 0x7fcbd8004870 2024-04-18T03:42:41.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe80e3c00 con 0x7fcbd8004870 2024-04-18T03:42:41.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.957+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe8056ed0 con 0x7fcbd8004870 2024-04-18T03:42:41.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.961+0000 7fcbdeffd700 1 -- 172.21.15.157:0/1570992840 <== mon.0 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcbe4003820 con 0x7fcbd8004870 2024-04-18T03:42:41.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.961+0000 7fcbdeffd700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcbd0066760 0x7fcbd0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T03:42:41.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.961+0000 7fcbdeffd700 1 -- 172.21.15.157:0/1570992840 <== mon.0 v2:172.21.15.157:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fcbe4084530 con 0x7fcbd8004870 2024-04-18T03:42:41.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.961+0000 7fcbedd9b700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcbd0066760 0x7fcbd0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T03:42:41.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.961+0000 7fcbedd9b700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcbd0066760 0x7fcbd0068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0000c00 tx=0x7fcbe0005040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T03:42:41.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:41.965+0000 7fcbdeffd700 1 -- 172.21.15.157:0/1570992840 <== mon.0 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175051 (secure 0 0 0) 0x7fcbe40517b0 con 0x7fcbd8004870 2024-04-18T03:42:42.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.137+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcbe8005440 con 0x7fcbd8004870 2024-04-18T03:42:42.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.817+0000 7fcbdeffd700 1 -- 172.21.15.157:0/1570992840 <== mon.0 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fcbe4054dd0 con 0x7fcbd8004870 2024-04-18T03:42:42.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcbd0066760 msgr2=0x7fcbd0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:42.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcbd0066760 0x7fcbd0068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0000c00 tx=0x7fcbe0005040 comp rx=0 tx=0).stop 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 msgr2=0x7fcbe803b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbe803b310 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4011600 tx=0x7fcbe40119c0 comp rx=0 tx=0).stop 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 shutdown_connections 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:6832/25864,v1:172.21.15.175:6833/25864] conn(0x7fcbd0066760 0x7fcbd0068c20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbe80389f0 0x7fcbe80df1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbe8039380 0x7fcbe8039800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 --2- 172.21.15.157:0/1570992840 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcbd8004870 0x7fcbe803b310 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 >> 172.21.15.157:0/1570992840 conn(0x7fcbe8055a10 msgr2=0x7fcbe804eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 shutdown_connections 2024-04-18T03:42:42.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-18T03:42:42.821+0000 7fcbef59e700 1 -- 172.21.15.157:0/1570992840 wait complete. 2024-04-18T03:42:42.827 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'cephfs_data_ec' removed 2024-04-18T03:42:42.840 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-18T03:42:42.840 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-18T03:42:42.840 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:42.851 INFO:tasks.ceph.mds.a:Stopped 2024-04-18T03:42:42.851 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-18T03:42:42.851 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:42.863 INFO:tasks.ceph.mds.c:Stopped 2024-04-18T03:42:42.863 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-18T03:42:42.864 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:42.878 INFO:tasks.ceph.mds.b:Stopped 2024-04-18T03:42:42.879 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-18T03:42:42.879 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:42.936 INFO:tasks.ceph.mds.d:Stopped 2024-04-18T03:42:42.936 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-18T03:42:42.937 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-18T03:42:42.937 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:43.035 INFO:tasks.ceph.osd.0:Stopped 2024-04-18T03:42:43.035 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-18T03:42:43.035 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:48.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-18T03:42:49.137 INFO:tasks.ceph.osd.1:Stopped 2024-04-18T03:42:49.138 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-18T03:42:49.138 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:49.230 INFO:tasks.ceph.osd.2:Stopped 2024-04-18T03:42:49.230 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-18T03:42:49.230 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:49.317 INFO:tasks.ceph.osd.3:Stopped 2024-04-18T03:42:49.318 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-18T03:42:49.318 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:49.414 INFO:tasks.ceph.osd.4:Stopped 2024-04-18T03:42:49.414 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-18T03:42:49.414 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:53.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-18T03:42:53.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-18T03:42:55.515 INFO:tasks.ceph.osd.5:Stopped 2024-04-18T03:42:55.516 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-18T03:42:55.516 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:55.611 INFO:tasks.ceph.osd.6:Stopped 2024-04-18T03:42:55.612 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-18T03:42:55.612 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:42:59.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-18T03:42:59.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-18T03:43:01.713 INFO:tasks.ceph.osd.7:Stopped 2024-04-18T03:43:01.714 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-18T03:43:01.714 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-18T03:43:01.714 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:43:01.743 INFO:tasks.ceph.mgr.y:Stopped 2024-04-18T03:43:01.743 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-18T03:43:01.743 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:43:01.773 INFO:tasks.ceph.mgr.x:Stopped 2024-04-18T03:43:01.773 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-18T03:43:01.773 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T03:43:01.773 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:43:01.815 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T03:43:01.815 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T03:43:01.816 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:43:01.850 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T03:43:01.850 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T03:43:01.850 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T03:43:01.943 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T03:43:01.944 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-18T03:43:01.944 DEBUG:teuthology.orchestra.run.smithi157:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-04-18T03:43:01.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:43:01.965 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-18T03:43:02.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:43:02.345 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-18T03:43:02.633 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:43:02.633 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-18T03:43:02.844 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:43:02.844 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-18T03:43:03.071 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:43:03.071 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-18T03:43:03.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:43:03.461 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-18T03:43:03.700 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:43:03.701 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-18T03:43:03.867 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:43:03.868 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-18T03:43:04.020 INFO:tasks.ceph:Archiving mon data... 2024-04-18T03:43:04.021 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/data/mon.a.tgz 2024-04-18T03:43:04.021 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-04-18T03:43:04.028 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.Zklspz4kAD 2024-04-18T03:43:04.028 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Zklspz4kAD 2024-04-18T03:43:04.115 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.Zklspz4kAD 2024-04-18T03:43:04.184 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.Zklspz4kAD is 324KB 2024-04-18T03:43:04.247 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.Zklspz4kAD 2024-04-18T03:43:04.254 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/data/mon.b.tgz 2024-04-18T03:43:04.254 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-18T03:43:04.261 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.HBUhBoqyV7 2024-04-18T03:43:04.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HBUhBoqyV7 2024-04-18T03:43:04.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.HBUhBoqyV7 2024-04-18T03:43:04.440 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.HBUhBoqyV7 is 429KB 2024-04-18T03:43:04.462 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.HBUhBoqyV7 2024-04-18T03:43:04.469 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/data/mon.c.tgz 2024-04-18T03:43:04.469 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-18T03:43:04.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-18T03:43:04.515 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.5fICUjMPGu 2024-04-18T03:43:04.516 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5fICUjMPGu 2024-04-18T03:43:04.625 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.5fICUjMPGu 2024-04-18T03:43:04.692 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.5fICUjMPGu is 428KB 2024-04-18T03:43:04.714 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.5fICUjMPGu 2024-04-18T03:43:04.720 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-18T03:43:04.720 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T03:43:04.722 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T03:43:04.737 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-18T03:43:04.737 DEBUG:teuthology.orchestra.run.smithi157:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T03:43:04.739 DEBUG:teuthology.orchestra.run.smithi175:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-18T03:43:04.766 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T03:43:04.815 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-18T03:43:04.821 INFO:tasks.ceph:Archiving crash dumps... 2024-04-18T03:43:04.823 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/remote/smithi157/crash 2024-04-18T03:43:04.823 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T03:43:04.840 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/remote/smithi175/crash 2024-04-18T03:43:04.841 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T03:43:04.858 INFO:tasks.ceph:Shutting down logrotate 2024-04-18T03:43:04.858 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:43:04.861 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-18T03:43:04.923 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-18T03:43:04.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-18T03:43:04.953 INFO:tasks.ceph:Compressing logs... 2024-04-18T03:43:04.953 DEBUG:teuthology.orchestra.run.smithi157:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T03:43:04.982 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T03:43:22.371 INFO:tasks.ceph:Archiving logs... 2024-04-18T03:43:22.371 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/remote/smithi157/log 2024-04-18T03:43:22.372 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T03:43:23.768 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/remote/smithi175/log 2024-04-18T03:43:23.769 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T03:43:25.919 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-18T03:43:25.929 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-18T03:43:25.929 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T03:43:25.931 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T03:43:26.003 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-18T03:43:26.013 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-18T03:43:26.013 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T03:43:26.016 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T03:43:26.039 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T03:43:26.039 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-04-18T03:43:26.039 INFO:teuthology.orchestra.run.smithi157.stdout:+hv01.front.sepi 67.205.162.81 3 u 54 64 377 0.094 -0.834 0.936 2024-04-18T03:43:26.040 INFO:teuthology.orchestra.run.smithi157.stdout:*hv02.front.sepi 63.231.80.2 3 u 62 64 377 0.071 1.724 0.851 2024-04-18T03:43:26.040 INFO:teuthology.orchestra.run.smithi157.stdout:+hv03.front.sepi 74.6.168.72 3 u 62 64 377 0.103 -0.055 1.157 2024-04-18T03:43:26.040 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:43:26.042 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-04-18T03:43:26.042 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-04-18T03:43:26.042 INFO:teuthology.orchestra.run.smithi175.stdout:*hv01.front.sepi 67.205.162.81 3 u 56 64 377 0.076 3.479 2.605 2024-04-18T03:43:26.042 INFO:teuthology.orchestra.run.smithi175.stdout:+hv02.front.sepi 63.231.80.2 3 u 54 64 377 0.107 3.746 1.223 2024-04-18T03:43:26.042 INFO:teuthology.orchestra.run.smithi175.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 64 377 0.099 1.044 1.988 2024-04-18T03:43:26.042 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-18T03:43:26.042 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-18T03:43:26.052 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-18T03:43:26.053 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-18T03:43:26.122 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-18T03:43:26.133 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-18T03:43:26.142 INFO:teuthology.task.internal:Duration was 930.684842 seconds 2024-04-18T03:43:26.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-18T03:43:26.154 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-18T03:43:26.154 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T03:43:26.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T03:43:26.205 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-18T03:43:26.205 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-04-18T03:43:26.206 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T03:43:26.217 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-04-18T03:43:26.218 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T03:43:26.229 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-18T03:43:26.229 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T03:43:26.231 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T03:43:26.310 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-18T03:43:26.311 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T03:43:26.313 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T03:43:26.390 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-18T03:43:26.402 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-18T03:43:26.402 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T03:43:26.418 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T03:43:26.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-18T03:43:26.506 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T03:43:26.509 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T03:43:26.522 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-04-18T03:43:26.523 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-04-18T03:43:26.540 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T03:43:26.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:43:26.587 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T03:43:26.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T03:43:26.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-18T03:43:26.603 INFO:teuthology.task.internal:Transferring archived files... 2024-04-18T03:43:26.604 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/remote/smithi157 2024-04-18T03:43:26.604 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T03:43:26.631 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661439/remote/smithi175 2024-04-18T03:43:26.631 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T03:43:26.658 INFO:teuthology.task.internal:Removing archive directory... 2024-04-18T03:43:26.658 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T03:43:26.671 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T03:43:26.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-18T03:43:26.688 INFO:teuthology.task.internal:Not uploading archives. 2024-04-18T03:43:26.688 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-18T03:43:26.699 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-18T03:43:26.699 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T03:43:26.701 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T03:43:26.706 INFO:teuthology.orchestra.run.smithi157.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 03:43 /home/ubuntu/cephtest 2024-04-18T03:43:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 03:43 /home/ubuntu/cephtest 2024-04-18T03:43:26.711 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-18T03:43:26.723 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-18T03:43:26.747 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/workunit/dir-max-entries} duration: 930.684841632843 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-18T03:43:26.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:43:26.835 INFO:teuthology.run:pass